[2025-09-19T17:00:02.673716] [INFO ] [MAIN ] Using last completed trading day: 2025-09-19 [2025-09-19T17:00:02.674231] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-19T17:00:02.674342] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-19T17:00:02.674381] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-19T17:00:04.195485] [DEBUG] [SYMBOL ] Found 2424 valid NYSE symbols. [2025-09-19T17:00:04.195704] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-19T17:00:04.195921] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-19T17:00:04.196581] [INFO ] [LOCAL ] Symbols cache updated with 2372 symbols. [2025-09-19T17:00:04.196672] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-19T17:00:04.196723] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-19T17:00:04.196784] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-19T17:00:04.196915] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-19T17:00:04.197282] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-19T17:00:04.197317] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-19T17:00:04.197485] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-19T17:00:04.197540] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2372 valid symbols. [2025-09-19T17:00:04.197573] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-19T17:00:04.197604] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-19T17:00:04.223546] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-19T17:00:04.250922] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-19T17:00:04.251112] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-19T17:00:04.251150] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-19T17:00:04.251179] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-19T17:00:04.251601] [WARN ] [STATE ] State set to: RUNNING [2025-09-19T17:00:04.251779] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-19T17:00:04.252181] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-19T17:00:04.252233] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-19T17:00:04.252317] [INFO ] [MAIN ] Starting incremental update for 2372 symbols. [2025-09-19T17:00:04.252354] [INFO ] [MAIN ] Running in parallel mode [2025-09-19T17:00:04.252519] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2372 symbols [2025-09-19T17:00:04.825843] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:04.841714] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-09-19T17:00:04.857285] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-09-19T17:00:04.881011] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-19T17:00:04.920042] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-19T17:00:04.944467] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-19T17:00:04.960059] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-19T17:00:04.928683] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:05.057045] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-09-19T17:00:05.089851] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:05.060564] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:05.095228] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-09-19T17:00:05.107908] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-19T17:00:05.107999] [DEBUG] [LOCAL ] AACT: No existing data file found in primary storage. [2025-09-19T17:00:05.119008] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-19T17:00:05.148794] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-19T17:00:05.169908] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-19T17:00:05.154095] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-19T17:00:05.148862] [WARN ] [MAIN ] AACT: No existing data found, performing full refresh instead. [2025-09-19T17:00:05.178136] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-19T17:00:05.182264] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-19T17:00:05.182571] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-19T17:00:05.182662] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-19T17:00:05.246509] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-19T17:00:05.251820] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-19T17:00:05.275526] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-19T17:00:05.295984] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-19T17:00:05.317306] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-19T17:00:06.200795] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:06.243141] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-19T17:00:06.603880] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:06.598804] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:06.616141] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-19T17:00:06.637112] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:06.633213] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-19T17:00:06.638496] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-19T17:00:07.068501] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-19T17:00:07.069771] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-19T17:00:07.088827] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-19T17:00:07.089917] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-19T17:00:07.500402] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-19T17:00:07.501821] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-19T17:00:07.696944] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T17:00:07.698602] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-19T17:00:07.847231] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-19T17:00:07.848619] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-19T17:00:08.112461] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T17:00:08.113500] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-19T17:00:08.304055] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-19T17:00:08.305044] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-19T17:00:08.457341] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T17:00:08.468693] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-19T17:00:08.520474] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T17:00:08.531267] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-19T17:00:08.612878] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-19T17:00:08.613967] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-19T17:00:08.869116] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:00:08.871399] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-19T17:00:08.893172] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-19T17:00:08.894271] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-19T17:00:09.199386] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-19T17:00:09.200302] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-19T17:00:09.881790] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-19T17:00:09.883432] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-19T17:00:09.892492] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T17:00:09.895285] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-19T17:00:10.302833] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T17:00:10.303933] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-19T17:00:10.438043] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:00:10.450088] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-19T17:00:10.923169] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T17:00:10.925868] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-19T17:00:11.030429] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-19T17:00:11.040724] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-19T17:00:11.506590] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-19T17:00:11.510832] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-19T17:00:12.141637] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:00:12.142442] [INFO ] [REMOTE ] AAM: Full fetch complete (999 records). [2025-09-19T17:00:12.142519] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-19T17:00:12.319960] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-19T17:00:12.320191] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:12.320241] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:12.320279] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-19T17:00:12.320337] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-19T17:00:12.320372] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-19T17:00:12.320410] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-19T17:00:12.320470] [INFO ] [MAIN ] Update Progress: 1/2372 symbols completed. AAM took 8.0s. Estimated remaining: 5h 18m 49s. Rate: 7.4 symbols/min [2025-09-19T17:00:12.491011] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:12.491454] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-19T17:00:12.491524] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-19T17:00:12.491762] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-19T17:00:12.492002] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-19T17:00:12.492154] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-19T17:00:12.492427] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-19T17:00:12.651225] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T17:00:12.709538] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-19T17:00:12.933261] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-19T17:00:12.931902] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:12.943699] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-19T17:00:12.947676] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-19T17:00:12.982775] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:00:12.993748] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-19T17:00:13.221742] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:13.222066] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-19T17:00:13.222563] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-19T17:00:13.389468] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T17:00:13.393005] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-19T17:00:14.649632] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:00:14.661915] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-19T17:00:15.144681] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:00:15.156203] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-19T17:00:16.090835] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-19T17:00:16.094758] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-19T17:00:16.159384] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-19T17:00:16.162165] [INFO ] [REMOTE ] AACT: Full fetch complete (10341 records). [2025-09-19T17:00:16.162267] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-19T17:00:16.162744] [FATAL] [VALIDATOR ] AACT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:00:16.162830] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:16.162873] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:16.162915] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-19T17:00:16.162972] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-19T17:00:16.163009] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-19T17:00:16.163048] [DEBUG] [LOCAL ] AACT: No derivative data file found to delete. [2025-09-19T17:00:16.163104] [INFO ] [MAIN ] Update Progress: 2/2372 symbols completed. AACT took 11.9s. Estimated remaining: 3h 55m 14s. Rate: 10.1 symbols/min [2025-09-19T17:00:16.336678] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:16.410640] [DEBUG] [LOCAL ] AAP: Loaded 52568 existing records from primary storage. [2025-09-19T17:00:16.410846] [INFO ] [MAIN ] AAP: Loaded 52568 existing records. [2025-09-19T17:00:16.610873] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:16.611146] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-19T17:00:16.611216] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-19T17:00:16.612848] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-19T17:00:16.612912] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-19T17:00:17.005782] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:17.006222] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-19T17:00:17.265301] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T17:00:17.281205] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-19T17:00:18.063207] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-09-19T17:00:18.074480] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-19T17:00:18.140694] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T17:00:18.144735] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-19T17:00:19.066230] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:00:19.076779] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-19T17:00:19.129103] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T17:00:19.140518] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-19T17:00:19.181748] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T17:00:19.186903] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-19T17:00:19.906575] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T17:00:19.926306] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-19T17:00:20.402884] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T17:00:20.410514] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-19T17:00:20.525429] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T17:00:20.539215] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-19T17:00:20.643872] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T17:00:20.654834] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-19T17:00:21.769191] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T17:00:21.775315] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-19T17:00:22.077150] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T17:00:22.087312] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-19T17:00:22.257037] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T17:00:22.268545] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-19T17:00:22.656780] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T17:00:22.680687] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-19T17:00:22.688200] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T17:00:22.694149] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-19T17:00:23.695688] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T17:00:23.707421] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-19T17:00:23.939552] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:00:23.951917] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-19T17:00:24.171833] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T17:00:24.178001] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-19T17:00:24.327736] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T17:00:24.341891] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-19T17:00:25.064815] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T17:00:25.070138] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-19T17:00:25.666590] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T17:00:25.679846] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-19T17:00:25.939549] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T17:00:25.950525] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-19T17:00:25.995868] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T17:00:26.007115] [INFO ] [REMOTE ] A: Full fetch complete (73119 records). [2025-09-19T17:00:26.007252] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-19T17:00:26.445404] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-19T17:00:26.445528] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-19T17:00:26.446408] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-19T17:00:26.446497] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-19T17:00:26.448712] [DEBUG] [LOCAL ] A: Trimmed 73119 records to 51608 (keeping 200 days of data) [2025-09-19T17:00:26.713342] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T17:00:26.719214] [INFO ] [REMOTE ] AAMI: Full fetch complete (29733 records). [2025-09-19T17:00:26.719570] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-19T17:00:26.720926] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:00:26.721772] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:26.722371] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:26.722709] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-19T17:00:26.723512] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-19T17:00:26.723841] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-19T17:00:26.723955] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-19T17:00:26.724071] [INFO ] [MAIN ] Update Progress: 3/2372 symbols completed. AAMI took 14.4s. Estimated remaining: 4h 55m 45s. Rate: 8.0 symbols/min [2025-09-19T17:00:26.904669] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:27.001049] [DEBUG] [LOCAL ] AAT: Loaded 30832 existing records from primary storage. [2025-09-19T17:00:27.002081] [INFO ] [MAIN ] AAT: Loaded 30832 existing records. [2025-09-19T17:00:27.197605] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:27.203845] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-19T17:00:27.206131] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-19T17:00:27.206018] [DEBUG] [LOCAL ] A: Primary data saved (51608 records). [2025-09-19T17:00:27.206312] [INFO ] [MAIN ] A: Full history saved. [2025-09-19T17:00:27.206604] [INFO ] [MAIN ] Update Progress: 4/2372 symbols completed. A took 23.0s. Estimated remaining: 3h 46m 29s. Rate: 10.5 symbols/min [2025-09-19T17:00:27.212084] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-19T17:00:27.259184] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-19T17:00:27.578258] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:27.640362] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-19T17:00:27.675564] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-19T17:00:27.709252] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-19T17:00:27.712570] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-19T17:00:27.723564] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-19T17:00:27.739179] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-19T17:00:27.914163] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:27.918962] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-19T17:00:28.186173] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:28.186750] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-19T17:00:28.225040] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T17:00:28.237402] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-19T17:00:28.318962] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-19T17:00:28.327632] [INFO ] [REMOTE ] AA: Full fetch complete (77512 records). [2025-09-19T17:00:28.327843] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-19T17:00:28.628487] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:28.631450] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-19T17:00:28.632337] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-19T17:00:28.730909] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-19T17:00:28.730998] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-19T17:00:28.731683] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-19T17:00:28.731752] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-19T17:00:28.733390] [DEBUG] [LOCAL ] AA: Trimmed 77512 records to 54365 (keeping 200 days of data) [2025-09-19T17:00:29.027208] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:29.052545] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-19T17:00:29.053548] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-19T17:00:29.083241] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T17:00:29.089931] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-19T17:00:29.105249] [DEBUG] [LOCAL ] AA: Primary data saved (54365 records). [2025-09-19T17:00:29.105418] [INFO ] [MAIN ] AA: Full history saved. [2025-09-19T17:00:29.105503] [INFO ] [MAIN ] Update Progress: 5/2372 symbols completed. AA took 24.8s. Estimated remaining: 3h 16m 5s. Rate: 12.1 symbols/min [2025-09-19T17:00:29.288258] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:29.288480] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-09-19T17:00:29.288524] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-09-19T17:00:29.288898] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-19T17:00:29.288954] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-19T17:00:29.289000] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-09-19T17:00:29.289036] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-19T17:00:29.322955] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:29.361391] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-19T17:00:29.373936] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-19T17:00:29.698680] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:29.699324] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-19T17:00:29.698886] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:29.700611] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-19T17:00:29.701157] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-19T17:00:30.340737] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:30.341577] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-19T17:00:30.342486] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-19T17:00:30.360968] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T17:00:30.367155] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-19T17:00:30.398920] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T17:00:30.411289] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-19T17:00:30.592531] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:30.592918] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-19T17:00:30.593460] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-19T17:00:30.962853] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T17:00:30.972007] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-19T17:00:31.351231] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T17:00:31.353578] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-19T17:00:31.689070] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T17:00:31.694867] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-19T17:00:31.921790] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T17:00:31.924495] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-19T17:00:32.032318] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:00:32.044263] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-19T17:00:32.270923] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T17:00:32.279024] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-19T17:00:32.586851] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T17:00:32.593597] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-19T17:00:33.041058] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T17:00:33.045240] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-19T17:00:33.590242] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T17:00:33.599553] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-19T17:00:33.801760] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:00:33.813556] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-19T17:00:33.861426] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T17:00:33.869236] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-19T17:00:34.269188] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T17:00:34.272714] [INFO ] [REMOTE ] AAUC: Full fetch complete (6975 records). [2025-09-19T17:00:34.272866] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-19T17:00:34.454248] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-19T17:00:34.454490] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:34.454573] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:34.454622] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-19T17:00:34.454729] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-19T17:00:34.454801] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-19T17:00:34.454865] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-19T17:00:34.454960] [INFO ] [MAIN ] Update Progress: 6/2372 symbols completed. AAUC took 7.2s. Estimated remaining: 3h 18m 30s. Rate: 11.9 symbols/min [2025-09-19T17:00:34.631372] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:34.698288] [DEBUG] [LOCAL ] ABBV: Loaded 54077 existing records from primary storage. [2025-09-19T17:00:34.698445] [INFO ] [MAIN ] ABBV: Loaded 54077 existing records. [2025-09-19T17:00:34.896344] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:34.896626] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-19T17:00:34.896711] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-19T17:00:34.898624] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-19T17:00:34.898715] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-19T17:00:35.292171] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:35.295994] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-19T17:00:35.322032] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T17:00:35.328912] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-19T17:00:35.492741] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T17:00:35.502945] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-19T17:00:35.735250] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T17:00:35.742567] [INFO ] [REMOTE ] AAP: Full fetch complete (74849 records). [2025-09-19T17:00:35.742753] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-19T17:00:35.747250] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:00:35.747407] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:35.747459] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:35.747525] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-19T17:00:35.747609] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-19T17:00:35.747695] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-09-19T17:00:35.748116] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-09-19T17:00:35.748266] [INFO ] [MAIN ] Update Progress: 7/2372 symbols completed. AAP took 19.6s. Estimated remaining: 2h 57m 21s. Rate: 13.3 symbols/min [2025-09-19T17:00:35.923465] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:35.963532] [DEBUG] [LOCAL ] ABCB: Loaded 31012 existing records from primary storage. [2025-09-19T17:00:35.963696] [INFO ] [MAIN ] ABCB: Loaded 31012 existing records. [2025-09-19T17:00:36.149588] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:36.149883] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-19T17:00:36.149935] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-19T17:00:36.150873] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-19T17:00:36.150937] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-19T17:00:36.520794] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:36.521315] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-19T17:00:36.540510] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T17:00:36.547764] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-19T17:00:37.043058] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:00:37.054377] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-19T17:00:37.206729] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T17:00:37.215348] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-19T17:00:37.553980] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T17:00:37.561438] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-19T17:00:38.007129] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T17:00:38.013979] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-19T17:00:38.170009] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:00:38.176913] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-19T17:00:38.980242] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T17:00:38.986307] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-19T17:00:39.057793] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:00:39.066520] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-19T17:00:39.233904] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T17:00:39.247416] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-19T17:00:39.747850] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T17:00:39.755084] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-19T17:00:40.366918] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T17:00:40.371244] [INFO ] [REMOTE ] AAT: Full fetch complete (42541 records). [2025-09-19T17:00:40.371334] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-19T17:00:40.371990] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:00:40.372079] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:40.372126] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:40.372205] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-19T17:00:40.372341] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-19T17:00:40.372398] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-19T17:00:40.372750] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-09-19T17:00:40.373660] [INFO ] [MAIN ] Update Progress: 8/2372 symbols completed. AAT took 13.6s. Estimated remaining: 2h 57m 54s. Rate: 13.3 symbols/min [2025-09-19T17:00:40.551314] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:40.621365] [DEBUG] [LOCAL ] ABEV: Loaded 53660 existing records from primary storage. [2025-09-19T17:00:40.621587] [INFO ] [MAIN ] ABEV: Loaded 53660 existing records. [2025-09-19T17:00:40.820174] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:40.830259] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-19T17:00:40.830039] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T17:00:40.835449] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-19T17:00:40.836368] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-19T17:00:40.837492] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-19T17:00:40.837583] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-19T17:00:41.224159] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:41.224720] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-19T17:00:41.315012] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T17:00:41.326853] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-19T17:00:41.497362] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T17:00:41.503919] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-19T17:00:42.138901] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T17:00:42.144255] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-19T17:00:42.669276] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T17:00:42.678260] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-19T17:00:42.791418] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-19T17:00:42.803585] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-19T17:00:43.637405] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-19T17:00:43.649227] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-19T17:00:43.660578] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T17:00:43.664881] [INFO ] [REMOTE ] AB: Full fetch complete (46093 records). [2025-09-19T17:00:43.664982] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-19T17:00:44.069931] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-19T17:00:44.070056] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-19T17:00:44.070586] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-19T17:00:44.070666] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-19T17:00:44.071748] [DEBUG] [LOCAL ] AB: Trimmed 46093 records to 29406 (keeping 200 days of data) [2025-09-19T17:00:44.185635] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T17:00:44.197949] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-19T17:00:44.294500] [DEBUG] [LOCAL ] AB: Primary data saved (29406 records). [2025-09-19T17:00:44.294744] [INFO ] [MAIN ] AB: Full history saved. [2025-09-19T17:00:44.294846] [INFO ] [MAIN ] Update Progress: 9/2372 symbols completed. AB took 15.2s. Estimated remaining: 2h 55m 13s. Rate: 13.5 symbols/min [2025-09-19T17:00:44.475617] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:44.496234] [DEBUG] [LOCAL ] ABG: Loaded 19091 existing records from primary storage. [2025-09-19T17:00:44.496374] [INFO ] [MAIN ] ABG: Loaded 19091 existing records. [2025-09-19T17:00:44.708611] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:00:44.715374] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:44.727211] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-19T17:00:44.726827] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-19T17:00:44.727365] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-19T17:00:44.729075] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-19T17:00:44.729160] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-19T17:00:45.103143] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:45.103548] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-19T17:00:45.523049] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T17:00:45.534550] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-19T17:00:45.644602] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T17:00:45.651353] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-19T17:00:46.066007] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T17:00:46.069885] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-19T17:00:46.768967] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T17:00:46.774149] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-19T17:00:46.808887] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T17:00:46.819217] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-19T17:00:47.096290] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T17:00:47.102433] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-19T17:00:47.391634] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T17:00:47.403580] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-19T17:00:48.052676] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T17:00:48.056421] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-19T17:00:48.250626] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T17:00:48.257989] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-19T17:00:48.413686] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T17:00:48.425256] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-19T17:00:49.299391] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T17:00:49.304507] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-19T17:00:49.596950] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:00:49.609575] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-19T17:00:49.908470] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T17:00:49.917437] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-19T17:00:50.283390] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T17:00:50.290004] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-19T17:00:50.705714] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T17:00:50.717278] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-19T17:00:51.072481] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T17:00:51.078997] [INFO ] [REMOTE ] ABCB: Full fetch complete (44236 records). [2025-09-19T17:00:51.079353] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-19T17:00:51.535881] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-19T17:00:51.536075] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-19T17:00:51.536762] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-19T17:00:51.536996] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-19T17:00:51.547883] [DEBUG] [LOCAL ] ABCB: Trimmed 44236 records to 31310 (keeping 200 days of data) [2025-09-19T17:00:51.548831] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T17:00:51.553306] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-19T17:00:51.709870] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:00:51.724739] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-19T17:00:51.827608] [DEBUG] [LOCAL ] ABCB: Primary data saved (31310 records). [2025-09-19T17:00:51.827821] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-19T17:00:51.828003] [INFO ] [MAIN ] Update Progress: 10/2372 symbols completed. ABCB took 16.1s. Estimated remaining: 3h 7m 17s. Rate: 12.6 symbols/min [2025-09-19T17:00:52.026629] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:52.060059] [DEBUG] [LOCAL ] ABM: Loaded 32511 existing records from primary storage. [2025-09-19T17:00:52.060224] [INFO ] [MAIN ] ABM: Loaded 32511 existing records. [2025-09-19T17:00:52.253704] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:52.254053] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-19T17:00:52.254114] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-19T17:00:52.255150] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-19T17:00:52.255217] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-19T17:00:52.625928] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:52.626287] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-19T17:00:52.664455] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T17:00:52.670361] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-19T17:00:52.809204] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T17:00:52.821184] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-19T17:00:53.551309] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T17:00:53.558124] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-19T17:00:53.592349] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:00:53.608712] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-19T17:00:53.667789] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T17:00:53.674819] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-19T17:00:54.832411] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:00:54.837159] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-19T17:00:55.064615] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T17:00:55.075575] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-19T17:00:55.178524] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T17:00:55.184515] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-19T17:00:55.427960] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T17:00:55.437237] [INFO ] [REMOTE ] ABBV: Full fetch complete (77721 records). [2025-09-19T17:00:55.437407] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-19T17:00:55.859558] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-19T17:00:55.859701] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-19T17:00:55.860545] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-19T17:00:55.860686] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-19T17:00:55.865045] [DEBUG] [LOCAL ] ABBV: Trimmed 77721 records to 54467 (keeping 200 days of data) [2025-09-19T17:00:56.206273] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T17:00:56.212885] [INFO ] [REMOTE ] ABG: Full fetch complete (26323 records). [2025-09-19T17:00:56.215875] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-19T17:00:56.427813] [DEBUG] [LOCAL ] ABBV: Primary data saved (54467 records). [2025-09-19T17:00:56.462425] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-19T17:00:56.487929] [INFO ] [MAIN ] Update Progress: 11/2372 symbols completed. ABBV took 22.0s. Estimated remaining: 3h 6m 52s. Rate: 12.6 symbols/min [2025-09-19T17:00:56.845940] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T17:00:56.880136] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:56.880522] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-19T17:00:56.881752] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-19T17:00:56.881624] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-19T17:00:56.882764] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-19T17:00:56.884280] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-19T17:00:56.887286] [DEBUG] [LOCAL ] ABG: Trimmed 26323 records to 19221 (keeping 200 days of data) [2025-09-19T17:00:57.022719] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T17:00:57.045598] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-19T17:00:57.101845] [DEBUG] [LOCAL ] ABR: Loaded 52531 existing records from primary storage. [2025-09-19T17:00:57.102880] [INFO ] [MAIN ] ABR: Loaded 52531 existing records. [2025-09-19T17:00:57.258111] [DEBUG] [LOCAL ] ABG: Primary data saved (19221 records). [2025-09-19T17:00:57.289807] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-19T17:00:57.296000] [INFO ] [MAIN ] Update Progress: 12/2372 symbols completed. ABG took 13.0s. Estimated remaining: 2h 53m 52s. Rate: 13.6 symbols/min [2025-09-19T17:00:57.295856] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:57.378074] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-19T17:00:57.397733] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-19T17:00:57.406475] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-19T17:00:57.416830] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-19T17:00:57.574919] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:57.892926] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:57.908484] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-19T17:00:57.912667] [DEBUG] [LOCAL ] ABT: Loaded 54011 existing records from primary storage. [2025-09-19T17:00:57.912915] [INFO ] [MAIN ] ABT: Loaded 54011 existing records. [2025-09-19T17:00:58.094926] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:58.095207] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-19T17:00:58.095260] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-19T17:00:58.097543] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-19T17:00:58.097610] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-19T17:00:58.454762] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:58.455091] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-19T17:00:58.717583] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T17:00:58.726290] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-19T17:00:59.227053] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T17:00:59.238897] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-19T17:00:59.588689] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:00:59.600521] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-19T17:00:59.835464] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T17:00:59.843203] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-19T17:01:00.652347] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T17:01:00.669366] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-19T17:01:01.132589] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T17:01:01.144922] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-19T17:01:01.418987] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:01:01.425634] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-19T17:01:01.761133] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-19T17:01:01.770831] [INFO ] [REMOTE ] ABEV: Full fetch complete (77195 records). [2025-09-19T17:01:01.771307] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-19T17:01:02.185709] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-19T17:01:02.185821] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-19T17:01:02.186620] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-19T17:01:02.186740] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-19T17:01:02.188556] [DEBUG] [LOCAL ] ABEV: Trimmed 77195 records to 54050 (keeping 200 days of data) [2025-09-19T17:01:02.455700] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:01:02.524830] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-19T17:01:02.567414] [DEBUG] [LOCAL ] ABEV: Primary data saved (54050 records). [2025-09-19T17:01:02.569068] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-19T17:01:02.570065] [INFO ] [MAIN ] Update Progress: 13/2372 symbols completed. ABEV took 22.2s. Estimated remaining: 2h 56m 22s. Rate: 13.4 symbols/min [2025-09-19T17:01:02.744788] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:02.781182] [DEBUG] [LOCAL ] ACA: Loaded 24478 existing records from primary storage. [2025-09-19T17:01:02.781540] [INFO ] [MAIN ] ACA: Loaded 24478 existing records. [2025-09-19T17:01:02.962905] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:02.963411] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-19T17:01:02.963486] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-19T17:01:02.964499] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-19T17:01:02.964563] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-19T17:01:03.395601] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T17:01:03.394130] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:03.403592] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-19T17:01:03.405284] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-19T17:01:03.439826] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T17:01:03.450818] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-19T17:01:04.210901] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T17:01:04.222889] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-19T17:01:04.861826] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T17:01:04.866428] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-19T17:01:05.012718] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T17:01:05.443314] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-19T17:01:05.649505] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:01:05.975389] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:01:06.243267] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-19T17:01:06.408625] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T17:01:07.035367] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T17:01:07.043221] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-19T17:01:07.843263] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-19T17:01:08.163477] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T17:01:08.643303] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-19T17:01:09.205338] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:01:09.448524] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-19T17:01:09.465005] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T17:01:10.243268] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-19T17:01:10.620952] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:01:10.626842] [INFO ] [REMOTE ] ABM: Full fetch complete (44314 records). [2025-09-19T17:01:10.626959] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-19T17:01:11.014074] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-19T17:01:11.014180] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-19T17:01:11.014627] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-19T17:01:11.014712] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-19T17:01:11.015896] [DEBUG] [LOCAL ] ABM: Trimmed 44314 records to 32750 (keeping 200 days of data) [2025-09-19T17:01:11.079052] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-19T17:01:11.157241] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T17:01:11.258381] [DEBUG] [LOCAL ] ABM: Primary data saved (32750 records). [2025-09-19T17:01:11.258556] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-19T17:01:11.258709] [INFO ] [MAIN ] Update Progress: 14/2372 symbols completed. ABM took 19.4s. Estimated remaining: 3h 8m 6s. Rate: 12.5 symbols/min [2025-09-19T17:01:11.445976] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:11.487523] [DEBUG] [LOCAL ] ACCO: Loaded 38341 existing records from primary storage. [2025-09-19T17:01:11.487730] [INFO ] [MAIN ] ACCO: Loaded 38341 existing records. [2025-09-19T17:01:11.668224] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:11.668494] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-19T17:01:11.668563] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-19T17:01:11.670314] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-19T17:01:11.670379] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-19T17:01:11.848898] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-19T17:01:12.043982] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:12.410226] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T17:01:12.643274] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-19T17:01:13.443304] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-19T17:01:13.550357] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-19T17:01:13.637594] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:01:14.243290] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-19T17:01:14.668934] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T17:01:14.860855] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T17:01:15.043284] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-19T17:01:15.204574] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T17:01:15.843276] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-19T17:01:16.643270] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-19T17:01:16.763849] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T17:01:17.443293] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-19T17:01:17.677555] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T17:01:17.755236] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T17:01:18.243273] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-19T17:01:18.551127] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T17:01:19.043283] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-19T17:01:19.641214] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T17:01:19.843281] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-19T17:01:20.643276] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-19T17:01:20.848674] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T17:01:21.366914] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T17:01:21.443232] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-19T17:01:21.831415] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T17:01:22.243279] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-19T17:01:23.043275] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-19T17:01:23.341059] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T17:01:23.468478] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T17:01:23.843307] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-19T17:01:24.308687] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:01:24.643297] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-19T17:01:25.443278] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-19T17:01:25.567977] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-19T17:01:26.243301] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-19T17:01:26.836007] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T17:01:26.965134] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-19T17:01:26.973350] [INFO ] [REMOTE ] ABT: Full fetch complete (77583 records). [2025-09-19T17:01:26.973520] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-19T17:01:27.048381] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-19T17:01:27.255880] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T17:01:27.299009] [INFO ] [REMOTE ] ACA: Full fetch complete (34282 records). [2025-09-19T17:01:27.311216] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-19T17:01:27.558725] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-19T17:01:27.574528] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-19T17:01:27.580740] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-19T17:01:27.580866] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-19T17:01:27.637848] [DEBUG] [LOCAL ] ABT: Trimmed 77583 records to 54400 (keeping 200 days of data) [2025-09-19T17:01:27.844256] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-19T17:01:27.953267] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-19T17:01:27.956038] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-19T17:01:27.958934] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-19T17:01:27.959752] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-19T17:01:27.964982] [DEBUG] [LOCAL ] ACA: Trimmed 34282 records to 24626 (keeping 200 days of data) [2025-09-19T17:01:28.254435] [DEBUG] [LOCAL ] ACA: Primary data saved (24626 records). [2025-09-19T17:01:28.255153] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-19T17:01:28.255538] [INFO ] [MAIN ] Update Progress: 15/2372 symbols completed. ACA took 25.7s. Estimated remaining: 3h 39m 60s. Rate: 10.7 symbols/min [2025-09-19T17:01:28.468997] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:28.556389] [DEBUG] [LOCAL ] ACEL: Loaded 27701 existing records from primary storage. [2025-09-19T17:01:28.578581] [INFO ] [MAIN ] ACEL: Loaded 27701 existing records. [2025-09-19T17:01:28.700463] [DEBUG] [LOCAL ] ABT: Primary data saved (54400 records). [2025-09-19T17:01:28.711197] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-19T17:01:28.711404] [INFO ] [MAIN ] Update Progress: 16/2372 symbols completed. ABT took 31.4s. Estimated remaining: 3h 27m 17s. Rate: 11.4 symbols/min [2025-09-19T17:01:28.935372] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:28.971428] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-19T17:01:28.979258] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-19T17:01:28.997205] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-19T17:01:28.997135] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:28.997709] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-19T17:01:29.383758] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-09-19T17:01:29.394768] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-09-19T17:01:29.519494] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:29.553856] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-19T17:01:29.621184] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T17:01:29.695687] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:29.695943] [INFO ] [REMOTE ] ABR: Full fetch complete (75175 records). [2025-09-19T17:01:29.696415] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-19T17:01:29.697101] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-19T17:01:29.697338] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-19T17:01:29.733939] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-19T17:01:29.761626] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-19T17:01:30.155765] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-19T17:01:30.271520] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-19T17:01:30.529529] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:30.535126] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-19T17:01:30.554879] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-19T17:01:30.554965] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-19T17:01:30.555686] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-19T17:01:30.555755] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-19T17:01:30.557397] [DEBUG] [LOCAL ] ABR: Trimmed 75175 records to 52915 (keeping 200 days of data) [2025-09-19T17:01:30.870981] [DEBUG] [LOCAL ] ABR: Primary data saved (52915 records). [2025-09-19T17:01:30.871115] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-19T17:01:30.871198] [INFO ] [MAIN ] Update Progress: 17/2372 symbols completed. ABR took 34.3s. Estimated remaining: 3h 19m 59s. Rate: 11.8 symbols/min [2025-09-19T17:01:31.039244] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:31.073634] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T17:01:31.080062] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-19T17:01:31.123121] [DEBUG] [LOCAL ] ACI: Loaded 53663 existing records from primary storage. [2025-09-19T17:01:31.123280] [INFO ] [MAIN ] ACI: Loaded 53663 existing records. [2025-09-19T17:01:31.306793] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:31.307116] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-19T17:01:31.307186] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-19T17:01:31.308425] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-19T17:01:31.308485] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-19T17:01:31.660612] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:31.843261] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-19T17:01:32.194984] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T17:01:32.480156] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T17:01:32.643332] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-19T17:01:33.443248] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-19T17:01:33.558525] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T17:01:33.683985] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (3.15 seconds). [2025-09-19T17:01:33.974551] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:01:34.243285] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-19T17:01:34.642902] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T17:01:35.043282] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-19T17:01:35.765606] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:01:35.843263] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-19T17:01:36.643242] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-19T17:01:37.195580] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T17:01:37.443291] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-19T17:01:37.483586] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T17:01:38.243272] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-19T17:01:38.753520] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T17:01:38.758576] [INFO ] [REMOTE ] ACCO: Full fetch complete (54261 records). [2025-09-19T17:01:38.758718] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-19T17:01:39.051165] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-19T17:01:39.151011] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-19T17:01:39.151193] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-19T17:01:39.151944] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-19T17:01:39.152058] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-19T17:01:39.153780] [DEBUG] [LOCAL ] ACCO: Trimmed 54261 records to 38568 (keeping 200 days of data) [2025-09-19T17:01:39.382170] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-19T17:01:39.419404] [DEBUG] [LOCAL ] ACCO: Primary data saved (38568 records). [2025-09-19T17:01:39.419564] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-19T17:01:39.419696] [INFO ] [MAIN ] Update Progress: 18/2372 symbols completed. ACCO took 28.2s. Estimated remaining: 3h 27m 26s. Rate: 11.3 symbols/min [2025-09-19T17:01:39.615759] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:39.660672] [DEBUG] [LOCAL ] ACM: Loaded 43495 existing records from primary storage. [2025-09-19T17:01:39.660843] [INFO ] [MAIN ] ACM: Loaded 43495 existing records. [2025-09-19T17:01:39.860125] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-19T17:01:39.908948] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:39.910062] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-19T17:01:39.910139] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-19T17:01:39.911257] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-19T17:01:39.911338] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-19T17:01:40.291108] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:40.320398] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T17:01:40.643304] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-19T17:01:40.661919] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T17:01:41.443282] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-19T17:01:42.098084] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T17:01:42.243302] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-19T17:01:42.373203] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T17:01:42.620874] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-19T17:01:43.043322] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-19T17:01:43.843277] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-19T17:01:43.929472] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T17:01:44.643271] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-19T17:01:45.012102] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T17:01:45.443275] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-19T17:01:46.243351] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-19T17:01:46.634303] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-19T17:01:46.827401] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T17:01:46.870129] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T17:01:47.043239] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-19T17:01:47.085865] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-19T17:01:47.843267] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-19T17:01:48.491933] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T17:01:48.643284] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-19T17:01:49.247446] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T17:01:49.443271] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-19T17:01:50.243294] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-19T17:01:51.043255] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-19T17:01:51.402302] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T17:01:51.542115] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-09-19T17:01:51.744775] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:01:51.843267] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-19T17:01:52.456614] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:01:52.643377] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-19T17:01:52.986406] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T17:01:52.991276] [INFO ] [REMOTE ] ACEL: Full fetch complete (39025 records). [2025-09-19T17:01:52.991464] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-19T17:01:53.448538] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-19T17:01:53.551910] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-19T17:01:53.552088] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-19T17:01:53.552829] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-19T17:01:53.552913] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-19T17:01:53.554455] [DEBUG] [LOCAL ] ACEL: Trimmed 39025 records to 27839 (keeping 200 days of data) [2025-09-19T17:01:53.775940] [DEBUG] [LOCAL ] ACEL: Primary data saved (27839 records). [2025-09-19T17:01:53.776125] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-19T17:01:53.776234] [INFO ] [MAIN ] Update Progress: 19/2372 symbols completed. ACEL took 25.5s. Estimated remaining: 3h 46m 4s. Rate: 10.4 symbols/min [2025-09-19T17:01:53.975334] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:54.034571] [DEBUG] [LOCAL ] ACN: Loaded 53809 existing records from primary storage. [2025-09-19T17:01:54.034774] [INFO ] [MAIN ] ACN: Loaded 53809 existing records. [2025-09-19T17:01:54.230538] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:54.230879] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-19T17:01:54.230931] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-19T17:01:54.232416] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-19T17:01:54.232490] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-19T17:01:54.266133] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-19T17:01:54.636270] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:54.988421] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T17:01:55.042236] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-19T17:01:55.052932] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-19T17:01:55.843280] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-19T17:01:56.643301] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-19T17:01:56.663457] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T17:01:56.717204] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T17:01:57.443253] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-19T17:01:57.934248] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T17:01:58.243311] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-19T17:01:59.046323] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (3.20 seconds). [2025-09-19T17:01:59.043758] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-19T17:01:59.644292] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-19T17:01:59.760495] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:01:59.843293] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-19T17:02:00.640075] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:02:00.644423] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-19T17:02:01.443320] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-19T17:02:01.871484] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:02:02.243328] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-19T17:02:02.756622] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:02:03.043281] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-19T17:02:03.851016] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-19T17:02:03.857894] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-09-19T17:02:03.948610] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T17:02:03.957217] [INFO ] [REMOTE ] ACI: Full fetch complete (77024 records). [2025-09-19T17:02:03.957440] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-19T17:02:04.413345] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-19T17:02:04.413447] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-19T17:02:04.414216] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-19T17:02:04.414294] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-19T17:02:04.416109] [DEBUG] [LOCAL ] ACI: Trimmed 77024 records to 54052 (keeping 200 days of data) [2025-09-19T17:02:04.644605] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-19T17:02:04.805204] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T17:02:04.827739] [DEBUG] [LOCAL ] ACI: Primary data saved (54052 records). [2025-09-19T17:02:04.827889] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-19T17:02:04.828169] [INFO ] [MAIN ] Update Progress: 20/2372 symbols completed. ACI took 34.0s. Estimated remaining: 3h 56m 20s. Rate: 10.0 symbols/min [2025-09-19T17:02:04.998539] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:05.028386] [DEBUG] [LOCAL ] ACP: Loaded 31597 existing records from primary storage. [2025-09-19T17:02:05.028521] [INFO ] [MAIN ] ACP: Loaded 31597 existing records. [2025-09-19T17:02:05.203773] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:05.204021] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-19T17:02:05.204067] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-19T17:02:05.204873] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-19T17:02:05.204933] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-19T17:02:05.450486] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-19T17:02:05.576067] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:06.100139] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T17:02:06.107835] [INFO ] [REMOTE ] ACM: Full fetch complete (62539 records). [2025-09-19T17:02:06.108042] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-19T17:02:06.248438] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-19T17:02:06.520788] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-19T17:02:06.520902] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-19T17:02:06.521531] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-19T17:02:06.521579] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-19T17:02:06.523135] [DEBUG] [LOCAL ] ACM: Trimmed 62539 records to 43847 (keeping 200 days of data) [2025-09-19T17:02:06.793339] [DEBUG] [LOCAL ] ACM: Primary data saved (43847 records). [2025-09-19T17:02:06.793477] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-19T17:02:06.793578] [INFO ] [MAIN ] Update Progress: 21/2372 symbols completed. ACM took 27.4s. Estimated remaining: 3h 48m 39s. Rate: 10.3 symbols/min [2025-09-19T17:02:06.963374] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:06.971857] [DEBUG] [LOCAL ] ACR: Loaded 6525 existing records from primary storage. [2025-09-19T17:02:06.971962] [INFO ] [MAIN ] ACR: Loaded 6525 existing records. [2025-09-19T17:02:07.155289] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:07.155559] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-19T17:02:07.155615] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-19T17:02:07.155937] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-19T17:02:07.155996] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-19T17:02:07.525070] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:07.525818] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-19T17:02:07.569071] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-19T17:02:07.616395] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T17:02:07.659553] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T17:02:07.843286] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-19T17:02:08.066685] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T17:02:08.643283] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-19T17:02:09.149255] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T17:02:09.443259] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-19T17:02:09.576470] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T17:02:10.020372] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T17:02:10.243259] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-19T17:02:11.043287] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-19T17:02:11.804117] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:02:11.843273] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-19T17:02:12.435805] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:02:12.643264] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-19T17:02:13.443275] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-19T17:02:14.055593] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T17:02:14.243278] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-19T17:02:14.504261] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:02:14.960399] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-09-19T17:02:14.969632] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-19T17:02:14.969850] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-19T17:02:15.048329] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-19T17:02:15.340718] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T17:02:15.393255] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-19T17:02:15.393344] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-19T17:02:15.394127] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-19T17:02:15.394196] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-19T17:02:15.395873] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54598 (keeping 200 days of data) [2025-09-19T17:02:15.722485] [DEBUG] [LOCAL ] ACHR: Primary data saved (54598 records). [2025-09-19T17:02:15.722667] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-19T17:02:15.722779] [INFO ] [MAIN ] Update Progress: 22/2372 symbols completed. ACHR took 47.0s. Estimated remaining: 3h 54m 3s. Rate: 10.0 symbols/min [2025-09-19T17:02:15.848341] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-19T17:02:15.914561] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:15.914732] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-09-19T17:02:15.914778] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-09-19T17:02:15.914917] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-19T17:02:15.914959] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-19T17:02:15.915000] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-19T17:02:15.915032] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-19T17:02:16.278081] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:16.368619] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:02:16.643264] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-19T17:02:17.443266] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-19T17:02:18.243294] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-19T17:02:18.348989] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:02:18.531327] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-19T17:02:19.043320] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-19T17:02:19.265952] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:02:19.279169] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T17:02:19.843286] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-19T17:02:20.632849] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T17:02:20.643213] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-19T17:02:20.876471] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:02:20.885283] [INFO ] [REMOTE ] ACN: Full fetch complete (77092 records). [2025-09-19T17:02:20.885468] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-19T17:02:21.222850] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T17:02:21.305537] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-19T17:02:21.305663] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-19T17:02:21.306435] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-19T17:02:21.306484] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-19T17:02:21.308217] [DEBUG] [LOCAL ] ACN: Trimmed 77092 records to 54199 (keeping 200 days of data) [2025-09-19T17:02:21.443671] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-19T17:02:21.669902] [DEBUG] [LOCAL ] ACN: Primary data saved (54199 records). [2025-09-19T17:02:21.670060] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-19T17:02:21.670166] [INFO ] [MAIN ] Update Progress: 23/2372 symbols completed. ACN took 27.9s. Estimated remaining: 3h 53m 55s. Rate: 10.0 symbols/min [2025-09-19T17:02:21.844126] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:21.844345] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-09-19T17:02:21.844398] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-09-19T17:02:21.844540] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-19T17:02:21.844583] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-19T17:02:21.844624] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-09-19T17:02:21.844692] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-19T17:02:22.192088] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:22.243225] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-19T17:02:22.394084] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T17:02:22.395347] [INFO ] [REMOTE ] ACR: Full fetch complete (8582 records). [2025-09-19T17:02:22.395422] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-19T17:02:22.757322] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-19T17:02:22.757406] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-19T17:02:22.757600] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-19T17:02:22.757637] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-19T17:02:22.758114] [DEBUG] [LOCAL ] ACR: Trimmed 8582 records to 6555 (keeping 200 days of data) [2025-09-19T17:02:22.795429] [DEBUG] [LOCAL ] ACR: Primary data saved (6555 records). [2025-09-19T17:02:22.795550] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-19T17:02:22.795668] [INFO ] [MAIN ] Update Progress: 24/2372 symbols completed. ACR took 16.0s. Estimated remaining: 3h 45m 54s. Rate: 10.4 symbols/min [2025-09-19T17:02:22.968296] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:23.017205] [DEBUG] [LOCAL ] ACVA: Loaded 49750 existing records from primary storage. [2025-09-19T17:02:23.017363] [INFO ] [MAIN ] ACVA: Loaded 49750 existing records. [2025-09-19T17:02:23.049501] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-19T17:02:23.260849] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:23.261145] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-19T17:02:23.261196] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-19T17:02:23.262375] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-19T17:02:23.262445] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-19T17:02:23.419310] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T17:02:23.643416] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:23.843308] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-19T17:02:24.555867] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T17:02:24.643239] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-19T17:02:25.443317] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-19T17:02:25.536552] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T17:02:26.243289] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-19T17:02:26.343137] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T17:02:26.365004] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T17:02:27.043299] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-19T17:02:27.687777] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T17:02:27.694956] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T17:02:27.843224] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-19T17:02:28.643278] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-19T17:02:29.371923] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T17:02:29.443259] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-19T17:02:29.534228] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T17:02:30.243285] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-19T17:02:31.043267] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-19T17:02:31.279197] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T17:02:31.843327] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-19T17:02:32.242274] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T17:02:32.468835] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-19T17:02:32.643291] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-19T17:02:32.826870] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T17:02:33.443271] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-19T17:02:34.243251] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-19T17:02:34.417477] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T17:02:34.444907] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:02:35.043284] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-19T17:02:35.735317] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T17:02:35.843270] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-19T17:02:36.253600] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T17:02:36.643276] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-19T17:02:36.947352] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T17:02:37.443287] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-19T17:02:38.243324] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-19T17:02:38.609168] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T17:02:38.675726] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-19T17:02:39.049456] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-19T17:02:39.065986] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T17:02:39.657463] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T17:02:39.843281] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-19T17:02:40.643285] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-19T17:02:41.448339] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-19T17:02:41.461131] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:02:41.770363] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T17:02:42.243225] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-19T17:02:42.573886] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T17:02:42.575635] [INFO ] [REMOTE ] ACV: Full fetch complete (9618 records). [2025-09-19T17:02:42.575737] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-19T17:02:42.991154] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-19T17:02:42.991241] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-19T17:02:42.991461] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-19T17:02:42.991535] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-19T17:02:42.992072] [DEBUG] [LOCAL ] ACV: Trimmed 9618 records to 7006 (keeping 200 days of data) [2025-09-19T17:02:43.037981] [DEBUG] [LOCAL ] ACV: Primary data saved (7006 records). [2025-09-19T17:02:43.038127] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-19T17:02:43.038225] [INFO ] [MAIN ] Update Progress: 25/2372 symbols completed. ACV took 21.4s. Estimated remaining: 4h 8m 27s. Rate: 9.4 symbols/min [2025-09-19T17:02:43.050551] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-19T17:02:43.224272] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:43.224431] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-19T17:02:43.224469] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-19T17:02:43.224718] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-19T17:02:43.224775] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-19T17:02:43.224820] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-19T17:02:43.224865] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-19T17:02:43.609898] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:43.843276] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-19T17:02:44.302156] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:02:44.502550] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T17:02:44.643301] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-19T17:02:44.888211] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:44.888534] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-19T17:02:45.000313] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T17:02:45.443291] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-19T17:02:45.670164] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:45.670589] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-19T17:02:46.243318] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-19T17:02:47.043322] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-19T17:02:47.721828] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T17:02:47.843271] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-19T17:02:48.549359] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:02:48.554464] [INFO ] [REMOTE ] ACRE: Full fetch complete (50461 records). [2025-09-19T17:02:48.554580] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-19T17:02:48.648519] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-19T17:02:48.986717] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-19T17:02:48.986812] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-19T17:02:48.987469] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-19T17:02:48.987545] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-19T17:02:48.988851] [DEBUG] [LOCAL ] ACRE: Trimmed 50461 records to 34131 (keeping 200 days of data) [2025-09-19T17:02:49.195559] [DEBUG] [LOCAL ] ACRE: Primary data saved (34131 records). [2025-09-19T17:02:49.195769] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-19T17:02:49.195911] [INFO ] [MAIN ] Update Progress: 26/2372 symbols completed. ACRE took 33.5s. Estimated remaining: 4h 8m 3s. Rate: 9.5 symbols/min [2025-09-19T17:02:49.363533] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:49.411227] [DEBUG] [LOCAL ] ADC: Loaded 46911 existing records from primary storage. [2025-09-19T17:02:49.411433] [INFO ] [MAIN ] ADC: Loaded 46911 existing records. [2025-09-19T17:02:49.448542] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-19T17:02:49.613764] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:49.614028] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-19T17:02:49.614081] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-19T17:02:49.615375] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-19T17:02:49.615440] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-19T17:02:49.732452] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:49.759278] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-19T17:02:50.013889] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:50.046466] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T17:02:50.221796] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T17:02:50.243286] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-19T17:02:51.043287] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-19T17:02:51.783913] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T17:02:51.789050] [INFO ] [REMOTE ] ACP: Full fetch complete (47894 records). [2025-09-19T17:02:51.789229] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-19T17:02:51.843320] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-19T17:02:52.133091] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:52.165506] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-19T17:02:52.183548] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-19T17:02:52.183638] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-19T17:02:52.184214] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-19T17:02:52.184276] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-19T17:02:52.186892] [DEBUG] [LOCAL ] ACP: Trimmed 47894 records to 31749 (keeping 200 days of data) [2025-09-19T17:02:52.383006] [DEBUG] [LOCAL ] ACP: Primary data saved (31749 records). [2025-09-19T17:02:52.383159] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-19T17:02:52.383246] [INFO ] [MAIN ] Update Progress: 27/2372 symbols completed. ACP took 47.6s. Estimated remaining: 4h 3m 22s. Rate: 9.6 symbols/min [2025-09-19T17:02:52.587769] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:52.646748] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-19T17:02:52.650546] [DEBUG] [LOCAL ] ADCT: Loaded 33823 existing records from primary storage. [2025-09-19T17:02:52.652331] [INFO ] [MAIN ] ADCT: Loaded 33823 existing records. [2025-09-19T17:02:52.694546] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T17:02:52.851938] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:52.852230] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-19T17:02:52.852309] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-19T17:02:52.853182] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-19T17:02:52.853260] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-19T17:02:52.932517] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:52.959037] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-19T17:02:53.239359] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:53.443278] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-19T17:02:54.243293] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-19T17:02:55.043268] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-19T17:02:55.273392] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:55.273889] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-19T17:02:55.441361] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T17:02:55.546218] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T17:02:55.843318] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-19T17:02:56.643284] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-19T17:02:57.443305] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-19T17:02:57.675537] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T17:02:57.930174] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:02:58.243281] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-19T17:02:58.980431] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T17:02:59.043260] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-19T17:02:59.299686] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:59.300003] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-19T17:02:59.587607] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T17:02:59.843266] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-19T17:03:00.074694] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:03:00.074999] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-19T17:03:00.643268] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-19T17:03:01.443274] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-19T17:03:02.243274] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-19T17:03:02.605890] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:03:03.043288] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-19T17:03:03.843286] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-19T17:03:04.474541] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-09-19T17:03:04.653220] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-19T17:03:04.655789] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T17:03:05.443277] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-19T17:03:05.770470] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-19T17:03:06.243335] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-19T17:03:06.300412] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-19T17:03:06.652467] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T17:03:06.656614] [INFO ] [REMOTE ] AD: Full fetch complete (5589 records). [2025-09-19T17:03:06.656771] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-19T17:03:06.870111] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 28 unique days, need 200 days [2025-09-19T17:03:06.870453] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:03:06.870543] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:03:06.870665] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-19T17:03:06.870784] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-19T17:03:06.870862] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-19T17:03:06.870951] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-19T17:03:06.871094] [INFO ] [MAIN ] Update Progress: 28/2372 symbols completed. AD took 23.8s. Estimated remaining: 4h 14m 48s. Rate: 9.2 symbols/min [2025-09-19T17:03:07.044274] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-19T17:03:07.069593] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:07.107614] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-19T17:03:07.142863] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:03:07.197036] [DEBUG] [LOCAL ] ADM: Loaded 53786 existing records from primary storage. [2025-09-19T17:03:07.197316] [INFO ] [MAIN ] ADM: Loaded 53786 existing records. [2025-09-19T17:03:07.398851] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:07.399193] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-19T17:03:07.399248] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-19T17:03:07.401235] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-19T17:03:07.401309] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-19T17:03:07.818603] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:07.843221] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-19T17:03:08.643290] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-19T17:03:09.376913] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-19T17:03:09.384769] [INFO ] [REMOTE ] ACVA: Full fetch complete (70133 records). [2025-09-19T17:03:09.384941] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-19T17:03:09.449426] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-19T17:03:09.825533] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-19T17:03:09.826068] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-19T17:03:09.826914] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-19T17:03:09.827049] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-19T17:03:09.838287] [DEBUG] [LOCAL ] ACVA: Trimmed 70133 records to 50110 (keeping 200 days of data) [2025-09-19T17:03:09.853560] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T17:03:10.127044] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T17:03:10.209386] [DEBUG] [LOCAL ] ACVA: Primary data saved (50110 records). [2025-09-19T17:03:10.209559] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-19T17:03:10.209677] [INFO ] [MAIN ] Update Progress: 29/2372 symbols completed. ACVA took 47.4s. Estimated remaining: 4h 10m 24s. Rate: 9.4 symbols/min [2025-09-19T17:03:10.252564] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-19T17:03:10.392225] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:10.439040] [DEBUG] [LOCAL ] ADNT: Loaded 48010 existing records from primary storage. [2025-09-19T17:03:10.439195] [INFO ] [MAIN ] ADNT: Loaded 48010 existing records. [2025-09-19T17:03:10.622896] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:10.623233] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-19T17:03:10.623290] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-19T17:03:10.624460] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-19T17:03:10.624523] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-19T17:03:10.980892] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:11.043273] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-19T17:03:11.309728] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T17:03:11.843245] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-19T17:03:11.927636] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T17:03:12.643257] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-19T17:03:12.733954] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T17:03:13.443258] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-19T17:03:14.243237] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-19T17:03:14.308697] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T17:03:15.043261] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-19T17:03:15.979534] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-19T17:03:15.994126] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-19T17:03:16.084154] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (3.44 seconds). [2025-09-19T17:03:16.605699] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-19T17:03:16.643223] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-19T17:03:17.443283] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-19T17:03:17.719720] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T17:03:17.829307] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-19T17:03:18.243266] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-19T17:03:18.486904] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T17:03:19.043291] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-19T17:03:19.633238] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T17:03:19.725031] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T17:03:19.843294] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-19T17:03:20.643273] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-19T17:03:20.900000] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T17:03:21.443296] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-19T17:03:22.069045] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T17:03:22.243329] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-19T17:03:22.303370] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:03:22.309411] [INFO ] [REMOTE ] ADCT: Full fetch complete (51527 records). [2025-09-19T17:03:22.309555] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-19T17:03:22.735383] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-19T17:03:22.735560] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-19T17:03:22.736146] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-19T17:03:22.736214] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-19T17:03:22.737831] [DEBUG] [LOCAL ] ADCT: Trimmed 51527 records to 34128 (keeping 200 days of data) [2025-09-19T17:03:22.932786] [DEBUG] [LOCAL ] ADCT: Primary data saved (34128 records). [2025-09-19T17:03:22.932926] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-19T17:03:22.933012] [INFO ] [MAIN ] Update Progress: 30/2372 symbols completed. ADCT took 30.5s. Estimated remaining: 4h 18m 30s. Rate: 9.1 symbols/min [2025-09-19T17:03:23.048424] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-19T17:03:23.111375] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:23.165867] [DEBUG] [LOCAL ] ADT: Loaded 53843 existing records from primary storage. [2025-09-19T17:03:23.166042] [INFO ] [MAIN ] ADT: Loaded 53843 existing records. [2025-09-19T17:03:23.351065] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:23.351387] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-19T17:03:23.351439] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-19T17:03:23.352623] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-19T17:03:23.352717] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-19T17:03:23.718565] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:23.818105] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T17:03:23.843211] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-19T17:03:24.529795] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-19T17:03:24.643283] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-19T17:03:24.995258] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T17:03:25.001666] [INFO ] [REMOTE ] ADC: Full fetch complete (65638 records). [2025-09-19T17:03:25.001783] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-19T17:03:25.005484] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:03:25.005582] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:03:25.005627] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:03:25.005713] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-19T17:03:25.005778] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-19T17:03:25.005815] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-09-19T17:03:25.006308] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-09-19T17:03:25.006405] [INFO ] [MAIN ] Update Progress: 31/2372 symbols completed. ADC took 35.8s. Estimated remaining: 4h 12m 40s. Rate: 9.3 symbols/min [2025-09-19T17:03:25.179398] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:25.217877] [DEBUG] [LOCAL ] ADX: Loaded 28341 existing records from primary storage. [2025-09-19T17:03:25.218106] [INFO ] [MAIN ] ADX: Loaded 28341 existing records. [2025-09-19T17:03:25.396738] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:25.396990] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-19T17:03:25.397039] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-19T17:03:25.398042] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-19T17:03:25.398104] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-19T17:03:25.461190] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-19T17:03:25.766959] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:25.796264] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T17:03:26.243320] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-19T17:03:27.043249] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-19T17:03:27.144722] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-19T17:03:27.843331] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-19T17:03:28.272585] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T17:03:28.643344] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-19T17:03:28.979975] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (3.52 seconds). [2025-09-19T17:03:29.099791] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T17:03:29.440638] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T17:03:29.451627] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-19T17:03:29.839062] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T17:03:30.243319] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-19T17:03:31.043281] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-19T17:03:31.436385] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T17:03:31.843301] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-19T17:03:32.264547] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T17:03:32.643309] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-19T17:03:33.443278] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-19T17:03:33.623434] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-19T17:03:33.823498] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T17:03:33.952329] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T17:03:34.243303] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-19T17:03:34.558098] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T17:03:35.043299] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-19T17:03:35.843272] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-19T17:03:36.137814] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T17:03:36.403154] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T17:03:36.643329] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-19T17:03:37.227994] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T17:03:37.235323] [INFO ] [REMOTE ] ADNT: Full fetch complete (68162 records). [2025-09-19T17:03:37.235490] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-19T17:03:37.448464] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-19T17:03:37.641694] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-19T17:03:37.641781] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-19T17:03:37.642520] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-19T17:03:37.642622] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-19T17:03:37.644065] [DEBUG] [LOCAL ] ADNT: Trimmed 68162 records to 48333 (keeping 200 days of data) [2025-09-19T17:03:37.757886] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T17:03:37.952336] [DEBUG] [LOCAL ] ADNT: Primary data saved (48333 records). [2025-09-19T17:03:37.952509] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-19T17:03:37.952625] [INFO ] [MAIN ] Update Progress: 32/2372 symbols completed. ADNT took 27.7s. Estimated remaining: 4h 20m 27s. Rate: 9.0 symbols/min [2025-09-19T17:03:38.122012] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:38.182672] [DEBUG] [LOCAL ] AEE: Loaded 50683 existing records from primary storage. [2025-09-19T17:03:38.182828] [INFO ] [MAIN ] AEE: Loaded 50683 existing records. [2025-09-19T17:03:38.248398] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-19T17:03:38.385135] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:38.385417] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-19T17:03:38.385476] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-19T17:03:38.386687] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-19T17:03:38.386753] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-19T17:03:38.813509] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:39.044583] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-19T17:03:39.843343] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-19T17:03:40.014304] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-19T17:03:40.044966] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T17:03:40.096110] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T17:03:40.104710] [INFO ] [REMOTE ] ADM: Full fetch complete (77213 records). [2025-09-19T17:03:40.104907] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-19T17:03:40.499134] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-19T17:03:40.499226] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-19T17:03:40.499950] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-19T17:03:40.500014] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-19T17:03:40.501452] [DEBUG] [LOCAL ] ADM: Trimmed 77213 records to 54176 (keeping 200 days of data) [2025-09-19T17:03:40.684105] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-19T17:03:40.839549] [DEBUG] [LOCAL ] ADM: Primary data saved (54176 records). [2025-09-19T17:03:40.839737] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-19T17:03:40.839838] [INFO ] [MAIN ] Update Progress: 33/2372 symbols completed. ADM took 34.0s. Estimated remaining: 4h 15m 51s. Rate: 9.1 symbols/min [2025-09-19T17:03:41.016408] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:41.026424] [DEBUG] [LOCAL ] AEFC: Loaded 8742 existing records from primary storage. [2025-09-19T17:03:41.026546] [INFO ] [MAIN ] AEFC: Loaded 8742 existing records. [2025-09-19T17:03:41.207877] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:41.208206] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-19T17:03:41.208281] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-19T17:03:41.208795] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-19T17:03:41.208861] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-19T17:03:41.455270] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-19T17:03:41.604157] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:41.902263] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:03:42.243273] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-19T17:03:42.734228] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T17:03:43.049479] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-19T17:03:43.054416] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T17:03:43.069783] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T17:03:43.843265] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-19T17:03:44.643276] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-19T17:03:45.057389] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:03:45.443322] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-19T17:03:45.623756] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T17:03:45.677029] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T17:03:46.243298] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-19T17:03:47.043330] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-19T17:03:47.190295] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T17:03:47.340072] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T17:03:47.843293] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-19T17:03:48.232096] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T17:03:48.643285] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-19T17:03:49.443301] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-19T17:03:49.613429] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T17:03:49.996365] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:03:50.243260] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-19T17:03:50.382291] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T17:03:50.386773] [INFO ] [REMOTE ] ADX: Full fetch complete (42182 records). [2025-09-19T17:03:50.386904] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-19T17:03:50.776626] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-19T17:03:50.776746] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-19T17:03:50.777220] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-19T17:03:50.777265] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-19T17:03:50.778391] [DEBUG] [LOCAL ] ADX: Trimmed 42182 records to 28540 (keeping 200 days of data) [2025-09-19T17:03:50.956622] [DEBUG] [LOCAL ] ADX: Primary data saved (28540 records). [2025-09-19T17:03:50.956826] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-19T17:03:50.957010] [INFO ] [MAIN ] Update Progress: 34/2372 symbols completed. ADX took 26.0s. Estimated remaining: 4h 19m 49s. Rate: 9.0 symbols/min [2025-09-19T17:03:51.048391] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-19T17:03:51.127255] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:51.171973] [DEBUG] [LOCAL ] AEG: Loaded 49975 existing records from primary storage. [2025-09-19T17:03:51.172115] [INFO ] [MAIN ] AEG: Loaded 49975 existing records. [2025-09-19T17:03:51.347872] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:51.348125] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-19T17:03:51.348171] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-19T17:03:51.349366] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-19T17:03:51.349428] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-19T17:03:51.724850] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:51.843281] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-19T17:03:52.260773] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:03:52.268541] [INFO ] [REMOTE ] ADT: Full fetch complete (77202 records). [2025-09-19T17:03:52.268737] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-19T17:03:52.648449] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-19T17:03:52.672208] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-19T17:03:52.672366] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-19T17:03:52.674684] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-19T17:03:52.674949] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-19T17:03:52.676636] [DEBUG] [LOCAL ] ADT: Trimmed 77202 records to 54231 (keeping 200 days of data) [2025-09-19T17:03:52.897842] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T17:03:53.015858] [DEBUG] [LOCAL ] ADT: Primary data saved (54231 records). [2025-09-19T17:03:53.016024] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-19T17:03:53.016113] [INFO ] [MAIN ] Update Progress: 35/2372 symbols completed. ADT took 30.1s. Estimated remaining: 4h 14m 35s. Rate: 9.2 symbols/min [2025-09-19T17:03:53.191721] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:53.237603] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T17:03:53.289422] [DEBUG] [LOCAL ] AEM: Loaded 53854 existing records from primary storage. [2025-09-19T17:03:53.289568] [INFO ] [MAIN ] AEM: Loaded 53854 existing records. [2025-09-19T17:03:53.448342] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-19T17:03:53.482626] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:53.482972] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-19T17:03:53.483030] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-19T17:03:53.485783] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-19T17:03:53.485850] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-19T17:03:53.858989] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:54.243284] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-19T17:03:54.560871] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T17:03:54.581791] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T17:03:55.043269] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-19T17:03:55.843269] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-19T17:03:55.969917] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T17:03:56.325608] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T17:03:56.643269] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-19T17:03:57.443313] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-19T17:03:57.953318] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T17:03:58.108546] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T17:03:58.243263] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-19T17:03:58.394458] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:03:59.043294] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-19T17:03:59.848385] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-19T17:03:59.864141] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T17:04:00.643290] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-19T17:04:01.343552] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T17:04:01.443296] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-19T17:04:01.838158] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T17:04:02.243263] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-19T17:04:02.436111] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T17:04:03.043273] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-19T17:04:03.416128] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-19T17:04:03.793333] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T17:04:03.794871] [INFO ] [REMOTE ] AEFC: Full fetch complete (12443 records). [2025-09-19T17:04:03.794947] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-19T17:04:03.851948] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-19T17:04:04.181118] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:04:04.205960] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-19T17:04:04.214611] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-19T17:04:04.215319] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-19T17:04:04.215707] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-19T17:04:04.216243] [DEBUG] [LOCAL ] AEFC: Trimmed 12443 records to 8763 (keeping 200 days of data) [2025-09-19T17:04:04.268833] [DEBUG] [LOCAL ] AEFC: Primary data saved (8763 records). [2025-09-19T17:04:04.268974] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-19T17:04:04.269059] [INFO ] [MAIN ] Update Progress: 36/2372 symbols completed. AEFC took 23.4s. Estimated remaining: 4h 19m 34s. Rate: 9.0 symbols/min [2025-09-19T17:04:04.448312] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:04.507123] [DEBUG] [LOCAL ] AEO: Loaded 53947 existing records from primary storage. [2025-09-19T17:04:04.507274] [INFO ] [MAIN ] AEO: Loaded 53947 existing records. [2025-09-19T17:04:04.651184] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-19T17:04:04.693384] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:04.693680] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-19T17:04:04.693754] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-19T17:04:04.695015] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-19T17:04:04.695075] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-19T17:04:05.069212] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:05.443281] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-19T17:04:06.243290] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-19T17:04:06.288768] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T17:04:06.346543] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T17:04:07.043279] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-19T17:04:07.230900] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:04:07.779372] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T17:04:07.843237] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-19T17:04:08.643268] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-19T17:04:09.443277] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-19T17:04:09.629155] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-19T17:04:10.166265] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T17:04:10.243243] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-19T17:04:10.715188] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T17:04:10.998263] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T17:04:11.043234] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-19T17:04:11.843272] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-19T17:04:12.270702] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:04:12.643274] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-19T17:04:13.398672] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T17:04:13.443219] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-19T17:04:14.089529] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T17:04:14.243262] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-19T17:04:14.473023] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T17:04:15.043303] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-19T17:04:15.386828] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:04:15.621894] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:04:15.843315] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-19T17:04:16.594701] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T17:04:16.643241] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-19T17:04:17.443323] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-19T17:04:18.207330] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-19T17:04:18.243231] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-19T17:04:18.840553] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T17:04:19.043303] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-19T17:04:19.654725] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T17:04:19.843271] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-19T17:04:20.167336] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T17:04:20.643371] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-19T17:04:21.139877] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:04:21.443320] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-19T17:04:21.877775] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T17:04:22.243332] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-19T17:04:22.610675] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T17:04:22.618091] [INFO ] [REMOTE ] AEM: Full fetch complete (76712 records). [2025-09-19T17:04:22.618241] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-19T17:04:22.619541] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:04:22.619684] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:04:22.619740] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:04:22.619821] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-19T17:04:22.619905] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-19T17:04:22.619944] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-09-19T17:04:22.620371] [DEBUG] [LOCAL ] AEM: Deleted derivative data file. [2025-09-19T17:04:22.620494] [INFO ] [MAIN ] Update Progress: 37/2372 symbols completed. AEM took 29.6s. Estimated remaining: 4h 31m 45s. Rate: 8.6 symbols/min [2025-09-19T17:04:23.043274] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-19T17:04:23.637761] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T17:04:23.843309] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-19T17:04:24.228413] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T17:04:24.235464] [INFO ] [REMOTE ] AEE: Full fetch complete (72162 records). [2025-09-19T17:04:24.235606] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-19T17:04:24.236452] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:04:24.236544] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:04:24.236589] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:04:24.236635] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-19T17:04:24.236736] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-19T17:04:24.236776] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-09-19T17:04:24.237159] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-09-19T17:04:24.238223] [INFO ] [MAIN ] Update Progress: 38/2372 symbols completed. AEE took 46.3s. Estimated remaining: 4h 26m 9s. Rate: 8.8 symbols/min [2025-09-19T17:04:25.646027] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T17:04:25.657046] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-19T17:04:25.761833] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-19T17:04:25.774202] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-19T17:04:27.676699] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:04:27.686526] [INFO ] [REMOTE ] AEG: Full fetch complete (70121 records). [2025-09-19T17:04:27.686798] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-19T17:04:27.814520] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T17:04:27.881914] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-19T17:04:28.146820] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-19T17:04:28.146919] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-19T17:04:28.147697] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-19T17:04:28.147767] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-19T17:04:28.149317] [DEBUG] [LOCAL ] AEG: Trimmed 70121 records to 50293 (keeping 200 days of data) [2025-09-19T17:04:28.441349] [DEBUG] [LOCAL ] AEG: Primary data saved (50293 records). [2025-09-19T17:04:28.441494] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-19T17:04:28.441595] [INFO ] [MAIN ] Update Progress: 39/2372 symbols completed. AEG took 37.5s. Estimated remaining: 4h 23m 24s. Rate: 8.9 symbols/min [2025-09-19T17:04:30.499108] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-19T17:04:30.507722] [INFO ] [REMOTE ] AEO: Full fetch complete (77446 records). [2025-09-19T17:04:30.507894] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-19T17:04:30.906914] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-19T17:04:30.907004] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-19T17:04:30.907791] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-19T17:04:30.907874] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-19T17:04:30.909471] [DEBUG] [LOCAL ] AEO: Trimmed 77446 records to 54337 (keeping 200 days of data) [2025-09-19T17:04:31.239948] [DEBUG] [LOCAL ] AEO: Primary data saved (54337 records). [2025-09-19T17:04:31.240098] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-19T17:04:31.240209] [INFO ] [MAIN ] Update Progress: 40/2372 symbols completed. AEO took 27.0s. Estimated remaining: 4h 19m 25s. Rate: 9.0 symbols/min [2025-09-19T17:04:31.933084] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:31.967467] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:32.004104] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:32.042404] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-09-19T17:04:32.042820] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-09-19T17:04:32.079104] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-19T17:04:32.087536] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:32.088171] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-09-19T17:04:32.087889] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-19T17:04:32.088405] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-09-19T17:04:32.088637] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-09-19T17:04:32.088937] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-19T17:04:32.089005] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-19T17:04:32.089177] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-19T17:04:32.089283] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-19T17:04:32.089362] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-19T17:04:32.677770] [DEBUG] [LOCAL ] AES: Loaded 54064 existing records from primary storage. [2025-09-19T17:04:32.736065] [DEBUG] [LOCAL ] AER: Loaded 49227 existing records from primary storage. [2025-09-19T17:04:32.740938] [INFO ] [MAIN ] AES: Loaded 54064 existing records. [2025-09-19T17:04:32.816804] [INFO ] [MAIN ] AER: Loaded 49227 existing records. [2025-09-19T17:04:33.465487] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:33.481349] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-19T17:04:33.560620] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:33.627941] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-19T17:04:33.622948] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:33.665129] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-19T17:04:33.665030] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:33.665845] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-19T17:04:33.665546] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-19T17:04:33.666085] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-19T17:04:33.667017] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-19T17:04:33.667098] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-19T17:04:33.678992] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-19T17:04:33.688586] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-19T17:04:34.398280] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:34.415870] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-19T17:04:34.419708] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:34.420955] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-19T17:04:34.714750] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T17:04:34.717602] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-19T17:04:35.676088] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:04:35.685417] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-19T17:04:35.721107] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T17:04:35.724252] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-19T17:04:36.251697] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T17:04:36.260956] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-19T17:04:36.794813] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T17:04:36.797856] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-19T17:04:37.186845] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-19T17:04:37.197774] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-19T17:04:37.480202] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:04:37.489622] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-19T17:04:37.559830] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:04:37.563556] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-19T17:04:37.637329] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T17:04:37.646885] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-19T17:04:38.821863] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T17:04:38.825621] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-19T17:04:39.080278] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T17:04:39.090175] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-19T17:04:39.355088] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-19T17:04:39.357997] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-19T17:04:39.578452] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:04:39.843306] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-19T17:04:39.884623] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T17:04:39.902806] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:04:40.566861] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T17:04:40.643286] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-19T17:04:41.217388] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T17:04:41.443284] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-19T17:04:41.943333] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T17:04:42.243277] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-19T17:04:42.405817] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T17:04:43.043293] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-19T17:04:43.843285] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-19T17:04:44.220911] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T17:04:44.643292] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-19T17:04:44.676125] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:04:45.443270] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-19T17:04:45.960151] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T17:04:46.017727] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T17:04:46.243322] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-19T17:04:46.731276] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T17:04:47.043316] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-19T17:04:47.843286] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-19T17:04:47.870419] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T17:04:47.873184] [INFO ] [REMOTE ] AFB: Full fetch complete (16523 records). [2025-09-19T17:04:47.873467] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-19T17:04:48.075283] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T17:04:48.298661] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-19T17:04:48.298772] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-19T17:04:48.299043] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-19T17:04:48.299085] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-19T17:04:48.299723] [DEBUG] [LOCAL ] AFB: Trimmed 16523 records to 11692 (keeping 200 days of data) [2025-09-19T17:04:48.373214] [DEBUG] [LOCAL ] AFB: Primary data saved (11692 records). [2025-09-19T17:04:48.373357] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-19T17:04:48.373435] [INFO ] [MAIN ] Update Progress: 41/2372 symbols completed. AFB took 17.1s. Estimated remaining: 4h 29m 13s. Rate: 8.7 symbols/min [2025-09-19T17:04:48.542474] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:48.580607] [DEBUG] [LOCAL ] AFG: Loaded 32981 existing records from primary storage. [2025-09-19T17:04:48.580786] [INFO ] [MAIN ] AFG: Loaded 32981 existing records. [2025-09-19T17:04:48.651873] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-19T17:04:48.792548] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:48.792826] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-19T17:04:48.792882] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-19T17:04:48.794925] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-19T17:04:48.794988] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-19T17:04:49.189747] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:49.443311] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-19T17:04:49.846615] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T17:04:50.243281] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-19T17:04:50.554852] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T17:04:51.043263] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-19T17:04:51.127304] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:04:51.843260] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-19T17:04:52.586411] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:04:52.629389] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-19T17:04:52.643224] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-19T17:04:53.278453] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:04:53.443255] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-19T17:04:54.248368] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-19T17:04:54.264614] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:04:55.043266] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-19T17:04:55.477249] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T17:04:55.484831] [INFO ] [REMOTE ] AESI: Full fetch complete (70177 records). [2025-09-19T17:04:55.484965] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-19T17:04:55.844266] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-19T17:04:55.890261] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-19T17:04:55.890440] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-19T17:04:55.891223] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-19T17:04:55.891307] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-19T17:04:55.893059] [DEBUG] [LOCAL ] AESI: Trimmed 70177 records to 50259 (keeping 200 days of data) [2025-09-19T17:04:56.007383] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:04:56.235900] [DEBUG] [LOCAL ] AESI: Primary data saved (50259 records). [2025-09-19T17:04:56.236052] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-19T17:04:56.236136] [INFO ] [MAIN ] Update Progress: 42/2372 symbols completed. AESI took 25.0s. Estimated remaining: 4h 29m 58s. Rate: 8.6 symbols/min [2025-09-19T17:04:56.414252] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:56.418571] [DEBUG] [LOCAL ] AFGB: Loaded 2536 existing records from primary storage. [2025-09-19T17:04:56.418692] [INFO ] [MAIN ] AFGB: Loaded 2536 existing records. [2025-09-19T17:04:56.604080] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:56.604438] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-19T17:04:56.604546] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-19T17:04:56.614287] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-19T17:04:56.627555] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-19T17:04:56.661502] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-19T17:04:56.675705] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T17:04:57.011125] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:57.443277] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-19T17:04:57.772515] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T17:04:58.243298] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-19T17:04:58.476498] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:04:59.043238] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-19T17:04:59.754349] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-19T17:04:59.762267] [INFO ] [REMOTE ] AER: Full fetch complete (69468 records). [2025-09-19T17:04:59.762459] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-19T17:04:59.857974] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-19T17:05:00.183604] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-19T17:05:00.183769] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-19T17:05:00.184696] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-19T17:05:00.184795] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-19T17:05:00.186495] [DEBUG] [LOCAL ] AER: Trimmed 69468 records to 49562 (keeping 200 days of data) [2025-09-19T17:05:00.358055] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T17:05:00.552364] [DEBUG] [LOCAL ] AER: Primary data saved (49562 records). [2025-09-19T17:05:00.552502] [INFO ] [MAIN ] AER: Full history saved. [2025-09-19T17:05:00.552603] [INFO ] [MAIN ] Update Progress: 43/2372 symbols completed. AER took 29.3s. Estimated remaining: 4h 27m 28s. Rate: 8.7 symbols/min [2025-09-19T17:05:00.648989] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-19T17:05:00.723546] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T17:05:00.727188] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:00.732884] [DEBUG] [LOCAL ] AFGC: Loaded 2566 existing records from primary storage. [2025-09-19T17:05:00.732957] [INFO ] [MAIN ] AFGC: Loaded 2566 existing records. [2025-09-19T17:05:00.913303] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:00.913780] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-19T17:05:00.913860] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-19T17:05:00.914169] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-19T17:05:00.914314] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-19T17:05:01.144316] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T17:05:01.305185] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:01.443267] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-19T17:05:02.023404] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T17:05:02.243279] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-19T17:05:03.043311] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-19T17:05:03.148371] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-19T17:05:03.650607] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T17:05:03.653040] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:05:03.843316] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-19T17:05:04.643311] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-19T17:05:05.208361] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T17:05:05.443344] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-19T17:05:06.010128] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T17:05:06.243277] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-19T17:05:06.537160] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T17:05:07.043279] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-19T17:05:07.843233] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-19T17:05:08.172566] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-19T17:05:08.624620] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T17:05:08.643231] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-19T17:05:08.723461] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T17:05:09.222363] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T17:05:09.443239] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-19T17:05:10.243260] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-19T17:05:10.278037] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T17:05:11.043257] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-19T17:05:11.586573] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T17:05:11.812054] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T17:05:11.843217] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-19T17:05:12.643261] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-19T17:05:13.035263] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:05:13.040300] [INFO ] [REMOTE ] AFG: Full fetch complete (45703 records). [2025-09-19T17:05:13.040394] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-19T17:05:13.411200] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-19T17:05:13.411277] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-19T17:05:13.411751] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-19T17:05:13.411814] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-19T17:05:13.412790] [DEBUG] [LOCAL ] AFG: Trimmed 45703 records to 33259 (keeping 200 days of data) [2025-09-19T17:05:13.468010] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-19T17:05:13.625376] [DEBUG] [LOCAL ] AFG: Primary data saved (33259 records). [2025-09-19T17:05:13.625544] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-19T17:05:13.625735] [INFO ] [MAIN ] Update Progress: 44/2372 symbols completed. AFG took 25.3s. Estimated remaining: 4h 32m 49s. Rate: 8.5 symbols/min [2025-09-19T17:05:13.794664] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:13.798380] [DEBUG] [LOCAL ] AFGD: Loaded 1906 existing records from primary storage. [2025-09-19T17:05:13.798488] [INFO ] [MAIN ] AFGD: Loaded 1906 existing records. [2025-09-19T17:05:13.975525] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:13.975795] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-19T17:05:13.975849] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-19T17:05:13.976108] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-19T17:05:13.976176] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-19T17:05:14.259744] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-19T17:05:14.360023] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:14.413880] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:05:14.751847] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-19T17:05:14.964168] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-19T17:05:14.973083] [INFO ] [REMOTE ] AES: Full fetch complete (77726 records). [2025-09-19T17:05:14.973232] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-19T17:05:15.048362] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-19T17:05:15.369060] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-19T17:05:15.369160] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-19T17:05:15.369955] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-19T17:05:15.370023] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-19T17:05:15.372490] [DEBUG] [LOCAL ] AES: Trimmed 77726 records to 54454 (keeping 200 days of data) [2025-09-19T17:05:15.721165] [DEBUG] [LOCAL ] AES: Primary data saved (54454 records). [2025-09-19T17:05:15.721407] [INFO ] [MAIN ] AES: Full history saved. [2025-09-19T17:05:15.721537] [INFO ] [MAIN ] Update Progress: 45/2372 symbols completed. AES took 44.5s. Estimated remaining: 4h 28m 26s. Rate: 8.7 symbols/min [2025-09-19T17:05:15.810286] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T17:05:15.848343] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-19T17:05:15.910360] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:15.916798] [DEBUG] [LOCAL ] AFGE: Loaded 2533 existing records from primary storage. [2025-09-19T17:05:15.916905] [INFO ] [MAIN ] AFGE: Loaded 2533 existing records. [2025-09-19T17:05:16.091833] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:16.092106] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-19T17:05:16.092155] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-19T17:05:16.092386] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-19T17:05:16.092462] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-19T17:05:16.446867] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:16.640555] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T17:05:16.643201] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-19T17:05:17.221339] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T17:05:17.443265] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-19T17:05:18.243272] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-19T17:05:18.353474] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T17:05:18.651675] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T17:05:19.043310] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-19T17:05:19.559866] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-19T17:05:19.843278] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-19T17:05:20.429102] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:05:20.643297] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-19T17:05:21.376706] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T17:05:21.443322] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-19T17:05:22.172142] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T17:05:22.243235] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-19T17:05:23.043244] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-19T17:05:23.136224] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T17:05:23.137301] [INFO ] [REMOTE ] AFGC: Full fetch complete (3697 records). [2025-09-19T17:05:23.137410] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-19T17:05:23.137912] [FATAL] [VALIDATOR ] AFGC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:05:23.137996] [FATAL] [MAIN ] AFGC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:05:23.138048] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:05:23.138131] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-19T17:05:23.138227] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-09-19T17:05:23.138315] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-09-19T17:05:23.138766] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-09-19T17:05:23.139010] [INFO ] [MAIN ] Update Progress: 46/2372 symbols completed. AFGC took 22.6s. Estimated remaining: 4h 28m 45s. Rate: 8.7 symbols/min [2025-09-19T17:05:23.308619] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:23.385011] [DEBUG] [LOCAL ] AFL: Loaded 53537 existing records from primary storage. [2025-09-19T17:05:23.385196] [INFO ] [MAIN ] AFL: Loaded 53537 existing records. [2025-09-19T17:05:23.567926] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:23.568370] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-19T17:05:23.568425] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-19T17:05:23.569879] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-19T17:05:23.569951] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-19T17:05:23.685665] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-19T17:05:23.848382] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-19T17:05:23.940069] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:24.534364] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-19T17:05:24.643267] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-19T17:05:25.443281] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-19T17:05:26.014214] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-19T17:05:26.243260] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-19T17:05:26.625742] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-19T17:05:26.791691] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T17:05:27.043277] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-19T17:05:27.843287] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-19T17:05:28.231933] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-19T17:05:28.643255] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-19T17:05:29.209324] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T17:05:29.252159] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T17:05:29.443273] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-19T17:05:30.108189] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T17:05:30.109357] [INFO ] [REMOTE ] AFGB: Full fetch complete (3632 records). [2025-09-19T17:05:30.109428] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-19T17:05:30.109846] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:05:30.109931] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:05:30.109973] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:05:30.110054] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-19T17:05:30.110134] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-09-19T17:05:30.110200] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-09-19T17:05:30.110554] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-09-19T17:05:30.110688] [INFO ] [MAIN ] Update Progress: 47/2372 symbols completed. AFGB took 33.9s. Estimated remaining: 4h 28m 40s. Rate: 8.7 symbols/min [2025-09-19T17:05:30.250886] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-19T17:05:30.285867] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:30.359993] [DEBUG] [LOCAL ] AG: Loaded 54031 existing records from primary storage. [2025-09-19T17:05:30.360188] [INFO ] [MAIN ] AG: Loaded 54031 existing records. [2025-09-19T17:05:30.553382] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:30.553680] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-19T17:05:30.553740] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-19T17:05:30.555057] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-19T17:05:30.555121] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-19T17:05:30.931453] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:30.967308] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T17:05:31.043293] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-19T17:05:31.843267] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-19T17:05:32.384016] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T17:05:32.643264] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-19T17:05:33.022542] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T17:05:33.172953] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T17:05:33.443286] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-19T17:05:34.243326] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-19T17:05:34.740798] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T17:05:35.043279] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-19T17:05:35.655299] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T17:05:35.843276] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-19T17:05:36.643320] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-19T17:05:36.985722] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-19T17:05:37.080110] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T17:05:37.443242] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-19T17:05:37.956945] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T17:05:37.997296] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T17:05:38.243259] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-19T17:05:38.650987] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-19T17:05:39.043300] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-19T17:05:39.843265] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-19T17:05:40.494554] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-19T17:05:40.643343] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-19T17:05:41.276140] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T17:05:41.277477] [INFO ] [REMOTE ] AFGD: Full fetch complete (3231 records). [2025-09-19T17:05:41.277589] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-19T17:05:41.445594] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-19T17:05:41.607489] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-19T17:05:41.698129] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-19T17:05:41.698225] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-19T17:05:41.698387] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-19T17:05:41.698434] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-19T17:05:41.698828] [DEBUG] [LOCAL ] AFGD: Trimmed 3231 records to 1913 (keeping 200 days of data) [2025-09-19T17:05:41.713839] [DEBUG] [LOCAL ] AFGD: Primary data saved (1913 records). [2025-09-19T17:05:41.713940] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-19T17:05:41.714039] [INFO ] [MAIN ] Update Progress: 48/2372 symbols completed. AFGD took 28.1s. Estimated remaining: 4h 32m 19s. Rate: 8.5 symbols/min [2025-09-19T17:05:41.896774] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:41.952488] [DEBUG] [LOCAL ] AGCO: Loaded 43138 existing records from primary storage. [2025-09-19T17:05:41.952671] [INFO ] [MAIN ] AGCO: Loaded 43138 existing records. [2025-09-19T17:05:42.137152] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T17:05:42.145107] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:42.145408] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-19T17:05:42.145485] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-19T17:05:42.147285] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-19T17:05:42.147376] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-19T17:05:42.248363] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-19T17:05:42.502881] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:43.043303] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-19T17:05:43.843341] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-19T17:05:44.643337] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-19T17:05:44.762417] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-19T17:05:45.210599] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T17:05:45.387998] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T17:05:45.443315] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-19T17:05:45.869196] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T17:05:46.243289] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-19T17:05:47.043283] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-19T17:05:47.723351] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-19T17:05:47.841304] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T17:05:47.849628] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-19T17:05:47.855538] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T17:05:48.643263] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-19T17:05:49.365330] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T17:05:49.366324] [INFO ] [REMOTE ] AFGE: Full fetch complete (3498 records). [2025-09-19T17:05:49.366396] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-19T17:05:49.448444] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-19T17:05:49.763343] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-19T17:05:49.763568] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-19T17:05:49.763828] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-19T17:05:49.763934] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-19T17:05:49.764617] [DEBUG] [LOCAL ] AFGE: Trimmed 3498 records to 2548 (keeping 200 days of data) [2025-09-19T17:05:49.780779] [DEBUG] [LOCAL ] AFGE: Primary data saved (2548 records). [2025-09-19T17:05:49.780878] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-19T17:05:49.781010] [INFO ] [MAIN ] Update Progress: 49/2372 symbols completed. AFGE took 34.1s. Estimated remaining: 4h 33m 1s. Rate: 8.5 symbols/min [2025-09-19T17:05:49.965115] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:49.997699] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-19T17:05:50.023603] [DEBUG] [LOCAL ] AGD: Loaded 17701 existing records from primary storage. [2025-09-19T17:05:50.023771] [INFO ] [MAIN ] AGD: Loaded 17701 existing records. [2025-09-19T17:05:50.202910] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:50.203194] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-19T17:05:50.203243] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-19T17:05:50.203824] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-19T17:05:50.203885] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-19T17:05:50.248357] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-19T17:05:50.624054] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:51.043267] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-19T17:05:51.617612] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T17:05:51.843282] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-19T17:05:52.176428] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:05:52.508211] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T17:05:52.643267] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-19T17:05:53.443250] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-19T17:05:53.609364] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T17:05:53.857916] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T17:05:54.243272] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-19T17:05:55.043312] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-19T17:05:55.739151] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T17:05:55.843237] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-19T17:05:55.881355] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T17:05:56.643269] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-19T17:05:56.999895] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T17:05:57.443270] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-19T17:05:57.950920] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T17:05:58.243267] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-19T17:05:58.427077] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T17:05:58.436325] [INFO ] [REMOTE ] AG: Full fetch complete (77570 records). [2025-09-19T17:05:58.436477] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-19T17:05:58.842779] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-19T17:05:58.843084] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-19T17:05:58.843826] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-19T17:05:58.843890] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-19T17:05:58.845441] [DEBUG] [LOCAL ] AG: Trimmed 77570 records to 54421 (keeping 200 days of data) [2025-09-19T17:05:59.054857] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-19T17:05:59.177842] [DEBUG] [LOCAL ] AG: Primary data saved (54421 records). [2025-09-19T17:05:59.177984] [INFO ] [MAIN ] AG: Full history saved. [2025-09-19T17:05:59.178069] [INFO ] [MAIN ] Update Progress: 50/2372 symbols completed. AG took 29.1s. Estimated remaining: 4h 34m 43s. Rate: 8.5 symbols/min [2025-09-19T17:05:59.357203] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:59.386696] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T17:05:59.440579] [DEBUG] [LOCAL ] AGI: Loaded 53802 existing records from primary storage. [2025-09-19T17:05:59.440752] [INFO ] [MAIN ] AGI: Loaded 53802 existing records. [2025-09-19T17:05:59.623431] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:59.623743] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-19T17:05:59.623849] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-19T17:05:59.625700] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-19T17:05:59.625764] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-19T17:05:59.849415] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-19T17:05:59.988797] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:00.336597] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T17:06:00.423440] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T17:06:00.643259] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-19T17:06:01.443281] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-19T17:06:01.788068] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T17:06:01.897222] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T17:06:02.243277] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-19T17:06:03.043282] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-19T17:06:03.843247] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-19T17:06:04.572905] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (3.13 seconds). [2025-09-19T17:06:04.643287] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-19T17:06:04.730610] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T17:06:04.944323] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-19T17:06:05.443275] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-19T17:06:06.184681] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T17:06:06.243239] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-19T17:06:06.725069] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T17:06:06.832447] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T17:06:07.043260] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-19T17:06:07.843254] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-19T17:06:08.383833] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T17:06:08.392066] [INFO ] [REMOTE ] AFL: Full fetch complete (76933 records). [2025-09-19T17:06:08.392221] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-19T17:06:08.649773] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-19T17:06:08.831503] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-19T17:06:08.831616] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-19T17:06:08.832501] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-19T17:06:08.832601] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-19T17:06:08.834344] [DEBUG] [LOCAL ] AFL: Trimmed 76933 records to 53927 (keeping 200 days of data) [2025-09-19T17:06:08.956964] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:06:09.221408] [DEBUG] [LOCAL ] AFL: Primary data saved (53927 records). [2025-09-19T17:06:09.221592] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-19T17:06:09.221726] [INFO ] [MAIN ] Update Progress: 51/2372 symbols completed. AFL took 46.1s. Estimated remaining: 4h 36m 50s. Rate: 8.4 symbols/min [2025-09-19T17:06:09.403524] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:09.446738] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-19T17:06:09.480495] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T17:06:09.493141] [DEBUG] [LOCAL ] AGL: Loaded 52793 existing records from primary storage. [2025-09-19T17:06:09.493510] [INFO ] [MAIN ] AGL: Loaded 52793 existing records. [2025-09-19T17:06:09.684012] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:09.684298] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-19T17:06:09.684394] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-19T17:06:09.685596] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-19T17:06:09.685682] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-19T17:06:10.060747] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:10.062010] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:06:10.243285] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-19T17:06:10.778162] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T17:06:11.043255] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-19T17:06:11.525251] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T17:06:11.843276] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-19T17:06:12.643266] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-19T17:06:12.685681] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-19T17:06:12.883041] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:06:12.889492] [INFO ] [REMOTE ] AGCO: Full fetch complete (62201 records). [2025-09-19T17:06:12.889612] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-19T17:06:13.283477] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-19T17:06:13.283575] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-19T17:06:13.284289] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-19T17:06:13.284357] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-19T17:06:13.285907] [DEBUG] [LOCAL ] AGCO: Trimmed 62201 records to 43447 (keeping 200 days of data) [2025-09-19T17:06:13.489883] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-19T17:06:13.589321] [DEBUG] [LOCAL ] AGCO: Primary data saved (43447 records). [2025-09-19T17:06:13.589461] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-19T17:06:13.589544] [INFO ] [MAIN ] Update Progress: 52/2372 symbols completed. AGCO took 31.9s. Estimated remaining: 4h 34m 38s. Rate: 8.4 symbols/min [2025-09-19T17:06:13.763018] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:13.763194] [DEBUG] [LOCAL ] AGM: No existing data file found in primary storage. [2025-09-19T17:06:13.763249] [WARN ] [MAIN ] AGM: No existing data found, performing full refresh instead. [2025-09-19T17:06:13.763405] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-19T17:06:13.763449] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-19T17:06:13.763491] [DEBUG] [LOCAL ] AGM: No primary data file found to delete. [2025-09-19T17:06:13.763523] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-19T17:06:14.121247] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:14.243255] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-19T17:06:14.799503] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T17:06:14.997972] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:06:15.007201] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T17:06:15.006925] [INFO ] [REMOTE ] AGD: Full fetch complete (25150 records). [2025-09-19T17:06:15.009675] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-19T17:06:15.048363] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-19T17:06:15.390951] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-19T17:06:15.391077] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-19T17:06:15.391420] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-19T17:06:15.391460] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-19T17:06:15.392128] [DEBUG] [LOCAL ] AGD: Trimmed 25150 records to 17845 (keeping 200 days of data) [2025-09-19T17:06:15.506053] [DEBUG] [LOCAL ] AGD: Primary data saved (17845 records). [2025-09-19T17:06:15.506198] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-19T17:06:15.506283] [INFO ] [MAIN ] Update Progress: 53/2372 symbols completed. AGD took 25.7s. Estimated remaining: 4h 30m 44s. Rate: 8.6 symbols/min [2025-09-19T17:06:15.675315] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:15.714742] [DEBUG] [LOCAL ] AGO: Loaded 28350 existing records from primary storage. [2025-09-19T17:06:15.714897] [INFO ] [MAIN ] AGO: Loaded 28350 existing records. [2025-09-19T17:06:15.848337] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-19T17:06:15.903827] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:15.904099] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-19T17:06:15.904152] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-19T17:06:15.905133] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-19T17:06:15.905197] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-19T17:06:16.269280] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:16.643277] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-19T17:06:17.443337] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-19T17:06:18.035688] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-09-19T17:06:18.243300] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-19T17:06:18.630405] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-19T17:06:18.739931] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T17:06:18.967534] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T17:06:19.043318] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-19T17:06:19.843239] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-19T17:06:19.994051] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T17:06:20.643282] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-19T17:06:20.843436] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T17:06:21.443279] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-19T17:06:21.691023] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T17:06:21.992334] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T17:06:22.239488] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T17:06:22.251244] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-19T17:06:23.043261] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-19T17:06:23.701855] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T17:06:23.792742] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T17:06:23.843279] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-19T17:06:24.643270] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-19T17:06:25.443244] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-19T17:06:25.479810] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T17:06:26.062078] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T17:06:26.243283] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-19T17:06:27.043308] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-19T17:06:27.223002] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T17:06:27.815424] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:06:27.843240] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-19T17:06:28.643323] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-19T17:06:29.443281] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-19T17:06:30.139706] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T17:06:30.243285] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-19T17:06:30.767071] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (3.72 seconds). [2025-09-19T17:06:30.804214] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-19T17:06:30.975156] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T17:06:31.043247] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-19T17:06:31.843295] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-19T17:06:31.881057] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T17:06:32.107240] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T17:06:32.643293] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-19T17:06:33.443280] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-19T17:06:33.933857] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T17:06:34.023720] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:06:34.243245] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-19T17:06:35.043304] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-19T17:06:35.089581] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T17:06:35.380900] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T17:06:35.843255] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-19T17:06:36.144402] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T17:06:36.643309] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-19T17:06:37.443325] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-19T17:06:37.631722] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T17:06:38.050730] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T17:06:38.059617] [INFO ] [REMOTE ] AGI: Full fetch complete (76677 records). [2025-09-19T17:06:38.059814] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-19T17:06:38.243635] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-19T17:06:38.459254] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-19T17:06:38.459349] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-19T17:06:38.460123] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-19T17:06:38.460191] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-19T17:06:38.461809] [DEBUG] [LOCAL ] AGI: Trimmed 76677 records to 54192 (keeping 200 days of data) [2025-09-19T17:06:38.806195] [DEBUG] [LOCAL ] AGI: Primary data saved (54192 records). [2025-09-19T17:06:38.806365] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-19T17:06:38.806518] [INFO ] [MAIN ] Update Progress: 54/2372 symbols completed. AGI took 39.6s. Estimated remaining: 4h 42m 17s. Rate: 8.2 symbols/min [2025-09-19T17:06:38.990019] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:39.037231] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T17:06:39.051329] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-19T17:06:39.062920] [DEBUG] [LOCAL ] AGRO: Loaded 34245 existing records from primary storage. [2025-09-19T17:06:39.063691] [INFO ] [MAIN ] AGRO: Loaded 34245 existing records. [2025-09-19T17:06:39.257505] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:39.257845] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-19T17:06:39.257908] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-19T17:06:39.258878] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-19T17:06:39.258939] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-19T17:06:39.621048] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:39.843283] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-19T17:06:40.102983] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T17:06:40.105770] [INFO ] [REMOTE ] AGM: Full fetch complete (12461 records). [2025-09-19T17:06:40.105863] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-19T17:06:40.485715] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-19T17:06:40.485817] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-19T17:06:40.486059] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-19T17:06:40.486165] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-19T17:06:40.486950] [DEBUG] [LOCAL ] AGM: Trimmed 12461 records to 9993 (keeping 200 days of data) [2025-09-19T17:06:40.562289] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-19T17:06:40.588124] [DEBUG] [LOCAL ] AGM: Primary data saved (9993 records). [2025-09-19T17:06:40.588308] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-19T17:06:40.588404] [INFO ] [MAIN ] Update Progress: 55/2372 symbols completed. AGM took 27.0s. Estimated remaining: 4h 38m 17s. Rate: 8.3 symbols/min [2025-09-19T17:06:40.652390] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-19T17:06:40.762194] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:40.801074] [DEBUG] [LOCAL ] AGX: Loaded 33860 existing records from primary storage. [2025-09-19T17:06:40.801257] [INFO ] [MAIN ] AGX: Loaded 33860 existing records. [2025-09-19T17:06:40.991262] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:40.991538] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-19T17:06:40.991592] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-19T17:06:40.992706] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-19T17:06:40.992793] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-19T17:06:41.279680] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:06:41.315959] [INFO ] [REMOTE ] AGO: Full fetch complete (39301 records). [2025-09-19T17:06:41.316101] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-19T17:06:41.447160] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-19T17:06:41.489886] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:41.801517] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-19T17:06:41.801697] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-19T17:06:41.802432] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-19T17:06:41.802517] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-19T17:06:41.805534] [DEBUG] [LOCAL ] AGO: Trimmed 39301 records to 28590 (keeping 200 days of data) [2025-09-19T17:06:41.986382] [DEBUG] [LOCAL ] AGO: Primary data saved (28590 records). [2025-09-19T17:06:41.986521] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-19T17:06:41.986606] [INFO ] [MAIN ] Update Progress: 56/2372 symbols completed. AGO took 26.5s. Estimated remaining: 4h 34m 9s. Rate: 8.4 symbols/min [2025-09-19T17:06:42.158984] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:42.202772] [DEBUG] [LOCAL ] AHH: Loaded 41921 existing records from primary storage. [2025-09-19T17:06:42.202949] [INFO ] [MAIN ] AHH: Loaded 41921 existing records. [2025-09-19T17:06:42.264717] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-19T17:06:42.425443] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:42.426032] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-19T17:06:42.426151] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-19T17:06:42.427306] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-19T17:06:42.427380] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-19T17:06:42.559727] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:06:42.839903] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:43.043323] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-19T17:06:43.201506] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:06:43.843276] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-19T17:06:44.056102] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T17:06:44.643285] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-19T17:06:44.778004] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:06:44.810293] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T17:06:45.443260] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-19T17:06:46.116435] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T17:06:46.243263] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-19T17:06:46.419341] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T17:06:47.043273] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-19T17:06:47.843287] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-19T17:06:48.195165] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T17:06:48.291800] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T17:06:48.643260] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-19T17:06:49.443318] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-19T17:06:49.994917] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T17:06:50.005586] [INFO ] [REMOTE ] AGL: Full fetch complete (75403 records). [2025-09-19T17:06:50.005877] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-19T17:06:50.254326] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-19T17:06:50.431252] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-19T17:06:50.431377] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-19T17:06:50.432255] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-19T17:06:50.432385] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-19T17:06:50.440984] [DEBUG] [LOCAL ] AGL: Trimmed 75403 records to 53174 (keeping 200 days of data) [2025-09-19T17:06:50.453857] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:06:50.762075] [DEBUG] [LOCAL ] AGL: Primary data saved (53174 records). [2025-09-19T17:06:50.762250] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-19T17:06:50.762402] [INFO ] [MAIN ] Update Progress: 57/2372 symbols completed. AGL took 41.5s. Estimated remaining: 4h 35m 10s. Rate: 8.4 symbols/min [2025-09-19T17:06:50.935701] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:50.935911] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-19T17:06:50.935965] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-19T17:06:50.936108] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-19T17:06:50.936151] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-19T17:06:50.936193] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-19T17:06:50.936225] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-19T17:06:51.048524] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-19T17:06:51.301764] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:51.454477] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:06:51.843280] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-19T17:06:52.039740] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:06:52.459484] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T17:06:52.643287] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-19T17:06:52.872027] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:06:52.872366] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-19T17:06:53.443275] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-19T17:06:53.726098] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T17:06:54.243278] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-19T17:06:55.043300] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-19T17:06:55.276846] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:06:55.277167] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-19T17:06:55.309267] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T17:06:55.699445] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:06:55.843267] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-19T17:06:56.643268] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-19T17:06:57.114742] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T17:06:57.443264] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-19T17:06:58.243274] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-19T17:06:58.382758] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T17:06:58.789571] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T17:06:59.043301] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-19T17:06:59.843291] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-19T17:07:00.000495] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:07:00.433453] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T17:07:00.643268] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-19T17:07:00.994066] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T17:07:01.443274] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-19T17:07:02.243279] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-19T17:07:02.357804] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T17:07:02.551402] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T17:07:02.556121] [INFO ] [REMOTE ] AGRO: Full fetch complete (49991 records). [2025-09-19T17:07:02.556231] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-19T17:07:02.973882] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-19T17:07:02.973964] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-19T17:07:02.974492] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-19T17:07:02.974535] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-19T17:07:02.975719] [DEBUG] [LOCAL ] AGRO: Trimmed 49991 records to 34460 (keeping 200 days of data) [2025-09-19T17:07:03.065482] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-19T17:07:03.183997] [DEBUG] [LOCAL ] AGRO: Primary data saved (34460 records). [2025-09-19T17:07:03.184157] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-19T17:07:03.184268] [INFO ] [MAIN ] Update Progress: 58/2372 symbols completed. AGRO took 24.4s. Estimated remaining: 4h 38m 34s. Rate: 8.3 symbols/min [2025-09-19T17:07:03.370685] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:03.343532] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:03.371565] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-19T17:07:03.429935] [DEBUG] [LOCAL ] AHR: Loaded 49738 existing records from primary storage. [2025-09-19T17:07:03.430114] [INFO ] [MAIN ] AHR: Loaded 49738 existing records. [2025-09-19T17:07:03.612275] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:03.612512] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-19T17:07:03.612560] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-19T17:07:03.613937] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-19T17:07:03.613999] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-19T17:07:03.855978] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-19T17:07:03.978413] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:04.224489] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T17:07:04.643274] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-19T17:07:05.443279] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-19T17:07:05.580864] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T17:07:05.586105] [INFO ] [REMOTE ] AGX: Full fetch complete (49032 records). [2025-09-19T17:07:05.586194] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-19T17:07:05.964581] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-19T17:07:05.964693] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-19T17:07:05.965240] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-19T17:07:05.965284] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-19T17:07:05.966358] [DEBUG] [LOCAL ] AGX: Trimmed 49032 records to 34119 (keeping 200 days of data) [2025-09-19T17:07:06.182400] [DEBUG] [LOCAL ] AGX: Primary data saved (34119 records). [2025-09-19T17:07:06.182547] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-19T17:07:06.182632] [INFO ] [MAIN ] Update Progress: 59/2372 symbols completed. AGX took 25.6s. Estimated remaining: 4h 35m 41s. Rate: 8.4 symbols/min [2025-09-19T17:07:06.252831] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-19T17:07:06.356288] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:06.365499] [DEBUG] [LOCAL ] AHT: Loaded 5997 existing records from primary storage. [2025-09-19T17:07:06.365615] [INFO ] [MAIN ] AHT: Loaded 5997 existing records. [2025-09-19T17:07:06.555547] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:06.555879] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-19T17:07:06.555930] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-19T17:07:06.557361] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-19T17:07:06.557424] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-19T17:07:06.590938] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:06.630691] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-19T17:07:06.933943] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:06.962984] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-19T17:07:07.001622] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:07:07.043220] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-19T17:07:07.843319] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-19T17:07:08.643261] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-19T17:07:08.896969] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:08.908957] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-19T17:07:08.911057] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:07:09.022022] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T17:07:09.443277] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-19T17:07:10.243264] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-19T17:07:10.909952] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:07:11.043690] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-19T17:07:11.044574] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T17:07:11.843259] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-19T17:07:12.643265] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-19T17:07:13.287200] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-19T17:07:13.376286] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T17:07:13.443283] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-19T17:07:13.466237] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:07:14.243279] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-19T17:07:14.826561] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T17:07:15.043254] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-19T17:07:15.316727] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T17:07:15.479289] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T17:07:15.843278] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-19T17:07:16.643274] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-19T17:07:17.443260] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-19T17:07:17.505965] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:07:18.042621] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T17:07:18.243308] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-19T17:07:18.784978] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T17:07:19.043305] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-19T17:07:19.813422] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T17:07:19.843228] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-19T17:07:20.190375] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:07:20.643251] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-19T17:07:20.716419] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T17:07:21.443278] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-19T17:07:22.180738] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:07:22.243268] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-19T17:07:23.043273] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-19T17:07:23.172546] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T17:07:23.807325] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T17:07:23.843280] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-19T17:07:24.350581] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:07:24.643321] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-19T17:07:25.443282] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-19T17:07:25.838449] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T17:07:26.052016] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T17:07:26.243302] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-19T17:07:26.489310] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T17:07:26.497559] [INFO ] [REMOTE ] AHH: Full fetch complete (60393 records). [2025-09-19T17:07:26.497781] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-19T17:07:26.903790] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-19T17:07:26.903874] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-19T17:07:26.904466] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-19T17:07:26.904528] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-19T17:07:26.905844] [DEBUG] [LOCAL ] AHH: Trimmed 60393 records to 42133 (keeping 200 days of data) [2025-09-19T17:07:27.076536] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-19T17:07:27.158949] [DEBUG] [LOCAL ] AHH: Primary data saved (42133 records). [2025-09-19T17:07:27.159091] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-19T17:07:27.161748] [INFO ] [MAIN ] Update Progress: 60/2372 symbols completed. AHH took 45.2s. Estimated remaining: 4h 44m 27s. Rate: 8.1 symbols/min [2025-09-19T17:07:27.357313] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:27.417849] [DEBUG] [LOCAL ] AI: Loaded 54139 existing records from primary storage. [2025-09-19T17:07:27.418021] [INFO ] [MAIN ] AI: Loaded 54139 existing records. [2025-09-19T17:07:27.624539] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:27.625614] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-19T17:07:27.625786] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-19T17:07:27.632307] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-19T17:07:27.644274] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T17:07:27.643531] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-19T17:07:27.651131] [INFO ] [REMOTE ] AHL: Full fetch complete (16826 records). [2025-09-19T17:07:27.656513] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-19T17:07:27.740135] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-19T17:07:27.863623] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-19T17:07:28.133065] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 93 unique days, need 200 days [2025-09-19T17:07:28.144807] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:07:28.166421] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:07:28.166614] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-19T17:07:28.166763] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-19T17:07:28.166853] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-19T17:07:28.167265] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-19T17:07:28.178247] [INFO ] [MAIN ] Update Progress: 61/2372 symbols completed. AHL took 37.4s. Estimated remaining: 4h 40m 18s. Rate: 8.2 symbols/min [2025-09-19T17:07:28.361000] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:28.424109] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:28.475950] [DEBUG] [LOCAL ] AIG: Loaded 53867 existing records from primary storage. [2025-09-19T17:07:28.476104] [INFO ] [MAIN ] AIG: Loaded 53867 existing records. [2025-09-19T17:07:28.653280] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-19T17:07:28.660816] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:28.661020] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-19T17:07:28.661080] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-19T17:07:28.662883] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-19T17:07:28.662950] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-19T17:07:29.045086] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:29.443345] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-19T17:07:29.645166] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T17:07:29.648951] [INFO ] [REMOTE ] AHT: Full fetch complete (9521 records). [2025-09-19T17:07:29.649209] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-19T17:07:30.204578] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-19T17:07:30.224071] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-19T17:07:30.242130] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-19T17:07:30.244999] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T17:07:30.245228] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-19T17:07:30.243100] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-19T17:07:30.260778] [DEBUG] [LOCAL ] AHT: Trimmed 9521 records to 6046 (keeping 200 days of data) [2025-09-19T17:07:30.310010] [DEBUG] [LOCAL ] AHT: Primary data saved (6046 records). [2025-09-19T17:07:30.310241] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-19T17:07:30.310375] [INFO ] [MAIN ] Update Progress: 62/2372 symbols completed. AHT took 24.1s. Estimated remaining: 4h 36m 59s. Rate: 8.3 symbols/min [2025-09-19T17:07:30.533298] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:30.533619] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-19T17:07:30.533711] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-19T17:07:30.533947] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-19T17:07:30.534012] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-19T17:07:30.534063] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-19T17:07:30.534116] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-19T17:07:30.958534] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:31.043309] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-19T17:07:31.284628] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:31.284998] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-19T17:07:31.843286] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-19T17:07:32.105425] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:32.105828] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-19T17:07:32.350276] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T17:07:32.393357] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-09-19T17:07:32.643286] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-19T17:07:32.872316] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:32.872627] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-19T17:07:33.443287] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-19T17:07:34.243255] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-19T17:07:34.488137] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:34.488543] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-19T17:07:35.043273] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-19T17:07:35.270218] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:35.270529] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-19T17:07:35.843283] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-19T17:07:36.262960] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-09-19T17:07:36.643246] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-19T17:07:36.952513] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T17:07:37.443287] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-19T17:07:38.243313] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-19T17:07:38.678921] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T17:07:38.931970] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T17:07:39.043296] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-19T17:07:39.843284] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-19T17:07:40.536239] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T17:07:40.643328] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-19T17:07:40.884634] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T17:07:41.184196] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T17:07:41.443324] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-19T17:07:42.243324] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-19T17:07:42.323426] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T17:07:42.839763] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:07:43.043320] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-19T17:07:43.843383] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-19T17:07:44.232721] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:07:44.235893] [INFO ] [REMOTE ] AII: Full fetch complete (10120 records). [2025-09-19T17:07:44.236150] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-19T17:07:44.434631] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 93 unique days, need 200 days [2025-09-19T17:07:44.435285] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:07:44.435421] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:07:44.435705] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-19T17:07:44.436023] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-19T17:07:44.436177] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-19T17:07:44.436286] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-19T17:07:44.436468] [INFO ] [MAIN ] Update Progress: 63/2372 symbols completed. AII took 14.1s. Estimated remaining: 4h 41m 6s. Rate: 8.2 symbols/min [2025-09-19T17:07:44.623614] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-19T17:07:44.648967] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-19T17:07:44.641573] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:44.653120] [INFO ] [REMOTE ] AHR: Full fetch complete (71077 records). [2025-09-19T17:07:44.653254] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-19T17:07:44.852058] [DEBUG] [LOCAL ] AIN: Loaded 24805 existing records from primary storage. [2025-09-19T17:07:44.875100] [INFO ] [MAIN ] AIN: Loaded 24805 existing records. [2025-09-19T17:07:45.290874] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-19T17:07:45.306676] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-19T17:07:45.312381] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:45.313185] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-19T17:07:45.313281] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-19T17:07:45.313556] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-19T17:07:45.313610] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-19T17:07:45.314401] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-19T17:07:45.314465] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-19T17:07:45.346859] [DEBUG] [LOCAL ] AHR: Trimmed 71077 records to 50104 (keeping 200 days of data) [2025-09-19T17:07:45.806789] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:45.815041] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-19T17:07:45.994852] [DEBUG] [LOCAL ] AHR: Primary data saved (50104 records). [2025-09-19T17:07:45.995036] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-19T17:07:45.995206] [INFO ] [MAIN ] Update Progress: 64/2372 symbols completed. AHR took 42.8s. Estimated remaining: 4h 37m 32s. Rate: 8.3 symbols/min [2025-09-19T17:07:46.227499] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:46.289186] [DEBUG] [LOCAL ] AIO: Loaded 13488 existing records from primary storage. [2025-09-19T17:07:46.289762] [INFO ] [MAIN ] AIO: Loaded 13488 existing records. [2025-09-19T17:07:46.294318] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T17:07:46.405480] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-19T17:07:46.489085] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:46.489368] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-19T17:07:46.489418] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-19T17:07:46.490029] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-19T17:07:46.490089] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-19T17:07:46.848476] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:46.868706] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:07:46.901505] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-19T17:07:47.043239] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-19T17:07:47.843268] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-19T17:07:48.643276] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-19T17:07:49.084154] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T17:07:49.119170] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-19T17:07:49.165000] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T17:07:49.393263] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:07:49.443279] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-19T17:07:50.243276] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-19T17:07:50.621853] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:07:51.043313] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-19T17:07:51.843327] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-19T17:07:51.980527] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T17:07:52.175996] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T17:07:52.643271] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-19T17:07:53.443274] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-19T17:07:54.181813] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T17:07:54.224941] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:07:54.243231] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-19T17:07:54.456603] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-19T17:07:55.043271] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-19T17:07:55.843284] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-19T17:07:56.434638] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:07:56.643272] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-19T17:07:57.006841] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T17:07:57.443277] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-19T17:07:58.114567] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-19T17:07:58.243318] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-19T17:07:58.821246] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:07:59.043276] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-19T17:07:59.058424] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T17:07:59.821958] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T17:07:59.843225] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-19T17:08:00.643292] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-19T17:08:00.884260] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T17:08:01.417084] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T17:08:01.443221] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-19T17:08:02.243269] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-19T17:08:03.043291] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-19T17:08:03.267699] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-19T17:08:03.293532] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T17:08:03.527005] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T17:08:03.535180] [INFO ] [REMOTE ] AIG: Full fetch complete (77375 records). [2025-09-19T17:08:03.535348] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-19T17:08:03.848395] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-19T17:08:03.942671] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-19T17:08:03.942762] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-19T17:08:03.943504] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-19T17:08:03.943547] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-19T17:08:03.945402] [DEBUG] [LOCAL ] AIG: Trimmed 77375 records to 54257 (keeping 200 days of data) [2025-09-19T17:08:04.298730] [DEBUG] [LOCAL ] AIG: Primary data saved (54257 records). [2025-09-19T17:08:04.299278] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-19T17:08:04.299523] [INFO ] [MAIN ] Update Progress: 65/2372 symbols completed. AIG took 36.1s. Estimated remaining: 4h 43m 58s. Rate: 8.1 symbols/min [2025-09-19T17:08:04.472477] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T17:08:04.491791] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:04.523807] [DEBUG] [LOCAL ] AIR: Loaded 27262 existing records from primary storage. [2025-09-19T17:08:04.523949] [INFO ] [MAIN ] AIR: Loaded 27262 existing records. [2025-09-19T17:08:04.648426] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-19T17:08:04.704629] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:04.704916] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-19T17:08:04.704965] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-19T17:08:04.705753] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-19T17:08:04.705819] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-19T17:08:05.084016] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:05.353629] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T17:08:05.443277] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-19T17:08:05.956006] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T17:08:06.243251] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-19T17:08:06.335314] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T17:08:07.043264] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-19T17:08:07.843267] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-19T17:08:08.519992] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T17:08:08.648459] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-19T17:08:08.659488] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-19T17:08:08.669793] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-19T17:08:08.669965] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-19T17:08:09.080842] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-19T17:08:09.081169] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-19T17:08:09.081945] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-19T17:08:09.082080] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-19T17:08:09.083805] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54529 (keeping 200 days of data) [2025-09-19T17:08:09.202614] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T17:08:09.440453] [DEBUG] [LOCAL ] AI: Primary data saved (54529 records). [2025-09-19T17:08:09.440605] [INFO ] [MAIN ] AI: Full history saved. [2025-09-19T17:08:09.441449] [INFO ] [MAIN ] Update Progress: 66/2372 symbols completed. AI took 42.3s. Estimated remaining: 4h 42m 32s. Rate: 8.2 symbols/min [2025-09-19T17:08:09.453021] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-19T17:08:09.616321] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:09.634185] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T17:08:09.666830] [DEBUG] [LOCAL ] AIT: Loaded 28647 existing records from primary storage. [2025-09-19T17:08:09.667021] [INFO ] [MAIN ] AIT: Loaded 28647 existing records. [2025-09-19T17:08:09.850131] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:09.850409] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-19T17:08:09.850461] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-19T17:08:09.851535] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-19T17:08:09.851595] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-19T17:08:10.221729] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:10.243229] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-19T17:08:10.625911] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T17:08:11.043275] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-19T17:08:11.757069] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T17:08:11.843381] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-19T17:08:12.346722] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T17:08:12.643302] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-19T17:08:12.975274] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T17:08:13.443301] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-19T17:08:13.764113] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T17:08:14.243267] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-19T17:08:14.927754] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:08:14.931293] [INFO ] [REMOTE ] AIN: Full fetch complete (33239 records). [2025-09-19T17:08:14.931375] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-19T17:08:15.048354] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-19T17:08:15.323064] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-19T17:08:15.323181] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-19T17:08:15.323601] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-19T17:08:15.323665] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-19T17:08:15.324758] [DEBUG] [LOCAL ] AIN: Trimmed 33239 records to 24971 (keeping 200 days of data) [2025-09-19T17:08:15.489770] [DEBUG] [LOCAL ] AIN: Primary data saved (24971 records). [2025-09-19T17:08:15.489906] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-19T17:08:15.489993] [INFO ] [MAIN ] Update Progress: 67/2372 symbols completed. AIN took 31.1s. Estimated remaining: 4h 41m 40s. Rate: 8.2 symbols/min [2025-09-19T17:08:15.664449] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:15.708682] [DEBUG] [LOCAL ] AIV: Loaded 40482 existing records from primary storage. [2025-09-19T17:08:15.708859] [INFO ] [MAIN ] AIV: Loaded 40482 existing records. [2025-09-19T17:08:15.852860] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-19T17:08:15.895342] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:15.895767] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-19T17:08:15.895831] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-19T17:08:15.902055] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-19T17:08:15.909397] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-19T17:08:15.947534] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T17:08:16.283541] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:16.304233] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T17:08:16.643294] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-19T17:08:16.719314] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T17:08:17.443302] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-19T17:08:18.243285] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-19T17:08:18.386951] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T17:08:18.917784] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:08:19.043337] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-19T17:08:19.174384] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T17:08:19.843271] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-19T17:08:20.406751] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T17:08:20.643300] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-19T17:08:21.189499] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T17:08:21.443273] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-19T17:08:21.854635] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T17:08:21.857350] [INFO ] [REMOTE ] AIO: Full fetch complete (20114 records). [2025-09-19T17:08:21.857486] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-19T17:08:22.256060] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-19T17:08:22.326721] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-19T17:08:22.326863] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-19T17:08:22.327426] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-19T17:08:22.327525] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-19T17:08:22.328801] [DEBUG] [LOCAL ] AIO: Trimmed 20114 records to 13548 (keeping 200 days of data) [2025-09-19T17:08:22.452504] [DEBUG] [LOCAL ] AIO: Primary data saved (13548 records). [2025-09-19T17:08:22.452710] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-19T17:08:22.452833] [INFO ] [MAIN ] Update Progress: 68/2372 symbols completed. AIO took 36.5s. Estimated remaining: 4h 41m 20s. Rate: 8.2 symbols/min [2025-09-19T17:08:22.740498] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:22.796448] [DEBUG] [LOCAL ] AIZ: Loaded 30647 existing records from primary storage. [2025-09-19T17:08:22.796685] [INFO ] [MAIN ] AIZ: Loaded 30647 existing records. [2025-09-19T17:08:23.059498] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-19T17:08:23.074219] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:23.075843] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-19T17:08:23.075932] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-19T17:08:23.077053] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-19T17:08:23.077433] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-19T17:08:23.250705] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:08:23.574874] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:23.687734] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T17:08:23.843261] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-19T17:08:24.643267] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-19T17:08:24.903002] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T17:08:25.024929] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T17:08:25.443305] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-19T17:08:25.691601] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:08:26.243256] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-19T17:08:27.043274] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-19T17:08:27.178328] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T17:08:27.843269] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-19T17:08:27.844564] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T17:08:28.204538] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T17:08:28.643311] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-19T17:08:29.203983] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:08:29.443272] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-19T17:08:29.716439] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T17:08:30.243337] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-19T17:08:31.043276] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-19T17:08:31.184460] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T17:08:31.403166] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T17:08:31.843294] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-19T17:08:32.643310] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-19T17:08:32.711991] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T17:08:32.716109] [INFO ] [REMOTE ] AIR: Full fetch complete (37070 records). [2025-09-19T17:08:32.716199] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-19T17:08:32.716819] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:08:32.716906] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:08:32.716949] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:08:32.717014] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-19T17:08:32.717080] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-19T17:08:32.717118] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-09-19T17:08:32.717594] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-09-19T17:08:32.717920] [INFO ] [MAIN ] Update Progress: 69/2372 symbols completed. AIR took 28.4s. Estimated remaining: 4h 42m 51s. Rate: 8.1 symbols/min [2025-09-19T17:08:32.901294] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:32.901535] [DEBUG] [LOCAL ] AIZN: No existing data file found in primary storage. [2025-09-19T17:08:32.901591] [WARN ] [MAIN ] AIZN: No existing data found, performing full refresh instead. [2025-09-19T17:08:32.901770] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-19T17:08:32.901818] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-19T17:08:32.901859] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-09-19T17:08:32.901892] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-19T17:08:33.307107] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:08:33.328961] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:33.443230] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-19T17:08:34.044481] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-19T17:08:34.243291] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-19T17:08:34.381624] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T17:08:35.043280] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-19T17:08:35.452869] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T17:08:35.843274] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-19T17:08:36.643393] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-19T17:08:36.871867] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T17:08:37.340595] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T17:08:37.443280] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-19T17:08:37.559433] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T17:08:38.243299] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-19T17:08:39.043310] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-19T17:08:39.108934] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T17:08:39.800876] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T17:08:39.843225] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-19T17:08:40.193314] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T17:08:40.643296] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-19T17:08:40.876518] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T17:08:41.443324] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-19T17:08:42.243282] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-19T17:08:42.573634] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T17:08:42.585485] [INFO ] [REMOTE ] AIV: Full fetch complete (58982 records). [2025-09-19T17:08:42.585738] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-19T17:08:42.944278] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:08:42.984553] [INFO ] [REMOTE ] AIT: Full fetch complete (39621 records). [2025-09-19T17:08:43.001922] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-19T17:08:43.005421] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-19T17:08:43.011114] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-19T17:08:43.011870] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-19T17:08:43.046912] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-19T17:08:43.046772] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-19T17:08:43.127673] [DEBUG] [LOCAL ] AIV: Trimmed 58982 records to 40790 (keeping 200 days of data) [2025-09-19T17:08:43.539534] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-19T17:08:43.542997] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-19T17:08:43.544102] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-19T17:08:43.544716] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-19T17:08:43.549577] [DEBUG] [LOCAL ] AIT: Trimmed 39621 records to 28788 (keeping 200 days of data) [2025-09-19T17:08:43.783293] [DEBUG] [LOCAL ] AIV: Primary data saved (40790 records). [2025-09-19T17:08:43.784778] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-19T17:08:43.785039] [INFO ] [MAIN ] Update Progress: 70/2372 symbols completed. AIV took 28.3s. Estimated remaining: 4h 44m 45s. Rate: 8.1 symbols/min [2025-09-19T17:08:43.867088] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:08:43.891980] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T17:08:43.905353] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-19T17:08:44.013627] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:44.014575] [DEBUG] [LOCAL ] AJG: No existing data file found in primary storage. [2025-09-19T17:08:44.014934] [WARN ] [MAIN ] AJG: No existing data found, performing full refresh instead. [2025-09-19T17:08:44.015884] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-19T17:08:44.016228] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-19T17:08:44.017060] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-19T17:08:44.017118] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-19T17:08:44.405112] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:44.460890] [DEBUG] [LOCAL ] AIT: Primary data saved (28788 records). [2025-09-19T17:08:44.461019] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-19T17:08:44.461104] [INFO ] [MAIN ] Update Progress: 71/2372 symbols completed. AIT took 35.0s. Estimated remaining: 4h 40m 59s. Rate: 8.2 symbols/min [2025-09-19T17:08:44.641202] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:44.641498] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-19T17:08:44.641556] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-19T17:08:44.641852] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-19T17:08:44.641925] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-19T17:08:44.641995] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-19T17:08:44.642032] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-19T17:08:44.653715] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-19T17:08:44.943519] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T17:08:45.032263] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:45.443272] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-19T17:08:46.127488] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T17:08:46.243298] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-19T17:08:47.039615] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T17:08:47.049664] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-19T17:08:47.776328] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T17:08:47.843282] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-19T17:08:47.890390] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T17:08:48.643263] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-19T17:08:49.383093] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T17:08:49.443306] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-19T17:08:49.889517] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T17:08:50.243320] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-19T17:08:50.953596] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:08:50.958017] [INFO ] [REMOTE ] AIZ: Full fetch complete (43065 records). [2025-09-19T17:08:50.958114] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-19T17:08:51.048475] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-19T17:08:51.356755] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-19T17:08:51.356854] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-19T17:08:51.357320] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-19T17:08:51.357361] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-19T17:08:51.358392] [DEBUG] [LOCAL ] AIZ: Trimmed 43065 records to 30801 (keeping 200 days of data) [2025-09-19T17:08:51.462250] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-19T17:08:51.564716] [DEBUG] [LOCAL ] AIZ: Primary data saved (30801 records). [2025-09-19T17:08:51.564868] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-19T17:08:51.564958] [INFO ] [MAIN ] Update Progress: 72/2372 symbols completed. AIZ took 29.1s. Estimated remaining: 4h 40m 45s. Rate: 8.2 symbols/min [2025-09-19T17:08:51.743841] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:51.775119] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T17:08:51.833057] [DEBUG] [LOCAL ] AKR: Loaded 46021 existing records from primary storage. [2025-09-19T17:08:51.833209] [INFO ] [MAIN ] AKR: Loaded 46021 existing records. [2025-09-19T17:08:51.848368] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-19T17:08:52.016365] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:52.016706] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-19T17:08:52.016765] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-19T17:08:52.018055] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-19T17:08:52.018119] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-19T17:08:52.386036] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:52.643264] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-19T17:08:52.676318] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T17:08:53.443297] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-19T17:08:54.147877] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T17:08:54.243293] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-19T17:08:54.276528] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:08:55.043294] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-19T17:08:55.843294] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-19T17:08:56.169969] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T17:08:56.626102] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T17:08:56.627169] [INFO ] [REMOTE ] AIZN: Full fetch complete (5722 records). [2025-09-19T17:08:56.627240] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-19T17:08:56.648428] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-19T17:08:57.049548] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-19T17:08:57.049701] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-19T17:08:57.050121] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-19T17:08:57.050204] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-19T17:08:57.050998] [DEBUG] [LOCAL ] AIZN: Trimmed 5722 records to 4012 (keeping 200 days of data) [2025-09-19T17:08:57.077538] [DEBUG] [LOCAL ] AIZN: Primary data saved (4012 records). [2025-09-19T17:08:57.077688] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-19T17:08:57.077782] [INFO ] [MAIN ] Update Progress: 73/2372 symbols completed. AIZN took 24.4s. Estimated remaining: 4h 39m 40s. Rate: 8.2 symbols/min [2025-09-19T17:08:57.266547] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:57.298727] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T17:08:57.349917] [DEBUG] [LOCAL ] AL: Loaded 44281 existing records from primary storage. [2025-09-19T17:08:57.350117] [INFO ] [MAIN ] AL: Loaded 44281 existing records. [2025-09-19T17:08:57.453257] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-19T17:08:57.541500] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:57.541824] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-19T17:08:57.541879] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-19T17:08:57.543175] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-19T17:08:57.543238] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-19T17:08:57.943341] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:58.243294] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-19T17:08:58.648300] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:08:58.916312] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T17:08:59.043289] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-19T17:08:59.455284] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T17:08:59.458167] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T17:08:59.843267] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-19T17:09:00.470929] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-19T17:09:00.643282] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-19T17:09:01.038197] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-19T17:09:01.443469] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-19T17:09:02.243329] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-19T17:09:03.043267] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-19T17:09:03.843262] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-19T17:09:04.770240] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T17:09:04.772586] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-19T17:09:05.316274] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:09:05.443265] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-19T17:09:05.859739] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-19T17:09:06.066822] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (4.62 seconds). [2025-09-19T17:09:06.138391] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (3.10 seconds). [2025-09-19T17:09:06.243243] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-19T17:09:06.367376] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-19T17:09:07.043307] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-19T17:09:07.843277] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-19T17:09:08.323927] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T17:09:08.361273] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:09:08.438073] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T17:09:08.643294] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-19T17:09:09.176472] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-19T17:09:09.177347] [INFO ] [REMOTE ] AKA: Full fetch complete (2450 records). [2025-09-19T17:09:09.177429] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-19T17:09:09.396183] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T17:09:09.396535] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:09:09.396590] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:09:09.396745] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-19T17:09:09.396856] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-19T17:09:09.396917] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-19T17:09:09.396977] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-19T17:09:09.397098] [INFO ] [MAIN ] Update Progress: 74/2372 symbols completed. AKA took 24.9s. Estimated remaining: 4h 42m 9s. Rate: 8.1 symbols/min [2025-09-19T17:09:09.448541] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-19T17:09:09.583446] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:09.651346] [DEBUG] [LOCAL ] ALB: Loaded 53627 existing records from primary storage. [2025-09-19T17:09:09.651549] [INFO ] [MAIN ] ALB: Loaded 53627 existing records. [2025-09-19T17:09:09.835144] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:09.835515] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-19T17:09:09.835569] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-19T17:09:09.836944] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-19T17:09:09.837010] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-19T17:09:10.217669] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:10.243243] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-19T17:09:11.043331] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-19T17:09:11.363320] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:09:11.843239] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-19T17:09:12.643279] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-19T17:09:12.681288] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-19T17:09:13.443364] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-19T17:09:13.693244] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-19T17:09:14.074204] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T17:09:14.243306] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-19T17:09:15.043266] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-19T17:09:15.667978] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (3.02 seconds). [2025-09-19T17:09:15.843270] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-19T17:09:16.168490] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T17:09:16.309163] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-19T17:09:16.556343] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T17:09:16.643266] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-19T17:09:17.444179] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-19T17:09:17.445576] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T17:09:17.453613] [INFO ] [REMOTE ] AJG: Full fetch complete (69694 records). [2025-09-19T17:09:17.453798] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-19T17:09:17.860742] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-19T17:09:17.860838] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-19T17:09:17.861486] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-19T17:09:17.861530] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-19T17:09:17.863096] [DEBUG] [LOCAL ] AJG: Trimmed 69694 records to 47861 (keeping 200 days of data) [2025-09-19T17:09:18.178481] [DEBUG] [LOCAL ] AJG: Primary data saved (47861 records). [2025-09-19T17:09:18.178619] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-19T17:09:18.178752] [INFO ] [MAIN ] Update Progress: 75/2372 symbols completed. AJG took 34.4s. Estimated remaining: 4h 42m 45s. Rate: 8.1 symbols/min [2025-09-19T17:09:18.253525] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-19T17:09:18.356563] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:18.423904] [DEBUG] [LOCAL ] ALC: Loaded 51186 existing records from primary storage. [2025-09-19T17:09:18.424087] [INFO ] [MAIN ] ALC: Loaded 51186 existing records. [2025-09-19T17:09:18.601693] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:18.601976] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-19T17:09:18.602026] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-19T17:09:18.603107] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-19T17:09:18.603196] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-19T17:09:19.010289] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:19.039974] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-19T17:09:19.049721] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-19T17:09:19.522145] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T17:09:19.662484] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:09:19.843277] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-19T17:09:20.643263] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-19T17:09:21.038840] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T17:09:21.443281] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-19T17:09:21.545608] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T17:09:22.029320] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T17:09:22.243277] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-19T17:09:23.043291] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-19T17:09:23.843281] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-19T17:09:24.275787] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-19T17:09:24.478531] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T17:09:24.517976] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T17:09:24.643248] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-19T17:09:25.443323] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-19T17:09:25.637401] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T17:09:26.243309] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-19T17:09:26.526131] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T17:09:26.725295] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T17:09:27.043279] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-19T17:09:27.843234] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-19T17:09:28.222351] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T17:09:28.326682] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T17:09:28.643266] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-19T17:09:29.443288] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-19T17:09:29.886938] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T17:09:29.893957] [INFO ] [REMOTE ] AKR: Full fetch complete (65315 records). [2025-09-19T17:09:29.894106] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-19T17:09:30.248393] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-19T17:09:30.295418] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-19T17:09:30.295503] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-19T17:09:30.296197] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-19T17:09:30.296262] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-19T17:09:30.297938] [DEBUG] [LOCAL ] AKR: Trimmed 65315 records to 46371 (keeping 200 days of data) [2025-09-19T17:09:30.603151] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T17:09:30.622361] [DEBUG] [LOCAL ] AKR: Primary data saved (46371 records). [2025-09-19T17:09:30.622508] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-19T17:09:30.622610] [INFO ] [MAIN ] Update Progress: 76/2372 symbols completed. AKR took 39.1s. Estimated remaining: 4h 45m 10s. Rate: 8.1 symbols/min [2025-09-19T17:09:30.796272] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:30.832919] [DEBUG] [LOCAL ] ALE: Loaded 30334 existing records from primary storage. [2025-09-19T17:09:30.833152] [INFO ] [MAIN ] ALE: Loaded 30334 existing records. [2025-09-19T17:09:31.018857] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:31.019173] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-19T17:09:31.019230] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-19T17:09:31.020021] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-19T17:09:31.020082] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-19T17:09:31.051225] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-19T17:09:31.412893] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:31.634785] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T17:09:31.642518] [INFO ] [REMOTE ] AL: Full fetch complete (61981 records). [2025-09-19T17:09:31.642750] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-19T17:09:31.848434] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-19T17:09:32.053004] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-19T17:09:32.053107] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-19T17:09:32.053739] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-19T17:09:32.053805] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-19T17:09:32.055094] [DEBUG] [LOCAL ] AL: Trimmed 61981 records to 44621 (keeping 200 days of data) [2025-09-19T17:09:32.335725] [DEBUG] [LOCAL ] AL: Primary data saved (44621 records). [2025-09-19T17:09:32.335878] [INFO ] [MAIN ] AL: Full history saved. [2025-09-19T17:09:32.335965] [INFO ] [MAIN ] Update Progress: 77/2372 symbols completed. AL took 35.3s. Estimated remaining: 4h 42m 12s. Rate: 8.1 symbols/min [2025-09-19T17:09:33.375528] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T17:09:33.387787] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-19T17:09:33.556000] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T17:09:33.561762] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-19T17:09:35.097611] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:09:35.107510] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-19T17:09:35.454667] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T17:09:35.465721] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-19T17:09:35.866046] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T17:09:35.871680] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-19T17:09:37.283420] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T17:09:37.289638] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-19T17:09:37.402196] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:09:37.443230] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-19T17:09:38.965099] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T17:09:38.972338] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-19T17:09:39.374872] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T17:09:39.402600] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-19T17:09:39.416997] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (9.17 seconds). [2025-09-19T17:09:39.843266] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-19T17:09:40.501857] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T17:09:40.643264] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-19T17:09:41.527537] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T17:09:41.541097] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-19T17:09:42.122672] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-19T17:09:42.153201] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T17:09:42.243261] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-19T17:09:43.043339] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-19T17:09:43.729266] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T17:09:43.737143] [INFO ] [REMOTE ] ALC: Full fetch complete (72474 records). [2025-09-19T17:09:43.737300] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-19T17:09:44.166087] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-19T17:09:44.166239] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-19T17:09:44.167029] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-19T17:09:44.167204] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-19T17:09:44.189521] [DEBUG] [LOCAL ] ALC: Trimmed 72474 records to 51559 (keeping 200 days of data) [2025-09-19T17:09:44.190780] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T17:09:44.199972] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-19T17:09:44.529669] [DEBUG] [LOCAL ] ALC: Primary data saved (51559 records). [2025-09-19T17:09:44.529842] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-19T17:09:44.530016] [INFO ] [MAIN ] Update Progress: 78/2372 symbols completed. ALC took 26.4s. Estimated remaining: 4h 44m 26s. Rate: 8.1 symbols/min [2025-09-19T17:09:45.650547] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-19T17:09:45.662710] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-19T17:09:46.222040] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T17:09:46.230281] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-19T17:09:47.809179] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:09:47.814848] [INFO ] [REMOTE ] ALE: Full fetch complete (42045 records). [2025-09-19T17:09:47.814993] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-19T17:09:48.206295] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-19T17:09:48.206405] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-19T17:09:48.206961] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-19T17:09:48.207116] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-19T17:09:48.209255] [DEBUG] [LOCAL ] ALE: Trimmed 42045 records to 30622 (keeping 200 days of data) [2025-09-19T17:09:48.331997] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-19T17:09:48.345934] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-19T17:09:48.445355] [DEBUG] [LOCAL ] ALE: Primary data saved (30622 records). [2025-09-19T17:09:48.445509] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-19T17:09:48.445599] [INFO ] [MAIN ] Update Progress: 79/2372 symbols completed. ALE took 17.8s. Estimated remaining: 4h 42m 36s. Rate: 8.1 symbols/min [2025-09-19T17:09:50.981061] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-19T17:09:50.989016] [INFO ] [REMOTE ] ALB: Full fetch complete (76755 records). [2025-09-19T17:09:50.989150] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-19T17:09:51.386852] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-19T17:09:51.386949] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-19T17:09:51.387726] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-19T17:09:51.387819] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-19T17:09:51.389446] [DEBUG] [LOCAL ] ALB: Trimmed 76755 records to 54006 (keeping 200 days of data) [2025-09-19T17:09:51.739063] [DEBUG] [LOCAL ] ALB: Primary data saved (54006 records). [2025-09-19T17:09:51.739224] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-19T17:09:51.742795] [INFO ] [MAIN ] Update Progress: 80/2372 symbols completed. ALB took 42.3s. Estimated remaining: 4h 40m 32s. Rate: 8.2 symbols/min [2025-09-19T17:09:52.372516] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:52.376557] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:52.497706] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:52.516967] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:52.544781] [DEBUG] [LOCAL ] ALG: Loaded 10773 existing records from primary storage. [2025-09-19T17:09:52.545024] [INFO ] [MAIN ] ALG: Loaded 10773 existing records. [2025-09-19T17:09:52.617345] [DEBUG] [LOCAL ] ALEX: Loaded 31856 existing records from primary storage. [2025-09-19T17:09:52.671180] [INFO ] [MAIN ] ALEX: Loaded 31856 existing records. [2025-09-19T17:09:52.909611] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:52.926901] [DEBUG] [LOCAL ] ALIT: Loaded 53112 existing records from primary storage. [2025-09-19T17:09:52.942970] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-19T17:09:52.937751] [INFO ] [MAIN ] ALIT: Loaded 53112 existing records. [2025-09-19T17:09:52.969130] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-19T17:09:52.981193] [DEBUG] [LOCAL ] ALK: Loaded 53456 existing records from primary storage. [2025-09-19T17:09:53.016331] [INFO ] [MAIN ] ALK: Loaded 53456 existing records. [2025-09-19T17:09:53.021626] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-19T17:09:53.061850] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-19T17:09:53.154531] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:53.313906] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-19T17:09:53.356039] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-19T17:09:53.452889] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-19T17:09:53.487026] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-19T17:09:53.526988] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:53.666080] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:53.733282] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-19T17:09:53.740998] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-19T17:09:53.780710] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-19T17:09:53.775457] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-19T17:09:53.840178] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-19T17:09:53.855891] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-19T17:09:53.855785] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-19T17:09:53.892501] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-19T17:09:54.366084] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:54.409140] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-19T17:09:54.752806] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:54.796826] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-19T17:09:54.975825] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:54.977402] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-19T17:09:55.014956] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:55.015382] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-19T17:09:55.828058] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:09:55.831029] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-19T17:09:56.112429] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T17:09:56.119509] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-19T17:09:56.579225] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T17:09:56.589773] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-19T17:09:57.016854] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T17:09:57.028523] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-19T17:09:57.038123] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T17:09:57.041510] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-19T17:09:57.934586] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T17:09:57.940751] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-19T17:09:58.136735] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T17:09:58.139737] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-19T17:09:58.508727] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T17:09:58.526232] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-19T17:09:58.642281] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T17:09:58.653057] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-19T17:09:58.726236] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-19T17:09:58.731547] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-19T17:09:59.022843] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T17:09:59.028610] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-19T17:10:00.016040] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:10:00.026173] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-19T17:10:00.394172] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:10:00.402308] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-19T17:10:00.414985] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T17:10:00.470511] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:10:00.643262] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-19T17:10:01.443319] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-19T17:10:02.199098] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:10:02.243281] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-19T17:10:02.339828] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-19T17:10:02.424556] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T17:10:02.495354] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T17:10:03.043281] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-19T17:10:03.266590] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T17:10:03.843272] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-19T17:10:04.643293] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-19T17:10:04.766378] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T17:10:05.171495] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T17:10:05.443266] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-19T17:10:06.243315] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-19T17:10:06.707683] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:10:06.890278] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T17:10:07.043312] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-19T17:10:07.832095] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T17:10:07.843420] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-19T17:10:08.579025] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:10:08.643260] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-19T17:10:09.227213] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:10:09.443302] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-19T17:10:10.243284] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-19T17:10:10.277901] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:10:10.283150] [INFO ] [REMOTE ] ALEX: Full fetch complete (44523 records). [2025-09-19T17:10:10.283327] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-19T17:10:10.686501] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-19T17:10:10.697848] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-19T17:10:10.698734] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-19T17:10:10.699410] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-19T17:10:10.699848] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T17:10:10.705492] [DEBUG] [LOCAL ] ALEX: Trimmed 44523 records to 32090 (keeping 200 days of data) [2025-09-19T17:10:10.916332] [DEBUG] [LOCAL ] ALEX: Primary data saved (32090 records). [2025-09-19T17:10:10.916493] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-19T17:10:10.916670] [INFO ] [MAIN ] Update Progress: 81/2372 symbols completed. ALEX took 19.2s. Estimated remaining: 4h 45m 59s. Rate: 8.0 symbols/min [2025-09-19T17:10:11.055519] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-19T17:10:11.088930] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:11.150237] [DEBUG] [LOCAL ] ALL: Loaded 50589 existing records from primary storage. [2025-09-19T17:10:11.150410] [INFO ] [MAIN ] ALL: Loaded 50589 existing records. [2025-09-19T17:10:11.331415] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:11.331928] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-19T17:10:11.331981] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-19T17:10:11.333593] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-19T17:10:11.333688] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-19T17:10:11.686638] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:11.843264] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-19T17:10:12.131519] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T17:10:12.643310] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-19T17:10:13.443268] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-19T17:10:13.848155] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T17:10:14.243268] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-19T17:10:14.407375] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (4.16 seconds). [2025-09-19T17:10:14.634822] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T17:10:15.043283] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-19T17:10:15.081807] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T17:10:15.843287] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-19T17:10:16.276604] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T17:10:16.546728] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T17:10:16.548592] [INFO ] [REMOTE ] ALG: Full fetch complete (15829 records). [2025-09-19T17:10:16.548715] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-19T17:10:16.650736] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-19T17:10:16.956062] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-19T17:10:16.956196] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-19T17:10:16.956486] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-19T17:10:16.956530] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-19T17:10:16.957130] [DEBUG] [LOCAL ] ALG: Trimmed 15829 records to 10840 (keeping 200 days of data) [2025-09-19T17:10:17.033554] [DEBUG] [LOCAL ] ALG: Primary data saved (10840 records). [2025-09-19T17:10:17.033725] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-19T17:10:17.033875] [INFO ] [MAIN ] Update Progress: 82/2372 symbols completed. ALG took 25.3s. Estimated remaining: 4h 45m 13s. Rate: 8.0 symbols/min [2025-09-19T17:10:17.226945] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:17.262073] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T17:10:17.327477] [DEBUG] [LOCAL ] ALLE: Loaded 45630 existing records from primary storage. [2025-09-19T17:10:17.327639] [INFO ] [MAIN ] ALLE: Loaded 45630 existing records. [2025-09-19T17:10:17.448475] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-19T17:10:17.530873] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:17.531123] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-19T17:10:17.531174] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-19T17:10:17.538713] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-19T17:10:17.539300] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-19T17:10:17.916166] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:18.243287] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-19T17:10:18.560387] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T17:10:19.043281] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-19T17:10:19.642084] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T17:10:19.843226] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-19T17:10:20.242674] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T17:10:20.643277] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-19T17:10:20.698220] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T17:10:20.709464] [INFO ] [REMOTE ] ALK: Full fetch complete (76789 records). [2025-09-19T17:10:20.709824] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-19T17:10:21.138139] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-19T17:10:21.138264] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-19T17:10:21.139037] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-19T17:10:21.139105] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-19T17:10:21.141551] [DEBUG] [LOCAL ] ALK: Trimmed 76789 records to 53840 (keeping 200 days of data) [2025-09-19T17:10:21.457235] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-19T17:10:21.484043] [DEBUG] [LOCAL ] ALK: Primary data saved (53840 records). [2025-09-19T17:10:21.484216] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-19T17:10:21.485576] [INFO ] [MAIN ] Update Progress: 83/2372 symbols completed. ALK took 29.7s. Estimated remaining: 4h 43m 42s. Rate: 8.1 symbols/min [2025-09-19T17:10:21.656124] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:21.717940] [DEBUG] [LOCAL ] ALLY: Loaded 53607 existing records from primary storage. [2025-09-19T17:10:21.718097] [INFO ] [MAIN ] ALLY: Loaded 53607 existing records. [2025-09-19T17:10:21.902037] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:21.902609] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-19T17:10:21.902782] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-19T17:10:21.904897] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-19T17:10:21.904970] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-19T17:10:22.048763] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T17:10:22.246584] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-19T17:10:22.333340] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:22.366628] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T17:10:23.043287] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-19T17:10:23.435237] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T17:10:23.843272] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-19T17:10:24.213108] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T17:10:24.221423] [INFO ] [REMOTE ] ALIT: Full fetch complete (76413 records). [2025-09-19T17:10:24.221676] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-19T17:10:24.650012] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-19T17:10:24.650171] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-19T17:10:24.648916] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-19T17:10:24.651078] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-19T17:10:24.651427] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-19T17:10:24.654261] [DEBUG] [LOCAL ] ALIT: Trimmed 76413 records to 53499 (keeping 200 days of data) [2025-09-19T17:10:25.005292] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T17:10:25.036134] [DEBUG] [LOCAL ] ALIT: Primary data saved (53499 records). [2025-09-19T17:10:25.036292] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-19T17:10:25.036382] [INFO ] [MAIN ] Update Progress: 84/2372 symbols completed. ALIT took 33.3s. Estimated remaining: 4h 41m 49s. Rate: 8.1 symbols/min [2025-09-19T17:10:25.216430] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:25.268739] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T17:10:25.292662] [DEBUG] [LOCAL ] ALSN: Loaded 43709 existing records from primary storage. [2025-09-19T17:10:25.292858] [INFO ] [MAIN ] ALSN: Loaded 43709 existing records. [2025-09-19T17:10:25.452717] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-19T17:10:25.484893] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:25.485158] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-19T17:10:25.485210] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-19T17:10:25.486485] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-19T17:10:25.486559] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-19T17:10:25.853150] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:26.243281] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-19T17:10:26.767954] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T17:10:27.001413] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T17:10:27.043247] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-19T17:10:27.843334] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-19T17:10:28.285057] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T17:10:28.643300] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-19T17:10:29.013525] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T17:10:29.443258] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-19T17:10:29.843205] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T17:10:30.243281] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-19T17:10:31.043328] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-19T17:10:31.375128] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:10:31.843264] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-19T17:10:32.048885] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:10:32.643291] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-19T17:10:33.082123] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:10:33.443684] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-19T17:10:33.449754] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T17:10:34.243255] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-19T17:10:34.931133] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-19T17:10:35.043273] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-19T17:10:35.405097] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T17:10:35.848589] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-19T17:10:35.873705] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T17:10:36.232303] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:10:36.531070] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (8.69 seconds). [2025-09-19T17:10:36.643268] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-19T17:10:37.443289] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-19T17:10:37.882095] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:10:38.243299] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-19T17:10:38.630189] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T17:10:39.024222] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:10:39.043209] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-19T17:10:39.709424] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:10:39.843259] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-19T17:10:40.643312] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-19T17:10:41.124382] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T17:10:41.443265] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-19T17:10:41.875814] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T17:10:42.243263] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-19T17:10:42.491837] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T17:10:43.043330] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-19T17:10:43.106847] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T17:10:43.843320] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-19T17:10:44.046369] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T17:10:44.643284] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-19T17:10:45.250633] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T17:10:45.426998] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T17:10:45.443223] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-19T17:10:46.000523] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T17:10:46.243264] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-19T17:10:47.043279] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-19T17:10:47.544766] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T17:10:47.553457] [INFO ] [REMOTE ] ALL: Full fetch complete (72491 records). [2025-09-19T17:10:47.553631] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-19T17:10:47.844588] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-19T17:10:47.976365] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-19T17:10:47.976477] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-19T17:10:47.977425] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-19T17:10:47.977517] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-19T17:10:47.979694] [DEBUG] [LOCAL ] ALL: Trimmed 72491 records to 50961 (keeping 200 days of data) [2025-09-19T17:10:48.171371] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T17:10:48.424453] [DEBUG] [LOCAL ] ALL: Primary data saved (50961 records). [2025-09-19T17:10:48.424614] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-19T17:10:48.426536] [INFO ] [MAIN ] Update Progress: 85/2372 symbols completed. ALL took 37.5s. Estimated remaining: 4h 48m 52s. Rate: 7.9 symbols/min [2025-09-19T17:10:48.605300] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:48.630577] [DEBUG] [LOCAL ] ALTG: Loaded 24477 existing records from primary storage. [2025-09-19T17:10:48.630746] [INFO ] [MAIN ] ALTG: Loaded 24477 existing records. [2025-09-19T17:10:48.664279] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-19T17:10:48.823537] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:48.824021] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-19T17:10:48.824179] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-19T17:10:48.825116] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-19T17:10:48.825178] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-19T17:10:49.222575] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:49.251837] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T17:10:49.443276] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-19T17:10:49.842880] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T17:10:49.850188] [INFO ] [REMOTE ] ALSN: Full fetch complete (61967 records). [2025-09-19T17:10:49.850329] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-19T17:10:50.250748] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-19T17:10:50.252451] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-19T17:10:50.252544] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-19T17:10:50.253168] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-19T17:10:50.253303] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-19T17:10:50.254723] [DEBUG] [LOCAL ] ALSN: Trimmed 61967 records to 44026 (keeping 200 days of data) [2025-09-19T17:10:50.496611] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:10:50.541432] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T17:10:50.551426] [INFO ] [REMOTE ] ALLY: Full fetch complete (76869 records). [2025-09-19T17:10:50.552396] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-19T17:10:50.711236] [DEBUG] [LOCAL ] ALSN: Primary data saved (44026 records). [2025-09-19T17:10:50.730181] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-19T17:10:50.740552] [INFO ] [MAIN ] Update Progress: 86/2372 symbols completed. ALSN took 25.7s. Estimated remaining: 4h 46m 25s. Rate: 8.0 symbols/min [2025-09-19T17:10:51.058415] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-19T17:10:51.159429] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:51.186524] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-19T17:10:51.186756] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-19T17:10:51.188799] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-19T17:10:51.189497] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-19T17:10:51.191479] [DEBUG] [LOCAL ] ALLY: Trimmed 76869 records to 53994 (keeping 200 days of data) [2025-09-19T17:10:51.295078] [DEBUG] [LOCAL ] ALUR: Loaded 11174 existing records from primary storage. [2025-09-19T17:10:51.295719] [INFO ] [MAIN ] ALUR: Loaded 11174 existing records. [2025-09-19T17:10:51.499962] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:51.506561] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-19T17:10:51.507696] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-19T17:10:51.512871] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-19T17:10:51.513214] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-19T17:10:52.030557] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:52.031376] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-19T17:10:52.132020] [DEBUG] [LOCAL ] ALLY: Primary data saved (53994 records). [2025-09-19T17:10:52.132162] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-19T17:10:52.132313] [INFO ] [MAIN ] Update Progress: 87/2372 symbols completed. ALLY took 30.6s. Estimated remaining: 4h 43m 36s. Rate: 8.1 symbols/min [2025-09-19T17:10:52.304936] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:52.330227] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T17:10:52.384698] [DEBUG] [LOCAL ] ALV: Loaded 43233 existing records from primary storage. [2025-09-19T17:10:52.384886] [INFO ] [MAIN ] ALV: Loaded 43233 existing records. [2025-09-19T17:10:52.569706] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:52.570217] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-19T17:10:52.570441] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-19T17:10:52.580395] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-19T17:10:52.581039] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-19T17:10:52.581355] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:10:52.645145] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-19T17:10:52.957482] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:53.443277] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-19T17:10:53.757829] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T17:10:54.125333] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:10:54.132178] [INFO ] [REMOTE ] ALLE: Full fetch complete (65139 records). [2025-09-19T17:10:54.132374] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-19T17:10:54.248497] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-19T17:10:54.558715] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-19T17:10:54.558805] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-19T17:10:54.559421] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-19T17:10:54.559467] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-19T17:10:54.561044] [DEBUG] [LOCAL ] ALLE: Trimmed 65139 records to 46000 (keeping 200 days of data) [2025-09-19T17:10:54.828424] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T17:10:54.891248] [DEBUG] [LOCAL ] ALLE: Primary data saved (46000 records). [2025-09-19T17:10:54.891415] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-19T17:10:54.891518] [INFO ] [MAIN ] Update Progress: 88/2372 symbols completed. ALLE took 37.9s. Estimated remaining: 4h 41m 27s. Rate: 8.1 symbols/min [2025-09-19T17:10:55.048627] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-19T17:10:55.066196] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:55.075329] [DEBUG] [LOCAL ] ALX: Loaded 5828 existing records from primary storage. [2025-09-19T17:10:55.075446] [INFO ] [MAIN ] ALX: Loaded 5828 existing records. [2025-09-19T17:10:55.254712] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:55.254987] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-19T17:10:55.255036] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-19T17:10:55.255468] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-19T17:10:55.255528] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-19T17:10:55.630317] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:55.770509] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T17:10:55.843279] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-19T17:10:56.540572] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T17:10:56.643264] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-19T17:10:56.697182] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T17:10:57.443263] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-19T17:10:58.049138] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T17:10:58.243272] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-19T17:10:58.387523] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T17:10:59.043279] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-19T17:10:59.618813] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T17:10:59.843269] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-19T17:11:00.353241] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T17:11:00.643272] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-19T17:11:01.177769] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T17:11:01.323004] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T17:11:01.443277] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-19T17:11:02.151413] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T17:11:02.243266] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-19T17:11:02.836733] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-19T17:11:03.043278] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-19T17:11:03.843282] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-19T17:11:04.395857] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:11:04.643307] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-19T17:11:05.443283] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-19T17:11:05.704131] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T17:11:05.976574] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-19T17:11:06.019958] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:11:06.243313] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-19T17:11:07.043226] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-19T17:11:07.275487] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T17:11:07.843283] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-19T17:11:08.643278] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-19T17:11:08.998572] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:11:09.070468] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T17:11:09.443315] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-19T17:11:09.605225] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T17:11:10.243268] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-19T17:11:10.616960] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T17:11:11.043274] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-19T17:11:11.730733] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T17:11:11.843293] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-19T17:11:12.136233] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T17:11:12.643305] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-19T17:11:12.867092] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T17:11:13.443286] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-19T17:11:14.117776] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:11:14.121883] [INFO ] [REMOTE ] ALTG: Full fetch complete (33619 records). [2025-09-19T17:11:14.121979] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-19T17:11:14.248412] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-19T17:11:14.537467] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-19T17:11:14.537622] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-19T17:11:14.538375] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-19T17:11:14.538456] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-19T17:11:14.540022] [DEBUG] [LOCAL ] ALTG: Trimmed 33619 records to 24604 (keeping 200 days of data) [2025-09-19T17:11:14.592616] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T17:11:14.603975] [INFO ] [REMOTE ] ALX: Full fetch complete (6714 records). [2025-09-19T17:11:14.630981] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-19T17:11:14.984701] [DEBUG] [LOCAL ] ALTG: Primary data saved (24604 records). [2025-09-19T17:11:14.990542] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-19T17:11:14.995876] [INFO ] [MAIN ] Update Progress: 89/2372 symbols completed. ALTG took 26.6s. Estimated remaining: 4h 46m 46s. Rate: 8.0 symbols/min [2025-09-19T17:11:15.048446] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-19T17:11:15.178349] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-19T17:11:15.181851] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-19T17:11:15.182213] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-19T17:11:15.188078] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-19T17:11:15.209344] [DEBUG] [LOCAL ] ALX: Trimmed 6714 records to 5880 (keeping 200 days of data) [2025-09-19T17:11:15.291394] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:15.294914] [DEBUG] [LOCAL ] ALX: Primary data saved (5880 records). [2025-09-19T17:11:15.295508] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-19T17:11:15.295612] [INFO ] [MAIN ] Update Progress: 90/2372 symbols completed. ALX took 20.4s. Estimated remaining: 4h 43m 35s. Rate: 8.0 symbols/min [2025-09-19T17:11:15.472123] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:15.515312] [DEBUG] [LOCAL ] AM: Loaded 52557 existing records from primary storage. [2025-09-19T17:11:15.515598] [INFO ] [MAIN ] AM: Loaded 52557 existing records. [2025-09-19T17:11:15.666821] [DEBUG] [LOCAL ] AMBC: Loaded 37906 existing records from primary storage. [2025-09-19T17:11:15.691470] [INFO ] [MAIN ] AMBC: Loaded 37906 existing records. [2025-09-19T17:11:15.753801] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:15.790865] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-19T17:11:15.816869] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-19T17:11:15.840074] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-19T17:11:15.840348] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-19T17:11:16.001059] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:16.053827] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-19T17:11:16.059917] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-19T17:11:16.102974] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-19T17:11:16.109010] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-19T17:11:16.527986] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:16.564546] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-19T17:11:16.576571] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T17:11:16.649740] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-19T17:11:16.771723] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:16.792613] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T17:11:17.443272] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-19T17:11:18.243356] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-19T17:11:18.446159] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T17:11:18.558916] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T17:11:18.820716] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-19T17:11:18.862442] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T17:11:19.043272] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-19T17:11:19.843299] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-19T17:11:20.145237] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T17:11:20.643325] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-19T17:11:21.443372] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-19T17:11:21.796389] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:11:22.160294] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T17:11:22.243402] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-19T17:11:22.674489] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T17:11:23.043310] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-19T17:11:23.843294] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-19T17:11:24.241495] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:11:24.643333] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-19T17:11:24.962944] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T17:11:25.074378] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:11:25.443260] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-19T17:11:25.578588] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T17:11:26.243271] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-19T17:11:27.043275] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-19T17:11:27.150637] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T17:11:27.843250] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-19T17:11:27.968861] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T17:11:27.970298] [INFO ] [REMOTE ] ALUR: Full fetch complete (21460 records). [2025-09-19T17:11:27.970374] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-19T17:11:28.358385] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-19T17:11:28.358464] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-19T17:11:28.358797] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-19T17:11:28.358859] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-19T17:11:28.359427] [DEBUG] [LOCAL ] ALUR: Trimmed 21460 records to 11223 (keeping 200 days of data) [2025-09-19T17:11:28.422589] [DEBUG] [LOCAL ] ALUR: Primary data saved (11223 records). [2025-09-19T17:11:28.422751] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-19T17:11:28.422847] [INFO ] [MAIN ] Update Progress: 91/2372 symbols completed. ALUR took 37.7s. Estimated remaining: 4h 45m 49s. Rate: 8.0 symbols/min [2025-09-19T17:11:28.609273] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:28.644388] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-19T17:11:28.644300] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-19T17:11:28.694329] [DEBUG] [LOCAL ] AMBP: Loaded 45660 existing records from primary storage. [2025-09-19T17:11:28.694468] [INFO ] [MAIN ] AMBP: Loaded 45660 existing records. [2025-09-19T17:11:28.873560] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:28.873825] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-19T17:11:28.873876] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-19T17:11:28.875290] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-19T17:11:28.875354] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-19T17:11:29.234362] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:29.443337] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-19T17:11:29.679060] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T17:11:30.243266] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-19T17:11:30.496450] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T17:11:31.043291] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-19T17:11:31.372848] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T17:11:31.851396] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-19T17:11:31.870614] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:11:32.048701] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T17:11:32.643284] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-19T17:11:33.443259] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-19T17:11:33.709908] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T17:11:33.716088] [INFO ] [REMOTE ] ALV: Full fetch complete (61919 records). [2025-09-19T17:11:33.716228] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-19T17:11:34.108315] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-19T17:11:34.108400] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-19T17:11:34.109249] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-19T17:11:34.109319] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-19T17:11:34.110681] [DEBUG] [LOCAL ] ALV: Trimmed 61919 records to 43481 (keeping 200 days of data) [2025-09-19T17:11:34.294446] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-19T17:11:34.392146] [DEBUG] [LOCAL ] ALV: Primary data saved (43481 records). [2025-09-19T17:11:34.392338] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-19T17:11:34.392981] [INFO ] [MAIN ] Update Progress: 92/2372 symbols completed. ALV took 42.3s. Estimated remaining: 4h 45m 3s. Rate: 8.0 symbols/min [2025-09-19T17:11:34.575549] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:34.576003] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-19T17:11:34.576115] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-19T17:11:34.576388] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-19T17:11:34.576437] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-19T17:11:34.576480] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-19T17:11:34.576513] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-19T17:11:34.952494] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T17:11:35.027328] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:35.056666] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-19T17:11:35.060798] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T17:11:35.345098] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T17:11:35.843275] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-19T17:11:36.643284] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-19T17:11:37.138730] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T17:11:37.443276] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-19T17:11:37.545390] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T17:11:37.681454] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:37.687709] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T17:11:37.687910] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-19T17:11:38.243325] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-19T17:11:39.043325] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-19T17:11:39.843274] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-19T17:11:40.143132] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T17:11:40.253287] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T17:11:40.258162] [INFO ] [REMOTE ] AMBC: Full fetch complete (51070 records). [2025-09-19T17:11:40.258291] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-19T17:11:40.631874] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-19T17:11:40.631958] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-19T17:11:40.632477] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-19T17:11:40.632538] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-19T17:11:40.633608] [DEBUG] [LOCAL ] AMBC: Trimmed 51070 records to 38086 (keeping 200 days of data) [2025-09-19T17:11:40.680937] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-19T17:11:40.845161] [DEBUG] [LOCAL ] AMBC: Primary data saved (38086 records). [2025-09-19T17:11:40.845301] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-19T17:11:40.845382] [INFO ] [MAIN ] Update Progress: 93/2372 symbols completed. AMBC took 25.5s. Estimated remaining: 4h 44m 30s. Rate: 8.0 symbols/min [2025-09-19T17:11:41.012903] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:41.066020] [DEBUG] [LOCAL ] AMC: Loaded 54147 existing records from primary storage. [2025-09-19T17:11:41.066164] [INFO ] [MAIN ] AMC: Loaded 54147 existing records. [2025-09-19T17:11:41.239623] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:41.239918] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-19T17:11:41.239965] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-19T17:11:41.241483] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-19T17:11:41.241543] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-19T17:11:41.472732] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-19T17:11:41.619582] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:41.690063] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:11:41.754049] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:41.754315] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-19T17:11:42.243260] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-19T17:11:42.856318] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:11:43.043270] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-19T17:11:43.709825] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T17:11:43.843256] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-19T17:11:44.082237] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:44.082619] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-19T17:11:44.643270] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-19T17:11:44.978753] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T17:11:45.443266] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-19T17:11:46.243273] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-19T17:11:46.491491] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:46.491849] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-19T17:11:47.043306] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-19T17:11:47.164330] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-19T17:11:47.321510] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T17:11:47.843270] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-19T17:11:48.643331] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-19T17:11:48.884529] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:48.884933] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-19T17:11:49.000345] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T17:11:49.008594] [INFO ] [REMOTE ] AM: Full fetch complete (75627 records). [2025-09-19T17:11:49.008842] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-19T17:11:49.450797] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-19T17:11:49.454625] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-19T17:11:49.454747] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-19T17:11:49.456492] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-19T17:11:49.456581] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-19T17:11:49.458251] [DEBUG] [LOCAL ] AM: Trimmed 75627 records to 52944 (keeping 200 days of data) [2025-09-19T17:11:49.769466] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:49.793566] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-19T17:11:49.817862] [DEBUG] [LOCAL ] AM: Primary data saved (52944 records). [2025-09-19T17:11:49.818022] [INFO ] [MAIN ] AM: Full history saved. [2025-09-19T17:11:49.818111] [INFO ] [MAIN ] Update Progress: 94/2372 symbols completed. AM took 34.8s. Estimated remaining: 4h 44m 59s. Rate: 8.0 symbols/min [2025-09-19T17:11:49.984842] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:50.039133] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-09-19T17:11:50.039381] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-09-19T17:11:50.247686] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-19T17:11:50.277371] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:50.279567] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-19T17:11:50.290488] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-19T17:11:50.290883] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-19T17:11:50.294482] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-19T17:11:50.294568] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-19T17:11:50.689528] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:51.043272] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-19T17:11:51.272786] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:51.273106] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-19T17:11:51.843281] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-19T17:11:52.075257] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T17:11:52.643260] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-19T17:11:53.443297] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-19T17:11:54.243295] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-19T17:11:54.352030] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-19T17:11:54.382811] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T17:11:54.398025] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:11:55.043257] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-19T17:11:55.843278] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-19T17:11:56.036548] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T17:11:56.643262] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-19T17:11:56.945261] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T17:11:57.103777] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:11:57.443275] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-19T17:11:58.243294] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-19T17:11:58.894032] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T17:11:59.043268] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-19T17:11:59.702630] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:11:59.706698] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7476 records). [2025-09-19T17:11:59.706773] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-19T17:11:59.848464] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-19T17:11:59.893000] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 37 unique days, need 200 days [2025-09-19T17:11:59.893239] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:11:59.893309] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:11:59.893381] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-19T17:11:59.893461] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-19T17:11:59.893518] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-19T17:11:59.893563] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-19T17:11:59.893624] [INFO ] [MAIN ] Update Progress: 95/2372 symbols completed. AMBQ took 25.5s. Estimated remaining: 4h 45m 53s. Rate: 8.0 symbols/min [2025-09-19T17:12:00.067049] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:00.130754] [DEBUG] [LOCAL ] AME: Loaded 48968 existing records from primary storage. [2025-09-19T17:12:00.130920] [INFO ] [MAIN ] AME: Loaded 48968 existing records. [2025-09-19T17:12:00.318283] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:00.334452] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-19T17:12:00.347092] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-19T17:12:00.348820] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-09-19T17:12:00.349021] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-19T17:12:00.359838] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-19T17:12:00.650433] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-19T17:12:00.733204] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:00.849104] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T17:12:00.855476] [INFO ] [REMOTE ] AMBP: Full fetch complete (66090 records). [2025-09-19T17:12:00.855602] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-19T17:12:01.237781] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-19T17:12:01.237867] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-19T17:12:01.238503] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-19T17:12:01.238544] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-19T17:12:01.239905] [DEBUG] [LOCAL ] AMBP: Trimmed 66090 records to 46014 (keeping 200 days of data) [2025-09-19T17:12:01.452004] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-19T17:12:01.508502] [DEBUG] [LOCAL ] AMBP: Primary data saved (46014 records). [2025-09-19T17:12:01.508688] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-19T17:12:01.508820] [INFO ] [MAIN ] Update Progress: 96/2372 symbols completed. AMBP took 33.1s. Estimated remaining: 4h 43m 25s. Rate: 8.0 symbols/min [2025-09-19T17:12:01.687371] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:01.710337] [DEBUG] [LOCAL ] AMG: Loaded 21044 existing records from primary storage. [2025-09-19T17:12:01.710487] [INFO ] [MAIN ] AMG: Loaded 21044 existing records. [2025-09-19T17:12:01.879875] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:12:01.951784] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:01.952035] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-19T17:12:01.952083] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-19T17:12:01.952975] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-19T17:12:01.953065] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-19T17:12:02.248461] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-19T17:12:02.320264] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:03.043323] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-19T17:12:03.870247] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (3.22 seconds). [2025-09-19T17:12:03.881932] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-19T17:12:04.700318] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T17:12:04.705174] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-19T17:12:05.812956] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:12:05.817751] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-19T17:12:05.869675] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (3.62 seconds). [2025-09-19T17:12:05.963952] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (4.51 seconds). [2025-09-19T17:12:06.243300] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-19T17:12:07.051177] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-19T17:12:07.058346] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-09-19T17:12:07.198272] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T17:12:07.848879] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-19T17:12:07.852210] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T17:12:08.556236] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T17:12:08.643319] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-19T17:12:09.368444] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:12:09.443280] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-19T17:12:10.243333] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-19T17:12:11.043334] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-19T17:12:11.231055] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:12:11.320894] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-19T17:12:11.843272] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-19T17:12:12.518288] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T17:12:12.643279] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-19T17:12:13.443347] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-19T17:12:14.370996] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (3.33 seconds). [2025-09-19T17:12:14.385109] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-19T17:12:15.115579] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (3.27 seconds). [2025-09-19T17:12:15.128936] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-19T17:12:15.221126] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-19T17:12:15.565462] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T17:12:15.843285] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-19T17:12:16.104224] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T17:12:16.643288] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-19T17:12:17.420039] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T17:12:17.443212] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-19T17:12:17.702063] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-19T17:12:18.243272] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-19T17:12:18.763957] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T17:12:18.814424] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T17:12:19.043270] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-19T17:12:19.843273] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-19T17:12:20.014791] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T17:12:20.235889] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T17:12:20.643283] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-19T17:12:21.443280] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-19T17:12:22.071601] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T17:12:22.079874] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-19T17:12:22.080094] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-19T17:12:22.245909] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-19T17:12:22.522772] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-19T17:12:22.523034] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-19T17:12:22.523853] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-19T17:12:22.523961] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-19T17:12:22.528014] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54537 (keeping 200 days of data) [2025-09-19T17:12:22.673215] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:12:22.881714] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:12:22.887336] [INFO ] [REMOTE ] AMG: Full fetch complete (29594 records). [2025-09-19T17:12:22.888234] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-19T17:12:22.889677] [FATAL] [VALIDATOR ] AMG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:12:22.890237] [FATAL] [MAIN ] AMG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:12:22.890795] [WARN ] [MAIN ] AMG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:12:22.892073] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-19T17:12:22.892572] [DEBUG] [LOCAL ] AMG: No primary data file found to delete. [2025-09-19T17:12:22.893111] [INFO ] [LOCAL ] AMG: Starting deletion of derivative data. [2025-09-19T17:12:22.894002] [DEBUG] [LOCAL ] AMG: Deleted derivative data file. [2025-09-19T17:12:22.894563] [INFO ] [MAIN ] Update Progress: 97/2372 symbols completed. AMG took 21.4s. Estimated remaining: 4h 48m 44s. Rate: 7.9 symbols/min [2025-09-19T17:12:23.045757] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-19T17:12:23.116268] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:23.127579] [DEBUG] [LOCAL ] AMC: Primary data saved (54537 records). [2025-09-19T17:12:23.127748] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-19T17:12:23.127864] [INFO ] [MAIN ] Update Progress: 98/2372 symbols completed. AMC took 42.3s. Estimated remaining: 4h 45m 45s. Rate: 8.0 symbols/min [2025-09-19T17:12:23.311544] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:23.346129] [DEBUG] [LOCAL ] AMH: Loaded 52077 existing records from primary storage. [2025-09-19T17:12:23.346359] [INFO ] [MAIN ] AMH: Loaded 52077 existing records. [2025-09-19T17:12:23.573517] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:23.573380] [DEBUG] [LOCAL ] AMN: Loaded 42501 existing records from primary storage. [2025-09-19T17:12:23.573853] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-19T17:12:23.573938] [INFO ] [MAIN ] AMN: Loaded 42501 existing records. [2025-09-19T17:12:23.574008] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-19T17:12:23.668032] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-19T17:12:23.679478] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-19T17:12:23.896958] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:23.912616] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-19T17:12:23.933406] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-19T17:12:23.953868] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-19T17:12:23.981033] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-19T17:12:24.345986] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:24.381491] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-19T17:12:24.556999] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:24.590171] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T17:12:24.643222] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-19T17:12:25.298132] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T17:12:25.443255] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-19T17:12:25.977202] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T17:12:26.243290] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-19T17:12:27.008516] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T17:12:27.016940] [INFO ] [REMOTE ] AMCR: Full fetch complete (77678 records). [2025-09-19T17:12:27.017126] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-19T17:12:27.050594] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-19T17:12:27.428514] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-19T17:12:27.428626] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-19T17:12:27.429421] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-19T17:12:27.429570] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-19T17:12:27.431345] [DEBUG] [LOCAL ] AMCR: Trimmed 77678 records to 54449 (keeping 200 days of data) [2025-09-19T17:12:27.541623] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T17:12:27.795763] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-09-19T17:12:27.795986] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-19T17:12:27.796155] [INFO ] [MAIN ] Update Progress: 99/2372 symbols completed. AMCR took 38.0s. Estimated remaining: 4h 44m 31s. Rate: 8.0 symbols/min [2025-09-19T17:12:27.863586] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-19T17:12:27.974432] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:28.013178] [DEBUG] [LOCAL ] AMP: Loaded 33159 existing records from primary storage. [2025-09-19T17:12:28.013341] [INFO ] [MAIN ] AMP: Loaded 33159 existing records. [2025-09-19T17:12:28.191936] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:28.192180] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-19T17:12:28.192258] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-19T17:12:28.193710] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-19T17:12:28.193773] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-19T17:12:28.571785] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:28.599924] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-19T17:12:28.643213] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-19T17:12:29.010349] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T17:12:29.443294] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-19T17:12:29.618080] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T17:12:30.025073] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T17:12:30.243289] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-19T17:12:31.043274] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-19T17:12:31.343667] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T17:12:31.452030] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T17:12:31.843263] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-19T17:12:32.643304] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-19T17:12:33.092051] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T17:12:33.223057] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T17:12:33.443296] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-19T17:12:33.906586] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T17:12:34.243304] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-19T17:12:35.043327] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-19T17:12:35.382825] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T17:12:35.843251] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-19T17:12:35.877476] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-19T17:12:35.885111] [INFO ] [REMOTE ] AME: Full fetch complete (69624 records). [2025-09-19T17:12:35.885281] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-19T17:12:36.288295] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-19T17:12:36.288479] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-19T17:12:36.289348] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-19T17:12:36.289602] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-19T17:12:36.291849] [DEBUG] [LOCAL ] AME: Trimmed 69624 records to 49312 (keeping 200 days of data) [2025-09-19T17:12:36.324129] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:12:36.643076] [DEBUG] [LOCAL ] AME: Primary data saved (49312 records). [2025-09-19T17:12:36.643212] [INFO ] [MAIN ] AME: Full history saved. [2025-09-19T17:12:36.643270] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-19T17:12:36.645124] [INFO ] [MAIN ] Update Progress: 100/2372 symbols completed. AME took 36.8s. Estimated remaining: 4h 44m 54s. Rate: 8.0 symbols/min [2025-09-19T17:12:36.818566] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:36.876414] [DEBUG] [LOCAL ] AMPX: Loaded 52458 existing records from primary storage. [2025-09-19T17:12:36.876565] [INFO ] [MAIN ] AMPX: Loaded 52458 existing records. [2025-09-19T17:12:37.052271] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:37.052512] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-19T17:12:37.052565] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-19T17:12:37.053784] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-19T17:12:37.053845] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-19T17:12:37.409434] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:37.443229] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-19T17:12:37.726322] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:12:38.243291] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-19T17:12:38.655602] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:12:39.043528] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-19T17:12:39.315078] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T17:12:39.628635] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T17:12:39.843281] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-19T17:12:40.643270] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-19T17:12:41.073574] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:12:41.191233] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:12:41.443284] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-19T17:12:42.243289] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-19T17:12:42.681166] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T17:12:43.043323] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-19T17:12:43.149823] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T17:12:43.570802] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T17:12:43.843281] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-19T17:12:44.643257] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-19T17:12:44.763899] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:12:45.443276] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-19T17:12:45.748010] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T17:12:45.880975] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:12:46.243270] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-19T17:12:47.043328] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-19T17:12:47.082879] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:12:47.843269] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-19T17:12:48.162392] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T17:12:48.643250] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-19T17:12:49.154816] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T17:12:49.224117] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:12:49.443259] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-19T17:12:50.243274] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-19T17:12:50.525151] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T17:12:51.043302] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-19T17:12:51.419631] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T17:12:51.843267] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-19T17:12:52.062673] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:12:52.643338] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-19T17:12:52.954256] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T17:12:52.960824] [INFO ] [REMOTE ] AMN: Full fetch complete (60525 records). [2025-09-19T17:12:52.960944] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-19T17:12:53.443355] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-19T17:12:53.443239] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-19T17:12:53.444567] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-19T17:12:53.445225] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-19T17:12:53.445307] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-19T17:12:53.453992] [DEBUG] [LOCAL ] AMN: Trimmed 60525 records to 42768 (keeping 200 days of data) [2025-09-19T17:12:53.467931] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T17:12:53.533818] [INFO ] [REMOTE ] AMH: Full fetch complete (74655 records). [2025-09-19T17:12:53.561442] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-19T17:12:54.064188] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-19T17:12:54.064855] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-19T17:12:54.066738] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-19T17:12:54.067114] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-19T17:12:54.071365] [DEBUG] [LOCAL ] AMH: Trimmed 74655 records to 52456 (keeping 200 days of data) [2025-09-19T17:12:54.445301] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:12:54.464681] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-19T17:12:54.508711] [DEBUG] [LOCAL ] AMN: Primary data saved (42768 records). [2025-09-19T17:12:54.510458] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-19T17:12:54.510867] [INFO ] [MAIN ] Update Progress: 101/2372 symbols completed. AMN took 31.4s. Estimated remaining: 4h 48m 39s. Rate: 7.9 symbols/min [2025-09-19T17:12:54.736449] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:54.818613] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T17:12:54.863135] [DEBUG] [LOCAL ] AMPY: Loaded 37679 existing records from primary storage. [2025-09-19T17:12:54.862502] [DEBUG] [LOCAL ] AMH: Primary data saved (52456 records). [2025-09-19T17:12:54.863281] [INFO ] [MAIN ] AMPY: Loaded 37679 existing records. [2025-09-19T17:12:54.863380] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-19T17:12:54.895829] [INFO ] [MAIN ] Update Progress: 102/2372 symbols completed. AMH took 32.0s. Estimated remaining: 4h 45m 51s. Rate: 7.9 symbols/min [2025-09-19T17:12:55.044631] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-19T17:12:55.197466] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:55.211038] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-19T17:12:55.212578] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-19T17:12:55.229975] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:55.230750] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-19T17:12:55.230815] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-19T17:12:55.546904] [DEBUG] [LOCAL ] AMR: Loaded 29544 existing records from primary storage. [2025-09-19T17:12:55.557979] [INFO ] [MAIN ] AMR: Loaded 29544 existing records. [2025-09-19T17:12:55.728753] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:55.808605] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:55.808858] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-19T17:12:55.808922] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-19T17:12:55.809776] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-19T17:12:55.809839] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-19T17:12:55.852083] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-19T17:12:56.169234] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:56.208771] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T17:12:56.643264] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-19T17:12:56.824203] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T17:12:56.829487] [INFO ] [REMOTE ] AMP: Full fetch complete (47622 records). [2025-09-19T17:12:56.829603] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-19T17:12:57.222148] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T17:12:57.245502] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-19T17:12:57.245584] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-19T17:12:57.246143] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-19T17:12:57.246206] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-19T17:12:57.250529] [DEBUG] [LOCAL ] AMP: Trimmed 47622 records to 33358 (keeping 200 days of data) [2025-09-19T17:12:57.445698] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-19T17:12:57.467807] [DEBUG] [LOCAL ] AMP: Primary data saved (33358 records). [2025-09-19T17:12:57.467911] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-19T17:12:57.467992] [INFO ] [MAIN ] Update Progress: 103/2372 symbols completed. AMP took 29.7s. Estimated remaining: 4h 43m 53s. Rate: 8.0 symbols/min [2025-09-19T17:12:57.637900] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:57.679685] [DEBUG] [LOCAL ] AMRC: Loaded 39026 existing records from primary storage. [2025-09-19T17:12:57.679835] [INFO ] [MAIN ] AMRC: Loaded 39026 existing records. [2025-09-19T17:12:57.859328] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:57.859707] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-19T17:12:57.859763] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-19T17:12:57.861113] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-19T17:12:57.861174] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-19T17:12:58.180717] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T17:12:58.245150] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-19T17:12:58.267263] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:59.026020] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T17:12:59.043214] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-19T17:12:59.548557] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T17:12:59.843260] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-19T17:13:00.008498] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T17:13:00.643263] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-19T17:13:01.443281] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-19T17:13:01.643740] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-19T17:13:02.012078] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T17:13:02.243311] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-19T17:13:02.504234] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T17:13:03.043272] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-19T17:13:03.843289] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-19T17:13:04.643332] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-19T17:13:04.802488] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T17:13:05.072019] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-19T17:13:05.182082] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T17:13:05.443290] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-19T17:13:05.884587] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T17:13:06.243289] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-19T17:13:07.043280] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-19T17:13:07.408772] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T17:13:07.446980] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T17:13:07.843279] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-19T17:13:07.993019] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T17:13:08.643307] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-19T17:13:09.443289] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-19T17:13:09.651683] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T17:13:10.243253] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-19T17:13:10.394435] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T17:13:11.051835] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-19T17:13:11.056927] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T17:13:11.843287] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-19T17:13:12.319514] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T17:13:12.468522] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T17:13:12.478569] [INFO ] [REMOTE ] AMPX: Full fetch complete (74494 records). [2025-09-19T17:13:12.478781] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-19T17:13:12.667696] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-19T17:13:12.890592] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-19T17:13:12.890724] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-19T17:13:12.891456] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-19T17:13:12.891507] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-19T17:13:12.893226] [DEBUG] [LOCAL ] AMPX: Trimmed 74494 records to 52848 (keeping 200 days of data) [2025-09-19T17:13:13.017131] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:13:13.230360] [DEBUG] [LOCAL ] AMPX: Primary data saved (52848 records). [2025-09-19T17:13:13.230505] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-19T17:13:13.231479] [INFO ] [MAIN ] Update Progress: 104/2372 symbols completed. AMPX took 36.6s. Estimated remaining: 4h 46m 46s. Rate: 7.9 symbols/min [2025-09-19T17:13:13.406750] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:13.406991] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-19T17:13:13.407046] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-19T17:13:13.407195] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-19T17:13:13.407247] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-19T17:13:13.407314] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-19T17:13:13.407357] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-19T17:13:13.449379] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-19T17:13:13.765447] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:13.861234] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T17:13:14.243285] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-19T17:13:14.606932] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T17:13:15.043304] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-19T17:13:15.329170] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:15.329516] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-19T17:13:15.533821] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T17:13:15.843302] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-19T17:13:16.643267] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-19T17:13:17.443306] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-19T17:13:17.484968] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T17:13:17.715287] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:17.715601] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-19T17:13:17.925618] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:13:18.243275] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-19T17:13:19.043283] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-19T17:13:19.329536] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:19.329904] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-19T17:13:19.843263] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-19T17:13:20.072985] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:20.073410] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-19T17:13:20.075707] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T17:13:20.643277] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-19T17:13:21.443279] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-19T17:13:22.243295] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-19T17:13:22.424371] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T17:13:22.469145] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:22.469561] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-19T17:13:22.560660] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T17:13:22.565609] [INFO ] [REMOTE ] AMPY: Full fetch complete (50087 records). [2025-09-19T17:13:22.565736] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-19T17:13:22.954541] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-19T17:13:22.954624] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-19T17:13:22.955193] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-19T17:13:22.955246] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-19T17:13:22.956411] [DEBUG] [LOCAL ] AMPY: Trimmed 50087 records to 37926 (keeping 200 days of data) [2025-09-19T17:13:23.044718] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-19T17:13:23.169167] [DEBUG] [LOCAL ] AMPY: Primary data saved (37926 records). [2025-09-19T17:13:23.169318] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-19T17:13:23.169418] [INFO ] [MAIN ] Update Progress: 105/2372 symbols completed. AMPY took 28.7s. Estimated remaining: 4h 47m 29s. Rate: 7.9 symbols/min [2025-09-19T17:13:23.340454] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:23.398936] [DEBUG] [LOCAL ] AMT: Loaded 52847 existing records from primary storage. [2025-09-19T17:13:23.399084] [INFO ] [MAIN ] AMT: Loaded 52847 existing records. [2025-09-19T17:13:23.650158] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:23.650521] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-19T17:13:23.650586] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-19T17:13:23.652403] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-19T17:13:23.652474] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-19T17:13:23.855044] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-19T17:13:24.068269] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:24.643304] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-19T17:13:24.835483] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T17:13:24.840582] [INFO ] [REMOTE ] AMR: Full fetch complete (39435 records). [2025-09-19T17:13:24.840748] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-19T17:13:24.912957] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:24.946912] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-19T17:13:25.231922] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-19T17:13:25.232018] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-19T17:13:25.232595] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-19T17:13:25.232686] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-19T17:13:25.233874] [DEBUG] [LOCAL ] AMR: Trimmed 39435 records to 29761 (keeping 200 days of data) [2025-09-19T17:13:25.439273] [DEBUG] [LOCAL ] AMR: Primary data saved (29761 records). [2025-09-19T17:13:25.439637] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-19T17:13:25.439790] [INFO ] [MAIN ] Update Progress: 106/2372 symbols completed. AMR took 30.5s. Estimated remaining: 4h 45m 27s. Rate: 7.9 symbols/min [2025-09-19T17:13:25.452192] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-19T17:13:25.631803] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T17:13:25.726979] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:25.759871] [DEBUG] [LOCAL ] AMTB: Loaded 20824 existing records from primary storage. [2025-09-19T17:13:25.760068] [INFO ] [MAIN ] AMTB: Loaded 20824 existing records. [2025-09-19T17:13:26.048054] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:26.048379] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-19T17:13:26.048457] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-19T17:13:26.049216] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-19T17:13:26.049280] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-19T17:13:26.261092] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-19T17:13:26.596862] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:27.043271] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-19T17:13:27.695387] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:13:27.735613] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T17:13:27.843268] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-19T17:13:28.333573] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T17:13:28.643280] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-19T17:13:29.443327] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-19T17:13:29.942118] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:13:30.149446] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T17:13:30.243262] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-19T17:13:31.043247] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-19T17:13:31.123680] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T17:13:31.843279] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-19T17:13:32.060470] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T17:13:32.643325] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-19T17:13:32.917524] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:13:32.974748] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T17:13:33.443271] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-19T17:13:34.243318] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-19T17:13:34.794600] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T17:13:34.895907] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T17:13:34.902295] [INFO ] [REMOTE ] AMRC: Full fetch complete (52175 records). [2025-09-19T17:13:34.902491] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-19T17:13:34.989235] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T17:13:35.058664] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-19T17:13:35.309395] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-19T17:13:35.309483] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-19T17:13:35.310088] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-19T17:13:35.310154] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-19T17:13:35.311465] [DEBUG] [LOCAL ] AMRC: Trimmed 52175 records to 39283 (keeping 200 days of data) [2025-09-19T17:13:35.541419] [DEBUG] [LOCAL ] AMRC: Primary data saved (39283 records). [2025-09-19T17:13:35.541604] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-19T17:13:35.541750] [INFO ] [MAIN ] Update Progress: 107/2372 symbols completed. AMRC took 38.1s. Estimated remaining: 4h 46m 14s. Rate: 7.9 symbols/min [2025-09-19T17:13:35.717230] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:35.722821] [DEBUG] [LOCAL ] AMTD: Loaded 3564 existing records from primary storage. [2025-09-19T17:13:35.722930] [INFO ] [MAIN ] AMTD: Loaded 3564 existing records. [2025-09-19T17:13:35.848406] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-19T17:13:35.909092] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:35.909333] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-19T17:13:35.909384] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-19T17:13:35.909686] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-19T17:13:35.909748] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-19T17:13:36.267217] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:36.391824] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T17:13:36.643264] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-19T17:13:37.443312] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-19T17:13:38.003255] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T17:13:38.243263] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-19T17:13:38.821456] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T17:13:38.829108] [INFO ] [REMOTE ] AMRZ: Full fetch complete (23806 records). [2025-09-19T17:13:38.829199] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-19T17:13:39.018095] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 63 unique days, need 200 days [2025-09-19T17:13:39.018549] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:13:39.018770] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:13:39.018887] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-19T17:13:39.019065] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-19T17:13:39.019136] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-19T17:13:39.019275] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-19T17:13:39.024699] [INFO ] [MAIN ] Update Progress: 108/2372 symbols completed. AMRZ took 25.8s. Estimated remaining: 4h 44m 40s. Rate: 8.0 symbols/min [2025-09-19T17:13:39.060743] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-19T17:13:39.079490] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T17:13:39.221949] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:39.263039] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T17:13:39.283536] [DEBUG] [LOCAL ] AMTM: Loaded 51128 existing records from primary storage. [2025-09-19T17:13:39.283721] [INFO ] [MAIN ] AMTM: Loaded 51128 existing records. [2025-09-19T17:13:39.465859] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:39.466168] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-19T17:13:39.466225] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-19T17:13:39.467780] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-19T17:13:39.467842] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-19T17:13:39.839491] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:39.843216] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-19T17:13:40.643271] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-19T17:13:40.788848] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T17:13:41.194331] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T17:13:41.443254] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-19T17:13:42.092789] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-19T17:13:42.207803] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T17:13:42.243302] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-19T17:13:43.043267] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-19T17:13:43.843268] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-19T17:13:44.426883] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T17:13:44.523251] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T17:13:44.643305] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-19T17:13:45.198359] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T17:13:45.269209] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T17:13:45.443268] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-19T17:13:46.243297] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-19T17:13:47.043345] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-19T17:13:47.364023] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T17:13:47.444012] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T17:13:47.843269] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-19T17:13:48.643251] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-19T17:13:48.732919] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T17:13:49.265183] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T17:13:49.443238] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-19T17:13:49.539155] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:13:50.144020] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T17:13:50.243261] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-19T17:13:51.043265] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-19T17:13:51.566004] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T17:13:51.569119] [INFO ] [REMOTE ] AMTB: Full fetch complete (30430 records). [2025-09-19T17:13:51.569330] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-19T17:13:51.848466] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-19T17:13:51.980100] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-19T17:13:51.980196] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-19T17:13:51.980704] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-19T17:13:51.980781] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-19T17:13:51.981559] [DEBUG] [LOCAL ] AMTB: Trimmed 30430 records to 20984 (keeping 200 days of data) [2025-09-19T17:13:52.110513] [DEBUG] [LOCAL ] AMTB: Primary data saved (20984 records). [2025-09-19T17:13:52.110671] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-19T17:13:52.110776] [INFO ] [MAIN ] Update Progress: 109/2372 symbols completed. AMTB took 26.7s. Estimated remaining: 4h 46m 28s. Rate: 7.9 symbols/min [2025-09-19T17:13:52.277796] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:52.288020] [DEBUG] [LOCAL ] AMWL: Loaded 8740 existing records from primary storage. [2025-09-19T17:13:52.288137] [INFO ] [MAIN ] AMWL: Loaded 8740 existing records. [2025-09-19T17:13:52.473816] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:52.474358] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-19T17:13:52.474486] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-19T17:13:52.475059] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-19T17:13:52.475129] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-19T17:13:52.685863] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-19T17:13:52.869374] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T17:13:52.920497] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:53.357128] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T17:13:53.443259] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-19T17:13:53.983536] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T17:13:54.243280] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-19T17:13:54.274446] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T17:13:55.043270] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-19T17:13:55.843267] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-19T17:13:56.261389] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:13:56.344550] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T17:13:56.643269] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-19T17:13:57.228711] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:13:57.447115] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-19T17:13:57.454082] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T17:13:58.243278] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-19T17:13:58.302413] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T17:13:59.043264] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-19T17:13:59.843277] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-19T17:14:00.073893] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T17:14:00.075440] [INFO ] [REMOTE ] AMTD: Full fetch complete (5594 records). [2025-09-19T17:14:00.075513] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-19T17:14:00.441989] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-19T17:14:00.442101] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-19T17:14:00.442522] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-19T17:14:00.442583] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-19T17:14:00.443080] [DEBUG] [LOCAL ] AMTD: Trimmed 5594 records to 3591 (keeping 200 days of data) [2025-09-19T17:14:00.468981] [DEBUG] [LOCAL ] AMTD: Primary data saved (3591 records). [2025-09-19T17:14:00.469314] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-19T17:14:00.469464] [INFO ] [MAIN ] Update Progress: 110/2372 symbols completed. AMTD took 24.9s. Estimated remaining: 4h 46m 36s. Rate: 7.9 symbols/min [2025-09-19T17:14:00.646627] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:00.643861] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-19T17:14:00.683875] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T17:14:00.739357] [DEBUG] [LOCAL ] AMX: Loaded 49447 existing records from primary storage. [2025-09-19T17:14:00.739504] [INFO ] [MAIN ] AMX: Loaded 49447 existing records. [2025-09-19T17:14:00.927098] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:14:00.927557] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-19T17:14:00.927607] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-19T17:14:00.929041] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-19T17:14:00.929111] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-19T17:14:01.075550] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T17:14:01.386619] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:01.443212] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-19T17:14:02.243276] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-19T17:14:03.043322] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-19T17:14:03.439076] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T17:14:03.470350] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-19T17:14:03.478198] [INFO ] [REMOTE ] AMT: Full fetch complete (75992 records). [2025-09-19T17:14:03.478329] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-19T17:14:03.861597] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-19T17:14:03.890955] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-19T17:14:03.891091] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-19T17:14:03.892004] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-19T17:14:03.892350] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-19T17:14:03.894856] [DEBUG] [LOCAL ] AMT: Trimmed 75992 records to 53223 (keeping 200 days of data) [2025-09-19T17:14:04.025808] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T17:14:04.173982] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T17:14:04.300955] [DEBUG] [LOCAL ] AMT: Primary data saved (53223 records). [2025-09-19T17:14:04.301122] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-19T17:14:04.301240] [INFO ] [MAIN ] Update Progress: 111/2372 symbols completed. AMT took 41.1s. Estimated remaining: 4h 45m 11s. Rate: 7.9 symbols/min [2025-09-19T17:14:04.473172] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:04.473357] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-09-19T17:14:04.473610] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-09-19T17:14:04.473791] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-19T17:14:04.473833] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-19T17:14:04.473873] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-09-19T17:14:04.473915] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-19T17:14:04.664578] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-19T17:14:04.861188] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:05.443273] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-19T17:14:05.782549] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T17:14:06.180527] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:14:06.243251] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-19T17:14:06.661382] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T17:14:07.043289] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-19T17:14:07.843284] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-19T17:14:08.067270] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T17:14:08.346768] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T17:14:08.643330] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-19T17:14:09.443268] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-19T17:14:09.585369] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T17:14:10.243267] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-19T17:14:10.452438] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T17:14:10.782246] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T17:14:11.043314] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-19T17:14:11.403457] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T17:14:11.843264] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-19T17:14:12.643294] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-19T17:14:13.162169] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T17:14:13.443264] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-19T17:14:13.963259] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T17:14:13.972092] [INFO ] [REMOTE ] AMTM: Full fetch complete (73947 records). [2025-09-19T17:14:13.972392] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-19T17:14:14.266416] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-19T17:14:14.410409] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-19T17:14:14.410680] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-19T17:14:14.411678] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-19T17:14:14.412493] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-19T17:14:14.423485] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T17:14:14.429234] [DEBUG] [LOCAL ] AMTM: Trimmed 73947 records to 51512 (keeping 200 days of data) [2025-09-19T17:14:14.501377] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T17:14:14.774868] [DEBUG] [LOCAL ] AMTM: Primary data saved (51512 records). [2025-09-19T17:14:14.775015] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-19T17:14:14.778999] [INFO ] [MAIN ] Update Progress: 112/2372 symbols completed. AMTM took 35.8s. Estimated remaining: 4h 46m 2s. Rate: 7.9 symbols/min [2025-09-19T17:14:14.963280] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:14.963473] [DEBUG] [LOCAL ] ANET: No existing data file found in primary storage. [2025-09-19T17:14:14.963512] [WARN ] [MAIN ] ANET: No existing data found, performing full refresh instead. [2025-09-19T17:14:14.963696] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-19T17:14:14.963750] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-19T17:14:14.963796] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-09-19T17:14:14.963841] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-19T17:14:15.048483] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-19T17:14:15.332461] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:15.843254] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-19T17:14:16.292821] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:14:16.448068] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T17:14:16.643324] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-19T17:14:17.443317] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-19T17:14:18.167481] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-19T17:14:18.243312] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-19T17:14:18.638252] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T17:14:19.038029] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T17:14:19.043222] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-19T17:14:19.478341] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T17:14:19.843287] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-19T17:14:20.017032] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T17:14:20.643282] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-19T17:14:21.443321] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-19T17:14:21.753976] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T17:14:21.756198] [INFO ] [REMOTE ] AMWL: Full fetch complete (13993 records). [2025-09-19T17:14:21.756293] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-19T17:14:22.167427] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-19T17:14:22.167507] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-19T17:14:22.167780] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-19T17:14:22.167842] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-19T17:14:22.168326] [DEBUG] [LOCAL ] AMWL: Trimmed 13993 records to 8803 (keeping 200 days of data) [2025-09-19T17:14:22.226490] [DEBUG] [LOCAL ] AMWL: Primary data saved (8803 records). [2025-09-19T17:14:22.226639] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-19T17:14:22.226767] [INFO ] [MAIN ] Update Progress: 113/2372 symbols completed. AMWL took 30.1s. Estimated remaining: 4h 45m 52s. Rate: 7.9 symbols/min [2025-09-19T17:14:22.258588] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-19T17:14:22.402084] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:22.477067] [DEBUG] [LOCAL ] ANF: Loaded 52666 existing records from primary storage. [2025-09-19T17:14:22.477513] [INFO ] [MAIN ] ANF: Loaded 52666 existing records. [2025-09-19T17:14:22.667439] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:14:22.668151] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-19T17:14:22.668458] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-19T17:14:22.678980] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-19T17:14:22.694477] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-19T17:14:22.783787] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.94 seconds). [2025-09-19T17:14:23.043349] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-19T17:14:23.081966] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:23.325115] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T17:14:23.843284] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-19T17:14:24.047836] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T17:14:24.643371] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-19T17:14:25.038322] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T17:14:25.443277] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-19T17:14:26.052839] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T17:14:26.243281] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-19T17:14:26.728783] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T17:14:26.845328] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T17:14:27.043354] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-19T17:14:27.843284] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-19T17:14:28.643329] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-19T17:14:29.047513] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:14:29.099248] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-19T17:14:29.302989] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T17:14:29.443311] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-19T17:14:30.243254] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-19T17:14:30.907857] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T17:14:31.043269] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-19T17:14:31.527979] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T17:14:31.843359] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-19T17:14:32.643256] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-19T17:14:32.914830] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T17:14:32.995834] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T17:14:33.059365] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:14:33.066533] [INFO ] [REMOTE ] AMX: Full fetch complete (70776 records). [2025-09-19T17:14:33.066693] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-19T17:14:33.443997] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-19T17:14:33.461301] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-19T17:14:33.462339] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-19T17:14:33.463079] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-19T17:14:33.463146] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-19T17:14:33.465588] [DEBUG] [LOCAL ] AMX: Trimmed 70776 records to 49778 (keeping 200 days of data) [2025-09-19T17:14:33.775619] [DEBUG] [LOCAL ] AMX: Primary data saved (49778 records). [2025-09-19T17:14:33.775781] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-19T17:14:33.775885] [INFO ] [MAIN ] Update Progress: 114/2372 symbols completed. AMX took 33.3s. Estimated remaining: 4h 47m 3s. Rate: 7.9 symbols/min [2025-09-19T17:14:33.945352] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:33.945548] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-19T17:14:33.945602] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-19T17:14:33.945792] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-19T17:14:33.945834] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-19T17:14:33.945901] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-19T17:14:33.945976] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-19T17:14:34.248362] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-19T17:14:34.312426] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:34.740759] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T17:14:34.911609] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:14:34.917157] [INFO ] [REMOTE ] AN: Full fetch complete (47833 records). [2025-09-19T17:14:34.917326] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-19T17:14:35.046020] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-19T17:14:35.322396] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-19T17:14:35.322477] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-19T17:14:35.322992] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-19T17:14:35.323052] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-19T17:14:35.324052] [DEBUG] [LOCAL ] AN: Trimmed 47833 records to 33301 (keeping 200 days of data) [2025-09-19T17:14:35.537963] [DEBUG] [LOCAL ] AN: Primary data saved (33301 records). [2025-09-19T17:14:35.538118] [INFO ] [MAIN ] AN: Full history saved. [2025-09-19T17:14:35.538200] [INFO ] [MAIN ] Update Progress: 115/2372 symbols completed. AN took 31.2s. Estimated remaining: 4h 44m 60s. Rate: 7.9 symbols/min [2025-09-19T17:14:35.710281] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:35.731100] [DEBUG] [LOCAL ] ANRO: Loaded 20424 existing records from primary storage. [2025-09-19T17:14:35.731288] [INFO ] [MAIN ] ANRO: Loaded 20424 existing records. [2025-09-19T17:14:35.848353] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-19T17:14:35.911417] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:14:35.911624] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-19T17:14:35.911719] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-19T17:14:35.912342] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-19T17:14:35.912401] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-19T17:14:36.159297] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:36.190460] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-19T17:14:36.269209] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:36.643220] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-19T17:14:36.859256] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T17:14:37.126061] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:37.126381] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-19T17:14:37.156813] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-19T17:14:37.443254] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-19T17:14:38.243254] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-19T17:14:39.043257] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-19T17:14:39.086241] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T17:14:39.843305] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-19T17:14:40.073519] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:40.073896] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-19T17:14:40.643298] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-19T17:14:40.871269] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-19T17:14:40.942199] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T17:14:41.350114] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T17:14:41.443272] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-19T17:14:42.243288] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-19T17:14:43.015087] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T17:14:43.043321] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-19T17:14:43.843268] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-19T17:14:44.548967] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T17:14:44.621959] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T17:14:44.643250] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-19T17:14:45.340472] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T17:14:45.443234] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-19T17:14:46.243259] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-19T17:14:46.818760] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T17:14:47.043260] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-19T17:14:47.420759] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-19T17:14:47.807320] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T17:14:47.843276] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-19T17:14:48.198258] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:48.198593] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-19T17:14:48.484759] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T17:14:48.643267] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-19T17:14:48.889259] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:48.889892] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-19T17:14:49.443288] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-19T17:14:50.243303] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-19T17:14:50.961054] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:50.961581] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-19T17:14:50.978815] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T17:14:51.043275] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-19T17:14:51.689345] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T17:14:51.843269] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-19T17:14:52.643325] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-19T17:14:52.888923] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:52.889246] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-19T17:14:53.443340] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-19T17:14:53.534981] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T17:14:53.700984] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:53.701317] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-19T17:14:54.243264] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-19T17:14:55.043271] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-19T17:14:55.843288] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-19T17:14:56.077410] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:56.077757] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-19T17:14:56.643251] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-19T17:14:56.946931] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-09-19T17:14:56.957887] [INFO ] [REMOTE ] ANET: Full fetch complete (77822 records). [2025-09-19T17:14:56.958045] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-19T17:14:57.319051] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T17:14:57.384689] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-19T17:14:57.385541] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-19T17:14:57.386464] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-19T17:14:57.387105] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-19T17:14:57.408725] [DEBUG] [LOCAL ] ANET: Trimmed 77822 records to 54546 (keeping 200 days of data) [2025-09-19T17:14:57.408575] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T17:14:57.417975] [INFO ] [REMOTE ] ANF: Full fetch complete (75653 records). [2025-09-19T17:14:57.418103] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-19T17:14:57.502598] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-19T17:14:58.042858] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-19T17:14:58.045987] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-19T17:14:58.048200] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-19T17:14:58.048293] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-19T17:14:58.061094] [DEBUG] [LOCAL ] ANF: Trimmed 75653 records to 53051 (keeping 200 days of data) [2025-09-19T17:14:58.243534] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-19T17:14:58.274617] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-09-19T17:14:58.275264] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-19T17:14:58.275602] [INFO ] [MAIN ] Update Progress: 116/2372 symbols completed. ANET took 43.5s. Estimated remaining: 4h 49m 47s. Rate: 7.8 symbols/min [2025-09-19T17:14:58.525378] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:58.587534] [DEBUG] [LOCAL ] ANVS: Loaded 23530 existing records from primary storage. [2025-09-19T17:14:58.589325] [INFO ] [MAIN ] ANVS: Loaded 23530 existing records. [2025-09-19T17:14:58.781473] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:14:58.782697] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-19T17:14:58.783078] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-19T17:14:58.784052] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-19T17:14:58.784346] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-19T17:14:58.976144] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T17:14:59.024436] [INFO ] [REMOTE ] ANRO: Full fetch complete (30941 records). [2025-09-19T17:14:59.043382] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-19T17:14:59.482737] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:59.527935] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-19T17:14:59.668743] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T17:14:59.676832] [INFO ] [REMOTE ] ANGX: Full fetch complete (2445 records). [2025-09-19T17:14:59.672883] [DEBUG] [LOCAL ] ANF: Primary data saved (53051 records). [2025-09-19T17:14:59.672702] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-19T17:14:59.677022] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-19T17:14:59.677094] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-19T17:14:59.682800] [INFO ] [MAIN ] Update Progress: 117/2372 symbols completed. ANF took 37.5s. Estimated remaining: 4h 47m 38s. Rate: 7.8 symbols/min [2025-09-19T17:14:59.677205] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-19T17:14:59.745193] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-19T17:14:59.756586] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-19T17:14:59.783516] [DEBUG] [LOCAL ] ANRO: Trimmed 30941 records to 20526 (keeping 200 days of data) [2025-09-19T17:14:59.941662] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-19T17:14:59.950610] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:14:59.954870] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:14:59.963400] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-19T17:14:59.967929] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-19T17:14:59.975508] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-19T17:14:59.977193] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-19T17:14:59.978208] [INFO ] [MAIN ] Update Progress: 118/2372 symbols completed. ANGX took 26.2s. Estimated remaining: 4h 45m 10s. Rate: 7.9 symbols/min [2025-09-19T17:14:59.979062] [DEBUG] [LOCAL ] ANRO: Primary data saved (20526 records). [2025-09-19T17:14:59.979216] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-19T17:14:59.979373] [INFO ] [MAIN ] Update Progress: 119/2372 symbols completed. ANRO took 24.4s. Estimated remaining: 4h 42m 39s. Rate: 8.0 symbols/min [2025-09-19T17:15:01.346146] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:15:01.352772] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-19T17:15:04.185819] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-19T17:15:04.192014] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-19T17:15:06.554148] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T17:15:06.561297] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-19T17:15:07.473431] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T17:15:07.478883] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-19T17:15:08.842447] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:15:08.848326] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-19T17:15:10.287016] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T17:15:10.294056] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-19T17:15:11.530180] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:15:11.540872] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-19T17:15:13.137246] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T17:15:13.146011] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-19T17:15:15.237068] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T17:15:15.241892] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-19T17:15:16.286684] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T17:15:16.289619] [INFO ] [REMOTE ] ANVS: Full fetch complete (37042 records). [2025-09-19T17:15:16.289749] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-19T17:15:16.664345] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-19T17:15:16.664490] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-19T17:15:16.664957] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-19T17:15:16.665020] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-19T17:15:16.666028] [DEBUG] [LOCAL ] ANVS: Trimmed 37042 records to 23662 (keeping 200 days of data) [2025-09-19T17:15:16.793997] [DEBUG] [LOCAL ] ANVS: Primary data saved (23662 records). [2025-09-19T17:15:16.794122] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-19T17:15:16.794203] [INFO ] [MAIN ] Update Progress: 120/2372 symbols completed. ANVS took 18.5s. Estimated remaining: 4h 45m 25s. Rate: 7.9 symbols/min [2025-09-19T17:15:17.403537] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:17.452479] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-09-19T17:15:17.458726] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-09-19T17:15:17.479837] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:17.504061] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:17.515034] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-19T17:15:17.518943] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:17.519418] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-09-19T17:15:17.519789] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-19T17:15:17.519887] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-19T17:15:17.520048] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-19T17:15:17.519689] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-09-19T17:15:17.520183] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-09-19T17:15:17.520490] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-19T17:15:17.520703] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-19T17:15:17.520862] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-19T17:15:17.520988] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-19T17:15:17.521238] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-19T17:15:17.532904] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-19T17:15:17.551774] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-19T17:15:17.562360] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-09-19T17:15:17.568347] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-19T17:15:18.081224] [DEBUG] [LOCAL ] AON: Loaded 46012 existing records from primary storage. [2025-09-19T17:15:18.213428] [INFO ] [MAIN ] AON: Loaded 46012 existing records. [2025-09-19T17:15:18.765428] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:18.831060] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-19T17:15:18.856450] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:18.859627] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:15:18.904947] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-19T17:15:18.905220] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-19T17:15:18.905388] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-19T17:15:18.931111] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-19T17:15:18.931287] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-19T17:15:18.930963] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:18.972670] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-19T17:15:19.299922] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:19.300386] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-19T17:15:19.402698] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:19.402942] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-19T17:15:19.403304] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-19T17:15:19.641780] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:19.642140] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-19T17:15:19.642710] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-19T17:15:19.883300] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:19.883626] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-19T17:15:19.884105] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-19T17:15:19.997410] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T17:15:20.000507] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-19T17:15:20.115064] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:20.115399] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-19T17:15:20.115914] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-19T17:15:20.537186] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:20.537853] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-19T17:15:20.538850] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-19T17:15:20.558609] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T17:15:20.564948] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-19T17:15:21.047702] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T17:15:21.051460] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-19T17:15:21.216200] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T17:15:21.217479] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-19T17:15:21.269809] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T17:15:21.280155] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-19T17:15:21.630735] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T17:15:21.632587] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-19T17:15:21.719096] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T17:15:21.726895] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-19T17:15:21.738996] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T17:15:21.743286] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-19T17:15:22.205192] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T17:15:22.206493] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-19T17:15:22.722936] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T17:15:22.728871] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-19T17:15:22.752077] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T17:15:22.753462] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-19T17:15:22.925039] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T17:15:22.994095] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T17:15:23.043274] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-19T17:15:23.545851] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T17:15:23.547246] [INFO ] [REMOTE ] AOMD: Full fetch complete (1721 records). [2025-09-19T17:15:23.547339] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-19T17:15:23.748541] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 81 unique days, need 200 days [2025-09-19T17:15:23.748751] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:15:23.748828] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:15:23.748896] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-19T17:15:23.748961] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-19T17:15:23.748996] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-19T17:15:23.749057] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-19T17:15:23.749136] [INFO ] [MAIN ] Update Progress: 121/2372 symbols completed. AOMD took 7.0s. Estimated remaining: 4h 45m 6s. Rate: 7.9 symbols/min [2025-09-19T17:15:23.847865] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-19T17:15:23.920118] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:23.920271] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-09-19T17:15:23.920308] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-09-19T17:15:23.920444] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-19T17:15:23.920486] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-19T17:15:23.920526] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-09-19T17:15:23.920556] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-19T17:15:24.292509] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:24.310999] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T17:15:24.496211] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T17:15:24.643276] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-19T17:15:25.443274] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-19T17:15:25.715106] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T17:15:25.830169] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:15:26.243264] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-19T17:15:26.373401] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T17:15:27.043270] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-19T17:15:27.583232] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T17:15:27.843274] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-19T17:15:28.643296] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-19T17:15:28.954786] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:15:29.107809] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T17:15:29.443298] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-19T17:15:29.736716] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T17:15:30.243329] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-19T17:15:30.559067] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T17:15:30.880859] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T17:15:31.043309] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-19T17:15:31.843295] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-19T17:15:31.975954] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T17:15:32.643315] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-19T17:15:33.379321] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T17:15:33.443279] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-19T17:15:34.243260] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-19T17:15:34.551715] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T17:15:34.868634] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T17:15:35.045907] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-19T17:15:35.050462] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T17:15:35.843310] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-19T17:15:36.004387] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T17:15:36.643305] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-19T17:15:37.443333] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-19T17:15:37.513389] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:15:37.966449] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:15:38.243253] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-19T17:15:39.043286] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-19T17:15:39.216400] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T17:15:39.843315] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-19T17:15:40.222617] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T17:15:40.253563] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T17:15:40.643300] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-19T17:15:41.193261] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:15:41.443275] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-19T17:15:41.699003] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T17:15:41.703917] [INFO ] [REMOTE ] AOD: Full fetch complete (44012 records). [2025-09-19T17:15:41.704013] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-19T17:15:42.083835] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-19T17:15:42.083923] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-19T17:15:42.084387] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-19T17:15:42.084427] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-19T17:15:42.085417] [DEBUG] [LOCAL ] AOD: Trimmed 44012 records to 30803 (keeping 200 days of data) [2025-09-19T17:15:42.247370] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-19T17:15:42.266893] [DEBUG] [LOCAL ] AOD: Primary data saved (30803 records). [2025-09-19T17:15:42.267025] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-19T17:15:42.267101] [INFO ] [MAIN ] Update Progress: 122/2372 symbols completed. AOD took 25.5s. Estimated remaining: 4h 48m 19s. Rate: 7.8 symbols/min [2025-09-19T17:15:42.437475] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:42.489752] [DEBUG] [LOCAL ] AOS: Loaded 49823 existing records from primary storage. [2025-09-19T17:15:42.489953] [INFO ] [MAIN ] AOS: Loaded 49823 existing records. [2025-09-19T17:15:42.684194] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:15:42.684463] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-19T17:15:42.684532] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-19T17:15:42.687028] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-19T17:15:42.687091] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-19T17:15:43.051281] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-19T17:15:43.055984] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:43.248704] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T17:15:43.583547] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T17:15:43.843321] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-19T17:15:44.447705] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T17:15:44.450664] [INFO ] [REMOTE ] AOMR: Full fetch complete (23080 records). [2025-09-19T17:15:44.450762] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-19T17:15:44.649395] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-19T17:15:44.840952] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-19T17:15:44.841035] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-19T17:15:44.841359] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-19T17:15:44.841396] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-19T17:15:44.842189] [DEBUG] [LOCAL ] AOMR: Trimmed 23080 records to 17257 (keeping 200 days of data) [2025-09-19T17:15:44.942750] [DEBUG] [LOCAL ] AOMR: Primary data saved (17257 records). [2025-09-19T17:15:44.942901] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-19T17:15:44.942982] [INFO ] [MAIN ] Update Progress: 123/2372 symbols completed. AOMR took 28.1s. Estimated remaining: 4h 46m 40s. Rate: 7.8 symbols/min [2025-09-19T17:15:45.115790] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:45.115956] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-09-19T17:15:45.115992] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-09-19T17:15:45.116210] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-19T17:15:45.116266] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-19T17:15:45.116308] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-19T17:15:45.116339] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-19T17:15:45.446448] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-19T17:15:45.492265] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:45.565575] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T17:15:46.194369] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T17:15:46.243259] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-19T17:15:46.820592] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T17:15:46.827605] [INFO ] [REMOTE ] AON: Full fetch complete (64937 records). [2025-09-19T17:15:46.827770] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-19T17:15:47.048338] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-19T17:15:47.223201] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-19T17:15:47.223289] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-19T17:15:47.223945] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-19T17:15:47.224009] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-19T17:15:47.225328] [DEBUG] [LOCAL ] AON: Trimmed 64937 records to 46389 (keeping 200 days of data) [2025-09-19T17:15:47.526970] [DEBUG] [LOCAL ] AON: Primary data saved (46389 records). [2025-09-19T17:15:47.527112] [INFO ] [MAIN ] AON: Full history saved. [2025-09-19T17:15:47.527226] [INFO ] [MAIN ] Update Progress: 124/2372 symbols completed. AON took 30.7s. Estimated remaining: 4h 45m 1s. Rate: 7.9 symbols/min [2025-09-19T17:15:47.701333] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:47.739745] [DEBUG] [LOCAL ] APAM: Loaded 37094 existing records from primary storage. [2025-09-19T17:15:47.739890] [INFO ] [MAIN ] APAM: Loaded 37094 existing records. [2025-09-19T17:15:47.848327] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-19T17:15:47.918530] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:15:47.918817] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-19T17:15:47.918885] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-19T17:15:47.921123] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-19T17:15:47.921188] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-19T17:15:48.296584] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:48.335275] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T17:15:48.391073] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T17:15:48.643266] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-19T17:15:48.780635] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:15:49.389473] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:15:49.443273] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-19T17:15:50.243247] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-19T17:15:50.888128] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T17:15:51.043280] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-19T17:15:51.843306] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-19T17:15:51.977930] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T17:15:51.982851] [INFO ] [REMOTE ] AORT: Full fetch complete (41607 records). [2025-09-19T17:15:51.982969] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-19T17:15:52.360945] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-19T17:15:52.361032] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-19T17:15:52.361537] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-19T17:15:52.361596] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-19T17:15:52.362814] [DEBUG] [LOCAL ] AORT: Trimmed 41607 records to 30407 (keeping 200 days of data) [2025-09-19T17:15:52.546349] [DEBUG] [LOCAL ] AORT: Primary data saved (30407 records). [2025-09-19T17:15:52.546521] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-19T17:15:52.546623] [INFO ] [MAIN ] Update Progress: 125/2372 symbols completed. AORT took 28.8s. Estimated remaining: 4h 44m 7s. Rate: 7.9 symbols/min [2025-09-19T17:15:52.624338] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T17:15:52.647104] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-19T17:15:52.755413] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:52.800970] [DEBUG] [LOCAL ] APD: Loaded 45876 existing records from primary storage. [2025-09-19T17:15:52.801148] [INFO ] [MAIN ] APD: Loaded 45876 existing records. [2025-09-19T17:15:52.980370] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:15:52.980918] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-19T17:15:52.980989] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-19T17:15:52.983396] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-19T17:15:52.983462] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-19T17:15:53.096051] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-19T17:15:53.322187] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T17:15:53.404492] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:53.443221] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-19T17:15:54.243246] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-19T17:15:55.043264] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-19T17:15:55.530374] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T17:15:55.730372] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T17:15:55.803849] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T17:15:55.843248] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-19T17:15:56.643272] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-19T17:15:56.837190] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T17:15:57.443275] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-19T17:15:58.243255] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-19T17:15:58.478508] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T17:15:58.660224] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T17:15:59.043279] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-19T17:15:59.843280] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-19T17:16:00.066056] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-19T17:16:00.125793] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T17:16:00.643320] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-19T17:16:01.443289] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-19T17:16:01.802137] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T17:16:01.863321] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T17:16:02.243315] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-19T17:16:03.043287] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-19T17:16:03.788782] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T17:16:03.843235] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-19T17:16:04.394390] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T17:16:04.395926] [INFO ] [REMOTE ] AP: Full fetch complete (8670 records). [2025-09-19T17:16:04.395999] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-19T17:16:04.665233] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-19T17:16:04.866519] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-19T17:16:04.866875] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-19T17:16:04.867341] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-19T17:16:04.867445] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-19T17:16:04.871616] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-19T17:16:04.886026] [DEBUG] [LOCAL ] AP: Trimmed 8670 records to 6911 (keeping 200 days of data) [2025-09-19T17:16:04.954422] [DEBUG] [LOCAL ] AP: Primary data saved (6911 records). [2025-09-19T17:16:04.954625] [INFO ] [MAIN ] AP: Full history saved. [2025-09-19T17:16:04.954772] [INFO ] [MAIN ] Update Progress: 126/2372 symbols completed. AP took 20.0s. Estimated remaining: 4h 45m 25s. Rate: 7.9 symbols/min [2025-09-19T17:16:05.183772] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:05.261625] [DEBUG] [LOCAL ] APG: Loaded 50625 existing records from primary storage. [2025-09-19T17:16:05.262127] [INFO ] [MAIN ] APG: Loaded 50625 existing records. [2025-09-19T17:16:05.452930] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-19T17:16:05.491751] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T17:16:05.615419] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:05.615795] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-19T17:16:05.615853] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-19T17:16:05.620732] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-19T17:16:05.620944] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-19T17:16:06.012036] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:06.056738] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T17:16:06.243267] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-19T17:16:07.043264] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-19T17:16:07.615898] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T17:16:07.735141] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T17:16:07.843233] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-19T17:16:08.643272] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-19T17:16:08.959170] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T17:16:09.443284] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-19T17:16:09.729727] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T17:16:10.243271] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-19T17:16:10.641549] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T17:16:10.760013] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:16:11.043281] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-19T17:16:11.843280] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-19T17:16:12.136559] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T17:16:12.508546] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:16:12.516241] [INFO ] [REMOTE ] AOS: Full fetch complete (70773 records). [2025-09-19T17:16:12.516385] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-19T17:16:12.648402] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-19T17:16:12.950418] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-19T17:16:12.950540] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-19T17:16:12.951352] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-19T17:16:12.952105] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-19T17:16:12.953858] [DEBUG] [LOCAL ] AOS: Trimmed 70773 records to 50129 (keeping 200 days of data) [2025-09-19T17:16:13.290780] [DEBUG] [LOCAL ] AOS: Primary data saved (50129 records). [2025-09-19T17:16:13.290934] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-19T17:16:13.291026] [INFO ] [MAIN ] Update Progress: 127/2372 symbols completed. AOS took 31.0s. Estimated remaining: 4h 45m 30s. Rate: 7.9 symbols/min [2025-09-19T17:16:13.456437] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-19T17:16:13.460433] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:13.517638] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-09-19T17:16:13.517817] [INFO ] [MAIN ] APH: Loaded 54081 existing records. [2025-09-19T17:16:13.707670] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:13.708007] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-19T17:16:13.708069] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-19T17:16:13.711322] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-19T17:16:13.711404] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-19T17:16:14.094370] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:14.124804] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T17:16:14.243258] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-19T17:16:14.282045] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T17:16:14.714187] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T17:16:15.043291] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-19T17:16:15.843312] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-19T17:16:16.213561] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:16:16.451432] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T17:16:16.643281] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-19T17:16:17.443266] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-19T17:16:17.960753] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T17:16:18.007881] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:16:18.243238] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-19T17:16:18.869066] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T17:16:19.043265] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-19T17:16:19.843315] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-19T17:16:20.142753] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T17:16:20.643317] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-19T17:16:21.299073] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T17:16:21.443301] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-19T17:16:21.948335] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T17:16:21.993537] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T17:16:22.243259] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-19T17:16:23.043273] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-19T17:16:23.352271] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:16:23.843269] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-19T17:16:24.184836] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T17:16:24.643237] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-19T17:16:25.268106] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T17:16:25.443278] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-19T17:16:25.691043] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:16:26.033564] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T17:16:26.243319] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-19T17:16:26.463128] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T17:16:26.469368] [INFO ] [REMOTE ] APAM: Full fetch complete (51598 records). [2025-09-19T17:16:26.469553] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-19T17:16:26.872305] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-19T17:16:26.872395] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-19T17:16:26.872972] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-19T17:16:26.873045] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-19T17:16:26.876950] [DEBUG] [LOCAL ] APAM: Trimmed 51598 records to 37305 (keeping 200 days of data) [2025-09-19T17:16:27.049503] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-19T17:16:27.102404] [DEBUG] [LOCAL ] APAM: Primary data saved (37305 records). [2025-09-19T17:16:27.102550] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-19T17:16:27.103832] [INFO ] [MAIN ] Update Progress: 128/2372 symbols completed. APAM took 39.6s. Estimated remaining: 4h 47m 11s. Rate: 7.8 symbols/min [2025-09-19T17:16:27.278243] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:27.333346] [DEBUG] [LOCAL ] APLE: Loaded 52448 existing records from primary storage. [2025-09-19T17:16:27.333519] [INFO ] [MAIN ] APLE: Loaded 52448 existing records. [2025-09-19T17:16:27.519088] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:27.519440] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-19T17:16:27.519524] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-19T17:16:27.522682] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-19T17:16:27.522770] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-19T17:16:27.849888] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-19T17:16:27.889203] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:27.933142] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T17:16:27.947316] [INFO ] [REMOTE ] APD: Full fetch complete (66539 records). [2025-09-19T17:16:27.947575] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-19T17:16:28.340767] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-19T17:16:28.340880] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-19T17:16:28.341560] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-19T17:16:28.341617] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-19T17:16:28.343254] [DEBUG] [LOCAL ] APD: Trimmed 66539 records to 46133 (keeping 200 days of data) [2025-09-19T17:16:28.639279] [DEBUG] [LOCAL ] APD: Primary data saved (46133 records). [2025-09-19T17:16:28.639424] [INFO ] [MAIN ] APD: Full history saved. [2025-09-19T17:16:28.639524] [INFO ] [MAIN ] Update Progress: 129/2372 symbols completed. APD took 36.1s. Estimated remaining: 4h 45m 16s. Rate: 7.9 symbols/min [2025-09-19T17:16:28.648800] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-19T17:16:28.826243] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:28.902450] [DEBUG] [LOCAL ] APO: Loaded 53772 existing records from primary storage. [2025-09-19T17:16:28.902709] [INFO ] [MAIN ] APO: Loaded 53772 existing records. [2025-09-19T17:16:29.089191] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:29.089637] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-19T17:16:29.089870] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-19T17:16:29.092866] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-19T17:16:29.092941] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-19T17:16:29.490140] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:29.503893] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-19T17:16:29.518064] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T17:16:29.742012] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T17:16:30.243279] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-19T17:16:30.878773] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T17:16:31.043300] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-19T17:16:31.845978] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-19T17:16:31.848689] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T17:16:32.327379] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T17:16:32.643233] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-19T17:16:33.364202] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:16:33.443279] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-19T17:16:33.487944] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T17:16:34.243265] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-19T17:16:34.548868] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T17:16:35.043315] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-19T17:16:35.385092] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:16:35.843277] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-19T17:16:36.341860] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:16:36.643292] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-19T17:16:36.824855] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T17:16:37.430097] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T17:16:37.437544] [INFO ] [REMOTE ] APG: Full fetch complete (71437 records). [2025-09-19T17:16:37.437708] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-19T17:16:37.449710] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-19T17:16:37.843355] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-19T17:16:37.843441] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-19T17:16:37.844216] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-19T17:16:37.844281] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-19T17:16:37.849447] [DEBUG] [LOCAL ] APG: Trimmed 71437 records to 51009 (keeping 200 days of data) [2025-09-19T17:16:38.168331] [DEBUG] [LOCAL ] APG: Primary data saved (51009 records). [2025-09-19T17:16:38.168471] [INFO ] [MAIN ] APG: Full history saved. [2025-09-19T17:16:38.168568] [INFO ] [MAIN ] Update Progress: 130/2372 symbols completed. APG took 33.2s. Estimated remaining: 4h 45m 41s. Rate: 7.8 symbols/min [2025-09-19T17:16:38.248384] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-19T17:16:38.344683] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:38.355335] [DEBUG] [LOCAL ] APOS: Loaded 7503 existing records from primary storage. [2025-09-19T17:16:38.355475] [INFO ] [MAIN ] APOS: Loaded 7503 existing records. [2025-09-19T17:16:38.553426] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:38.554046] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-19T17:16:38.554107] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-19T17:16:38.555018] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-19T17:16:38.555083] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-19T17:16:38.825400] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:16:38.985392] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:39.043257] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-19T17:16:39.615752] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:16:39.843250] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-19T17:16:40.229248] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:16:40.256060] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T17:16:40.643275] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-19T17:16:41.443246] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-19T17:16:41.516760] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:16:42.239020] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T17:16:42.243231] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-19T17:16:43.043258] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-19T17:16:43.095522] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-19T17:16:43.161399] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T17:16:43.843260] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-19T17:16:44.454385] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:16:44.643261] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-19T17:16:45.443267] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-19T17:16:46.243246] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-19T17:16:46.282387] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T17:16:46.307039] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T17:16:46.317069] [INFO ] [REMOTE ] APH: Full fetch complete (77682 records). [2025-09-19T17:16:46.317245] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-19T17:16:46.715265] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-19T17:16:46.715450] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-19T17:16:46.716306] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-19T17:16:46.716387] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-19T17:16:46.718356] [DEBUG] [LOCAL ] APH: Trimmed 77682 records to 54471 (keeping 200 days of data) [2025-09-19T17:16:46.747617] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:16:47.060755] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-19T17:16:47.116556] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-09-19T17:16:47.116723] [INFO ] [MAIN ] APH: Full history saved. [2025-09-19T17:16:47.116850] [INFO ] [MAIN ] Update Progress: 131/2372 symbols completed. APH took 33.8s. Estimated remaining: 4h 45m 56s. Rate: 7.8 symbols/min [2025-09-19T17:16:47.291723] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:47.347734] [DEBUG] [LOCAL ] APTV: Loaded 52636 existing records from primary storage. [2025-09-19T17:16:47.347884] [INFO ] [MAIN ] APTV: Loaded 52636 existing records. [2025-09-19T17:16:47.528981] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:47.529232] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-19T17:16:47.529281] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-19T17:16:47.533517] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-19T17:16:47.533583] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-19T17:16:47.848385] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-19T17:16:47.904224] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:48.418938] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:16:48.643280] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-19T17:16:48.691763] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-19T17:16:49.112297] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-19T17:16:49.416953] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T17:16:49.443217] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-19T17:16:50.243353] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-19T17:16:51.043303] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-19T17:16:51.199251] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T17:16:51.234254] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T17:16:51.843266] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-19T17:16:52.640744] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T17:16:52.643224] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-19T17:16:52.825268] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T17:16:53.443272] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-19T17:16:53.552141] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T17:16:54.243274] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-19T17:16:55.043260] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-19T17:16:55.104862] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T17:16:55.106740] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T17:16:55.108877] [INFO ] [REMOTE ] APOS: Full fetch complete (10418 records). [2025-09-19T17:16:55.119777] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-19T17:16:55.496426] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-19T17:16:55.496517] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-19T17:16:55.496785] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-19T17:16:55.496871] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-19T17:16:55.497379] [DEBUG] [LOCAL ] APOS: Trimmed 10418 records to 7543 (keeping 200 days of data) [2025-09-19T17:16:55.543570] [DEBUG] [LOCAL ] APOS: Primary data saved (7543 records). [2025-09-19T17:16:55.543729] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-19T17:16:55.543821] [INFO ] [MAIN ] Update Progress: 132/2372 symbols completed. APOS took 17.4s. Estimated remaining: 4h 46m 1s. Rate: 7.8 symbols/min [2025-09-19T17:16:55.718284] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:55.773094] [DEBUG] [LOCAL ] AQN: Loaded 52366 existing records from primary storage. [2025-09-19T17:16:55.773251] [INFO ] [MAIN ] AQN: Loaded 52366 existing records. [2025-09-19T17:16:55.848376] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-19T17:16:55.956080] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:55.956339] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-19T17:16:55.956386] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-19T17:16:55.959528] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-19T17:16:55.959592] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-19T17:16:56.329106] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:56.643256] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-19T17:16:57.178717] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T17:16:57.443281] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-19T17:16:57.886892] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T17:16:57.977664] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T17:16:58.243309] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-19T17:16:59.043271] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-19T17:16:59.180711] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:16:59.843242] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-19T17:16:59.939931] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T17:17:00.643237] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-19T17:17:01.167174] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T17:17:01.302820] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:17:01.314022] [INFO ] [REMOTE ] APLE: Full fetch complete (73871 records). [2025-09-19T17:17:01.314322] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-19T17:17:01.315956] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:17:01.316088] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:17:01.316159] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:17:01.316231] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-19T17:17:01.316309] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-09-19T17:17:01.316364] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-09-19T17:17:01.317222] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-09-19T17:17:01.317367] [INFO ] [MAIN ] Update Progress: 133/2372 symbols completed. APLE took 34.2s. Estimated remaining: 4h 45m 22s. Rate: 7.8 symbols/min [2025-09-19T17:17:01.448402] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-19T17:17:01.508850] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:01.515731] [DEBUG] [LOCAL ] AQNB: Loaded 4254 existing records from primary storage. [2025-09-19T17:17:01.515847] [INFO ] [MAIN ] AQNB: Loaded 4254 existing records. [2025-09-19T17:17:01.713519] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:01.713958] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-19T17:17:01.714058] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-19T17:17:01.714578] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-19T17:17:01.714682] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-19T17:17:02.110314] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:02.243287] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-19T17:17:02.824897] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T17:17:02.955118] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T17:17:03.043279] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-19T17:17:03.377533] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:17:03.843286] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-19T17:17:04.643308] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-19T17:17:05.265551] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T17:17:05.443240] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-19T17:17:05.879258] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:17:06.066696] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T17:17:06.243269] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-19T17:17:06.599096] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T17:17:07.043264] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-19T17:17:07.739687] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T17:17:07.843232] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-19T17:17:08.643310] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-19T17:17:08.965687] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-19T17:17:09.043538] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:17:09.123782] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T17:17:09.443263] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-19T17:17:10.243322] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-19T17:17:11.031257] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T17:17:11.043216] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-19T17:17:11.843276] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-19T17:17:11.872807] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-19T17:17:11.881615] [INFO ] [REMOTE ] APO: Full fetch complete (77286 records). [2025-09-19T17:17:11.881833] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-19T17:17:12.202724] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T17:17:12.338279] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-19T17:17:12.338368] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-19T17:17:12.339169] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-19T17:17:12.339239] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-19T17:17:12.340856] [DEBUG] [LOCAL ] APO: Trimmed 77286 records to 54162 (keeping 200 days of data) [2025-09-19T17:17:12.659893] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-19T17:17:12.721011] [DEBUG] [LOCAL ] APO: Primary data saved (54162 records). [2025-09-19T17:17:12.721169] [INFO ] [MAIN ] APO: Full history saved. [2025-09-19T17:17:12.723704] [INFO ] [MAIN ] Update Progress: 134/2372 symbols completed. APO took 44.1s. Estimated remaining: 4h 46m 17s. Rate: 7.8 symbols/min [2025-09-19T17:17:12.896324] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:12.896505] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-09-19T17:17:12.896542] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-09-19T17:17:12.896728] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-19T17:17:12.896811] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-19T17:17:12.896901] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-09-19T17:17:12.896970] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-19T17:17:13.189385] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-19T17:17:13.259286] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:13.443258] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-19T17:17:13.952408] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T17:17:14.243303] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-19T17:17:15.018108] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T17:17:15.043248] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-19T17:17:15.613007] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T17:17:15.679161] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T17:17:15.843286] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-19T17:17:16.509597] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T17:17:16.643379] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-19T17:17:17.443283] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-19T17:17:18.243326] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-19T17:17:18.537368] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T17:17:19.043283] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-19T17:17:19.791800] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T17:17:19.843225] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-19T17:17:20.330549] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T17:17:20.643290] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-19T17:17:21.052294] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T17:17:21.176010] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:17:21.443280] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-19T17:17:22.243271] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-19T17:17:23.046788] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T17:17:23.046575] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-19T17:17:23.049155] [INFO ] [REMOTE ] AQNB: Full fetch complete (5954 records). [2025-09-19T17:17:23.049229] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-19T17:17:23.259759] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T17:17:23.485383] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-19T17:17:23.485467] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-19T17:17:23.485663] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-19T17:17:23.485723] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-19T17:17:23.486102] [DEBUG] [LOCAL ] AQNB: Trimmed 5954 records to 4281 (keeping 200 days of data) [2025-09-19T17:17:23.513124] [DEBUG] [LOCAL ] AQNB: Primary data saved (4281 records). [2025-09-19T17:17:23.513195] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-19T17:17:23.513269] [INFO ] [MAIN ] Update Progress: 135/2372 symbols completed. AQNB took 22.2s. Estimated remaining: 4h 47m 1s. Rate: 7.8 symbols/min [2025-09-19T17:17:23.681085] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:23.738380] [DEBUG] [LOCAL ] ARCO: Loaded 45022 existing records from primary storage. [2025-09-19T17:17:23.738582] [INFO ] [MAIN ] ARCO: Loaded 45022 existing records. [2025-09-19T17:17:23.844848] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-19T17:17:23.986958] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:24.002528] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-19T17:17:24.002837] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-19T17:17:24.005344] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-19T17:17:24.016165] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-19T17:17:24.016637] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-19T17:17:24.409769] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:24.643298] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-19T17:17:25.331770] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-19T17:17:25.392604] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:17:25.443251] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-19T17:17:26.243317] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-19T17:17:26.541315] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T17:17:27.043297] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-19T17:17:27.357498] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T17:17:27.365160] [INFO ] [REMOTE ] AQN: Full fetch complete (75260 records). [2025-09-19T17:17:27.365293] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-19T17:17:27.764950] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-19T17:17:27.765039] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-19T17:17:27.765824] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-19T17:17:27.765889] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-19T17:17:27.767398] [DEBUG] [LOCAL ] AQN: Trimmed 75260 records to 52736 (keeping 200 days of data) [2025-09-19T17:17:27.855810] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-19T17:17:28.091395] [DEBUG] [LOCAL ] AQN: Primary data saved (52736 records). [2025-09-19T17:17:28.091542] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-19T17:17:28.091670] [INFO ] [MAIN ] Update Progress: 136/2372 symbols completed. AQN took 32.5s. Estimated remaining: 4h 46m 2s. Rate: 7.8 symbols/min [2025-09-19T17:17:28.269438] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:28.269668] [DEBUG] [LOCAL ] ARDC: No existing data file found in primary storage. [2025-09-19T17:17:28.269726] [WARN ] [MAIN ] ARDC: No existing data found, performing full refresh instead. [2025-09-19T17:17:28.269892] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-19T17:17:28.269943] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-19T17:17:28.269984] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-09-19T17:17:28.270016] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-19T17:17:28.636884] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:28.643212] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-19T17:17:28.746731] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T17:17:28.913987] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:17:29.341311] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T17:17:29.443289] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-19T17:17:29.662858] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T17:17:29.670067] [INFO ] [REMOTE ] APTV: Full fetch complete (75694 records). [2025-09-19T17:17:29.670196] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-19T17:17:29.671080] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:17:29.671179] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:17:29.671222] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:17:29.671261] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-19T17:17:29.671318] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-09-19T17:17:29.671352] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-09-19T17:17:29.671876] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-09-19T17:17:29.671973] [INFO ] [MAIN ] Update Progress: 137/2372 symbols completed. APTV took 42.6s. Estimated remaining: 4h 44m 15s. Rate: 7.9 symbols/min [2025-09-19T17:17:29.842794] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:29.872690] [DEBUG] [LOCAL ] ARDT: Loaded 28901 existing records from primary storage. [2025-09-19T17:17:29.872838] [INFO ] [MAIN ] ARDT: Loaded 28901 existing records. [2025-09-19T17:17:30.059080] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:30.059361] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-19T17:17:30.059410] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-19T17:17:30.060695] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-19T17:17:30.060758] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-19T17:17:30.253082] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-19T17:17:30.429466] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:30.443707] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T17:17:31.043270] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-19T17:17:31.843327] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-19T17:17:32.029694] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T17:17:32.380414] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T17:17:32.643273] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-19T17:17:33.443245] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-19T17:17:33.507869] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T17:17:34.243256] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-19T17:17:34.594851] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T17:17:34.722999] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T17:17:35.043263] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-19T17:17:35.843287] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-19T17:17:36.407292] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T17:17:36.643270] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-19T17:17:37.064382] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:17:37.098469] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T17:17:37.443265] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-19T17:17:38.198728] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:17:38.243223] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-19T17:17:39.043304] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-19T17:17:39.383526] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:17:39.777504] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T17:17:39.789325] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T17:17:39.843234] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-19T17:17:40.643283] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-19T17:17:41.443270] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-19T17:17:42.115152] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T17:17:42.123076] [INFO ] [REMOTE ] AR: Full fetch complete (77524 records). [2025-09-19T17:17:42.123220] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-19T17:17:42.248336] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-19T17:17:42.548048] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-19T17:17:42.557356] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-19T17:17:42.558557] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-19T17:17:42.560034] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T17:17:42.563572] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-19T17:17:42.601737] [DEBUG] [LOCAL ] AR: Trimmed 77524 records to 54365 (keeping 200 days of data) [2025-09-19T17:17:42.604261] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T17:17:42.945422] [DEBUG] [LOCAL ] AR: Primary data saved (54365 records). [2025-09-19T17:17:42.945566] [INFO ] [MAIN ] AR: Full history saved. [2025-09-19T17:17:42.945684] [INFO ] [MAIN ] Update Progress: 138/2372 symbols completed. AR took 30.2s. Estimated remaining: 4h 45m 39s. Rate: 7.8 symbols/min [2025-09-19T17:17:43.046138] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-19T17:17:43.122355] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:43.175848] [DEBUG] [LOCAL ] ARE: Loaded 50937 existing records from primary storage. [2025-09-19T17:17:43.176024] [INFO ] [MAIN ] ARE: Loaded 50937 existing records. [2025-09-19T17:17:43.356227] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:43.356493] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-19T17:17:43.356543] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-19T17:17:43.358709] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-19T17:17:43.358772] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-19T17:17:43.718157] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:43.843261] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-19T17:17:43.881716] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:17:43.995235] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:17:44.643262] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-19T17:17:45.443243] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-19T17:17:45.704744] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T17:17:46.016372] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T17:17:46.243300] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-19T17:17:46.998213] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T17:17:47.043230] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-19T17:17:47.843224] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-19T17:17:48.146497] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T17:17:48.414154] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T17:17:48.643300] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-19T17:17:49.443281] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-19T17:17:49.837509] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:17:49.840083] [INFO ] [REMOTE ] ARDC: Full fetch complete (20228 records). [2025-09-19T17:17:49.840171] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-19T17:17:50.219756] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-19T17:17:50.220014] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-19T17:17:50.220344] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-19T17:17:50.229788] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-19T17:17:50.246464] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-19T17:17:50.251458] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-19T17:17:50.248476] [DEBUG] [LOCAL ] ARDC: Trimmed 20228 records to 14872 (keeping 200 days of data) [2025-09-19T17:17:50.360294] [DEBUG] [LOCAL ] ARDC: Primary data saved (14872 records). [2025-09-19T17:17:50.360504] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-19T17:17:50.360622] [INFO ] [MAIN ] Update Progress: 139/2372 symbols completed. ARDC took 22.3s. Estimated remaining: 4h 45m 27s. Rate: 7.8 symbols/min [2025-09-19T17:17:50.544102] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:50.566173] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T17:17:50.623053] [DEBUG] [LOCAL ] ARES: Loaded 50098 existing records from primary storage. [2025-09-19T17:17:50.623246] [INFO ] [MAIN ] ARES: Loaded 50098 existing records. [2025-09-19T17:17:50.806264] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:50.806509] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-19T17:17:50.806559] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-19T17:17:50.809579] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-19T17:17:50.809683] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-19T17:17:51.048599] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-19T17:17:51.197752] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:51.511701] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T17:17:51.843273] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-19T17:17:52.643273] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-19T17:17:53.008169] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:17:53.443298] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-19T17:17:53.787695] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T17:17:54.189243] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T17:17:54.243274] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-19T17:17:54.803454] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T17:17:54.811859] [INFO ] [REMOTE ] ARCO: Full fetch complete (65757 records). [2025-09-19T17:17:54.812046] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-19T17:17:55.048404] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-19T17:17:55.243255] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-19T17:17:55.243344] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-19T17:17:55.244128] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-19T17:17:55.244197] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-19T17:17:55.245872] [DEBUG] [LOCAL ] ARCO: Trimmed 65757 records to 45295 (keeping 200 days of data) [2025-09-19T17:17:55.537215] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T17:17:55.544166] [DEBUG] [LOCAL ] ARCO: Primary data saved (45295 records). [2025-09-19T17:17:55.544565] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-19T17:17:55.545361] [INFO ] [MAIN ] Update Progress: 140/2372 symbols completed. ARCO took 32.0s. Estimated remaining: 4h 44m 39s. Rate: 7.8 symbols/min [2025-09-19T17:17:55.723732] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:55.770464] [DEBUG] [LOCAL ] ARI: Loaded 43621 existing records from primary storage. [2025-09-19T17:17:55.770620] [INFO ] [MAIN ] ARI: Loaded 43621 existing records. [2025-09-19T17:17:55.851591] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-19T17:17:55.971391] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:55.971783] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-19T17:17:55.971843] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-19T17:17:55.973865] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-19T17:17:55.973928] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-19T17:17:56.351339] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:56.643266] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-19T17:17:57.274788] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T17:17:57.443236] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-19T17:17:57.915295] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T17:17:58.013502] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T17:17:58.243260] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-19T17:17:58.712613] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T17:17:59.043273] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-19T17:17:59.492527] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T17:17:59.843291] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-19T17:18:00.396604] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T17:18:00.643277] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-19T17:18:01.370910] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T17:18:01.443269] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-19T17:18:02.243280] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-19T17:18:02.405975] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T17:18:03.043272] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-19T17:18:03.843271] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-19T17:18:04.620597] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-19T17:18:04.643224] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-19T17:18:04.729603] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (3.29 seconds). [2025-09-19T17:18:05.103034] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:18:05.443268] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-19T17:18:05.711615] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:18:06.243309] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-19T17:18:07.049708] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-19T17:18:07.069961] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:18:07.843260] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-19T17:18:08.028420] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T17:18:08.032741] [INFO ] [REMOTE ] ARDT: Full fetch complete (41202 records). [2025-09-19T17:18:08.032838] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-19T17:18:08.410893] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-19T17:18:08.411116] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-19T17:18:08.411711] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-19T17:18:08.412026] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-19T17:18:08.414145] [DEBUG] [LOCAL ] ARDT: Trimmed 41202 records to 29081 (keeping 200 days of data) [2025-09-19T17:18:08.589830] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T17:18:08.628393] [DEBUG] [LOCAL ] ARDT: Primary data saved (29081 records). [2025-09-19T17:18:08.629128] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-19T17:18:08.629700] [INFO ] [MAIN ] Update Progress: 141/2372 symbols completed. ARDT took 39.0s. Estimated remaining: 4h 45m 58s. Rate: 7.8 symbols/min [2025-09-19T17:18:08.651488] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-19T17:18:08.790693] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (4.15 seconds). [2025-09-19T17:18:08.859341] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:08.900747] [DEBUG] [LOCAL ] ARIS: Loaded 42356 existing records from primary storage. [2025-09-19T17:18:08.900895] [INFO ] [MAIN ] ARIS: Loaded 42356 existing records. [2025-09-19T17:18:09.088770] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:09.089172] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-19T17:18:09.089306] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-19T17:18:09.098683] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-19T17:18:09.112542] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-19T17:18:09.178661] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T17:18:09.446047] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-19T17:18:09.482159] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:10.243323] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-19T17:18:10.738664] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T17:18:10.855074] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T17:18:11.043323] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-19T17:18:11.742957] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:18:11.843295] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-19T17:18:12.643290] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-19T17:18:12.913178] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T17:18:12.971580] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T17:18:13.443282] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-19T17:18:14.243274] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-19T17:18:14.578513] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:18:15.043283] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-19T17:18:15.518974] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T17:18:15.557785] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T17:18:15.843276] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-19T17:18:16.217968] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:18:16.643268] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-19T17:18:17.105977] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T17:18:17.443327] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-19T17:18:18.243254] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-19T17:18:18.345104] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T17:18:18.973875] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T17:18:18.981506] [INFO ] [REMOTE ] ARE: Full fetch complete (72678 records). [2025-09-19T17:18:18.981741] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-19T17:18:19.055412] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-19T17:18:19.408169] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-19T17:18:19.408259] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-19T17:18:19.409552] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-19T17:18:19.409631] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-19T17:18:19.411235] [DEBUG] [LOCAL ] ARE: Trimmed 72678 records to 51282 (keeping 200 days of data) [2025-09-19T17:18:19.725978] [DEBUG] [LOCAL ] ARE: Primary data saved (51282 records). [2025-09-19T17:18:19.726128] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-19T17:18:19.726213] [INFO ] [MAIN ] Update Progress: 142/2372 symbols completed. ARE took 36.8s. Estimated remaining: 4h 46m 44s. Rate: 7.8 symbols/min [2025-09-19T17:18:19.848420] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-19T17:18:19.904246] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:19.949110] [DEBUG] [LOCAL ] ARLO: Loaded 44533 existing records from primary storage. [2025-09-19T17:18:19.949294] [INFO ] [MAIN ] ARLO: Loaded 44533 existing records. [2025-09-19T17:18:20.145212] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:20.145462] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-19T17:18:20.145511] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-19T17:18:20.147728] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-19T17:18:20.147807] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-19T17:18:20.561286] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:20.643293] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-19T17:18:20.683770] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T17:18:21.076042] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T17:18:21.443281] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-19T17:18:21.734719] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T17:18:21.742621] [INFO ] [REMOTE ] ARES: Full fetch complete (70557 records). [2025-09-19T17:18:21.742789] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-19T17:18:22.146781] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-19T17:18:22.146888] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-19T17:18:22.147616] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-19T17:18:22.147707] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-19T17:18:22.150019] [DEBUG] [LOCAL ] ARES: Trimmed 70557 records to 50464 (keeping 200 days of data) [2025-09-19T17:18:22.244237] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-19T17:18:22.476180] [DEBUG] [LOCAL ] ARES: Primary data saved (50464 records). [2025-09-19T17:18:22.476323] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-19T17:18:22.476425] [INFO ] [MAIN ] Update Progress: 143/2372 symbols completed. ARES took 32.1s. Estimated remaining: 4h 45m 18s. Rate: 7.8 symbols/min [2025-09-19T17:18:22.656390] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:18:22.690993] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:22.691166] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-09-19T17:18:22.691221] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-09-19T17:18:22.691444] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-19T17:18:22.691522] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-19T17:18:22.691602] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-19T17:18:22.691699] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-19T17:18:23.066366] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-19T17:18:23.066258] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:23.095434] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T17:18:23.505818] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T17:18:23.843271] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-19T17:18:24.643280] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-19T17:18:25.070932] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:18:25.193767] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T17:18:25.443269] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-19T17:18:26.243327] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-19T17:18:26.482898] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:18:26.496354] [INFO ] [REMOTE ] ARI: Full fetch complete (62735 records). [2025-09-19T17:18:26.496627] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-19T17:18:26.935409] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-19T17:18:26.935533] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-19T17:18:26.936462] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-19T17:18:26.936567] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-19T17:18:26.938247] [DEBUG] [LOCAL ] ARI: Trimmed 62735 records to 43976 (keeping 200 days of data) [2025-09-19T17:18:27.047685] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-19T17:18:27.070063] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T17:18:27.260097] [DEBUG] [LOCAL ] ARI: Primary data saved (43976 records). [2025-09-19T17:18:27.260240] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-19T17:18:27.262900] [INFO ] [MAIN ] Update Progress: 144/2372 symbols completed. ARI took 31.7s. Estimated remaining: 4h 44m 26s. Rate: 7.8 symbols/min [2025-09-19T17:18:27.449756] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:27.505479] [DEBUG] [LOCAL ] AROC: Loaded 49382 existing records from primary storage. [2025-09-19T17:18:27.505672] [INFO ] [MAIN ] AROC: Loaded 49382 existing records. [2025-09-19T17:18:27.702893] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:27.703422] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-19T17:18:27.703583] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-19T17:18:27.706041] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-19T17:18:27.706140] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-19T17:18:27.848432] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-19T17:18:28.051756] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T17:18:28.147219] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:28.288415] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T17:18:28.643311] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-19T17:18:29.443322] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-19T17:18:29.758877] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:18:30.250416] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-19T17:18:30.253807] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T17:18:31.043268] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-19T17:18:31.304838] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T17:18:31.437908] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T17:18:31.843271] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-19T17:18:32.643276] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-19T17:18:32.875363] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T17:18:33.261441] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T17:18:33.443277] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-19T17:18:34.201727] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:18:34.243257] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-19T17:18:35.043277] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-19T17:18:35.588760] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T17:18:35.843279] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-19T17:18:35.970049] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T17:18:36.643265] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-19T17:18:37.094713] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T17:18:37.145676] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T17:18:37.443269] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-19T17:18:37.862121] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T17:18:38.243264] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-19T17:18:39.043285] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-19T17:18:39.468062] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T17:18:39.561934] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T17:18:39.572922] [INFO ] [REMOTE ] ARIS: Full fetch complete (59696 records). [2025-09-19T17:18:39.573133] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-19T17:18:39.848350] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-19T17:18:39.977214] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-19T17:18:39.977318] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-19T17:18:39.977983] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-19T17:18:39.978047] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-19T17:18:39.979266] [DEBUG] [LOCAL ] ARIS: Trimmed 59696 records to 42669 (keeping 200 days of data) [2025-09-19T17:18:40.257481] [DEBUG] [LOCAL ] ARIS: Primary data saved (42669 records). [2025-09-19T17:18:40.257626] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-19T17:18:40.257787] [INFO ] [MAIN ] Update Progress: 145/2372 symbols completed. ARIS took 31.6s. Estimated remaining: 4h 45m 40s. Rate: 7.8 symbols/min [2025-09-19T17:18:40.430102] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:40.490586] [DEBUG] [LOCAL ] ARR: Loaded 52416 existing records from primary storage. [2025-09-19T17:18:40.490779] [INFO ] [MAIN ] ARR: Loaded 52416 existing records. [2025-09-19T17:18:40.653734] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-19T17:18:40.676441] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:40.676727] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-19T17:18:40.676784] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-19T17:18:40.678798] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-19T17:18:40.679050] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-19T17:18:41.056747] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:41.088365] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T17:18:41.284077] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T17:18:41.443229] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-19T17:18:42.243276] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-19T17:18:42.677926] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T17:18:43.043279] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-19T17:18:43.272630] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T17:18:43.843279] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-19T17:18:43.880330] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T17:18:44.369869] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T17:18:44.643268] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-19T17:18:45.443277] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-19T17:18:45.658120] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:18:46.243260] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-19T17:18:46.580531] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:18:46.755898] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:18:47.043315] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-19T17:18:47.843318] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-19T17:18:48.259718] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T17:18:48.420243] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T17:18:48.428459] [INFO ] [REMOTE ] ARLO: Full fetch complete (62559 records). [2025-09-19T17:18:48.428563] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-19T17:18:48.651274] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-19T17:18:48.832780] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-19T17:18:48.832868] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-19T17:18:48.833479] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-19T17:18:48.833519] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-19T17:18:48.834801] [DEBUG] [LOCAL ] ARLO: Trimmed 62559 records to 44833 (keeping 200 days of data) [2025-09-19T17:18:49.099935] [DEBUG] [LOCAL ] ARLO: Primary data saved (44833 records). [2025-09-19T17:18:49.100074] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-19T17:18:49.100188] [INFO ] [MAIN ] Update Progress: 146/2372 symbols completed. ARLO took 29.4s. Estimated remaining: 4h 45m 50s. Rate: 7.8 symbols/min [2025-09-19T17:18:49.283812] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:49.325162] [DEBUG] [LOCAL ] ARW: Loaded 33464 existing records from primary storage. [2025-09-19T17:18:49.325397] [INFO ] [MAIN ] ARW: Loaded 33464 existing records. [2025-09-19T17:18:49.449862] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-19T17:18:49.463675] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T17:18:49.555593] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:49.555854] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-19T17:18:49.555902] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-19T17:18:49.557321] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-19T17:18:49.557382] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-19T17:18:49.924438] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:50.243278] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-19T17:18:50.704266] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T17:18:50.714721] [INFO ] [REMOTE ] ARMK: Full fetch complete (72506 records). [2025-09-19T17:18:50.714888] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-19T17:18:51.048385] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-19T17:18:51.126336] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-19T17:18:51.126439] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-19T17:18:51.127197] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-19T17:18:51.127265] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-19T17:18:51.128753] [DEBUG] [LOCAL ] ARMK: Trimmed 72506 records to 51064 (keeping 200 days of data) [2025-09-19T17:18:51.400834] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:18:51.440599] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T17:18:51.524278] [DEBUG] [LOCAL ] ARMK: Primary data saved (51064 records). [2025-09-19T17:18:51.524417] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-19T17:18:51.524496] [INFO ] [MAIN ] Update Progress: 147/2372 symbols completed. ARMK took 29.0s. Estimated remaining: 4h 44m 22s. Rate: 7.8 symbols/min [2025-09-19T17:18:51.704980] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:51.705149] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-19T17:18:51.705187] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-19T17:18:51.705370] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-19T17:18:51.705413] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-19T17:18:51.705475] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-19T17:18:51.705509] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-19T17:18:51.853524] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-19T17:18:52.065110] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:52.643279] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-19T17:18:53.275031] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-19T17:18:53.443261] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-19T17:18:53.776533] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T17:18:53.951729] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:18:54.243303] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-19T17:18:54.459330] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:18:54.459683] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-19T17:18:55.043241] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-19T17:18:55.108233] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:18:55.251504] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:18:55.251874] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-19T17:18:55.843285] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-19T17:18:56.643264] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-19T17:18:57.443281] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-19T17:18:57.673239] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:18:57.673585] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-19T17:18:57.830947] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T17:18:57.934219] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T17:18:58.243278] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-19T17:18:59.043312] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-19T17:18:59.843286] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-19T17:19:00.210194] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T17:19:00.643276] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-19T17:19:01.056461] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T17:19:01.064475] [INFO ] [REMOTE ] AROC: Full fetch complete (70507 records). [2025-09-19T17:19:01.064620] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-19T17:19:01.458255] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-19T17:19:01.500059] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-19T17:19:01.500189] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-19T17:19:01.500978] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-19T17:19:01.501188] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-19T17:19:01.503285] [DEBUG] [LOCAL ] AROC: Trimmed 70507 records to 49755 (keeping 200 days of data) [2025-09-19T17:19:01.765530] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T17:19:01.766143] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:19:01.783373] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-19T17:19:01.881699] [DEBUG] [LOCAL ] AROC: Primary data saved (49755 records). [2025-09-19T17:19:01.881849] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-19T17:19:01.882465] [INFO ] [MAIN ] Update Progress: 148/2372 symbols completed. AROC took 34.6s. Estimated remaining: 4h 44m 55s. Rate: 7.8 symbols/min [2025-09-19T17:19:02.061397] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:02.122351] [DEBUG] [LOCAL ] AS: Loaded 53456 existing records from primary storage. [2025-09-19T17:19:02.122515] [INFO ] [MAIN ] AS: Loaded 53456 existing records. [2025-09-19T17:19:02.248477] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-19T17:19:02.310748] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:02.310989] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-19T17:19:02.311037] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-19T17:19:02.312751] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-19T17:19:02.312817] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-19T17:19:02.708151] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:02.736467] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T17:19:03.043294] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-19T17:19:03.843288] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-19T17:19:03.953148] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T17:19:04.063319] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:19:04.063660] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-19T17:19:04.643264] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-19T17:19:04.881448] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:19:04.881836] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-19T17:19:05.079585] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T17:19:05.443300] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-19T17:19:06.243275] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-19T17:19:06.499601] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:19:06.500026] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-19T17:19:07.043325] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-19T17:19:07.452390] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T17:19:07.843269] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-19T17:19:08.643280] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-19T17:19:08.894118] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T17:19:09.443248] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-19T17:19:09.816912] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T17:19:09.911990] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T17:19:10.243295] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-19T17:19:11.043291] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-19T17:19:11.187294] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:19:11.807494] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T17:19:11.843225] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-19T17:19:12.643272] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-19T17:19:12.777949] [DEBUG] [REMOTE ] ARW: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-19T17:19:12.778274] [WARN ] [REMOTE ] ARW: No data returned for month 2025-07 [2025-09-19T17:19:13.443322] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-19T17:19:13.515303] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T17:19:13.580048] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T17:19:14.243300] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-19T17:19:14.984241] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:19:15.043258] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-19T17:19:15.843275] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-19T17:19:16.167398] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T17:19:16.643273] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-19T17:19:16.849477] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T17:19:16.854711] [INFO ] [REMOTE ] ARW: Full fetch complete (43089 records). [2025-09-19T17:19:16.854815] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-19T17:19:17.048292] [WARN ] [VALIDATOR ] ARW: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T17:19:17.049041] [FATAL] [MAIN ] ARW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:19:17.049114] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:19:17.049214] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-19T17:19:17.049348] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-09-19T17:19:17.049418] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-09-19T17:19:17.050133] [DEBUG] [LOCAL ] ARW: Deleted derivative data file. [2025-09-19T17:19:17.050242] [INFO ] [MAIN ] Update Progress: 149/2372 symbols completed. ARW took 27.9s. Estimated remaining: 4h 46m 39s. Rate: 7.8 symbols/min [2025-09-19T17:19:17.223452] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:17.239249] [DEBUG] [LOCAL ] ASA: Loaded 13569 existing records from primary storage. [2025-09-19T17:19:17.239374] [INFO ] [MAIN ] ASA: Loaded 13569 existing records. [2025-09-19T17:19:17.438053] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:17.438298] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-19T17:19:17.438345] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-19T17:19:17.439067] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-19T17:19:17.439141] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-19T17:19:17.457195] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-19T17:19:17.837760] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:18.243283] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-19T17:19:18.421969] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T17:19:18.748493] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:19:18.754975] [INFO ] [REMOTE ] ARX: Full fetch complete (12696 records). [2025-09-19T17:19:18.755101] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-19T17:19:18.755634] [FATAL] [VALIDATOR ] ARX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:19:18.755749] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:19:18.755794] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:19:18.755833] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-19T17:19:18.755894] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-19T17:19:18.755930] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-19T17:19:18.755971] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-19T17:19:18.756028] [INFO ] [MAIN ] Update Progress: 150/2372 symbols completed. ARX took 27.2s. Estimated remaining: 4h 45m 2s. Rate: 7.8 symbols/min [2025-09-19T17:19:18.942858] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:18.999851] [DEBUG] [LOCAL ] ASAN: Loaded 53150 existing records from primary storage. [2025-09-19T17:19:19.000078] [INFO ] [MAIN ] ASAN: Loaded 53150 existing records. [2025-09-19T17:19:19.068709] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-19T17:19:19.196811] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:19.197173] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-19T17:19:19.197247] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-19T17:19:19.198385] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-19T17:19:19.198449] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-19T17:19:19.532920] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T17:19:19.608788] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:19.843282] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-19T17:19:19.887432] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-19T17:19:20.643292] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-19T17:19:20.871288] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T17:19:21.333911] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-19T17:19:21.443265] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-19T17:19:22.223924] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T17:19:22.243274] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-19T17:19:23.043272] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-19T17:19:23.082746] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-19T17:19:23.843269] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-19T17:19:23.989311] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T17:19:24.086080] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:19:24.094031] [INFO ] [REMOTE ] ARR: Full fetch complete (75038 records). [2025-09-19T17:19:24.094174] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-19T17:19:24.484631] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-19T17:19:24.484763] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-19T17:19:24.485506] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-19T17:19:24.485564] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-19T17:19:24.487256] [DEBUG] [LOCAL ] ARR: Trimmed 75038 records to 52797 (keeping 200 days of data) [2025-09-19T17:19:24.669695] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-19T17:19:24.819578] [DEBUG] [LOCAL ] ARR: Primary data saved (52797 records). [2025-09-19T17:19:24.819757] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-19T17:19:24.819864] [INFO ] [MAIN ] Update Progress: 151/2372 symbols completed. ARR took 44.6s. Estimated remaining: 4h 44m 30s. Rate: 7.8 symbols/min [2025-09-19T17:19:24.986941] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:25.035218] [DEBUG] [LOCAL ] ASB: Loaded 50015 existing records from primary storage. [2025-09-19T17:19:25.035371] [INFO ] [MAIN ] ASB: Loaded 50015 existing records. [2025-09-19T17:19:25.224257] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:25.224717] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-19T17:19:25.225009] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-19T17:19:25.226409] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-19T17:19:25.226497] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-19T17:19:25.459380] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-19T17:19:25.479248] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:19:25.664933] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:25.918967] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T17:19:26.243271] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-19T17:19:27.043336] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-19T17:19:27.076145] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T17:19:27.843341] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-19T17:19:28.056747] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:19:28.475558] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:19:28.643252] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-19T17:19:29.443271] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-19T17:19:29.912189] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T17:19:30.243267] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-19T17:19:30.549735] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:19:31.043281] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-19T17:19:31.440245] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T17:19:31.601938] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T17:19:31.843266] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-19T17:19:32.643245] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-19T17:19:32.724529] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T17:19:33.443270] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-19T17:19:33.622330] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T17:19:34.243274] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-19T17:19:34.725531] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T17:19:34.734707] [INFO ] [REMOTE ] AS: Full fetch complete (76510 records). [2025-09-19T17:19:34.734891] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-19T17:19:35.056217] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-19T17:19:35.199188] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-19T17:19:35.199282] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-19T17:19:35.200060] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-19T17:19:35.200125] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-19T17:19:35.201894] [DEBUG] [LOCAL ] AS: Trimmed 76510 records to 53846 (keeping 200 days of data) [2025-09-19T17:19:35.232422] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:19:35.573021] [DEBUG] [LOCAL ] AS: Primary data saved (53846 records). [2025-09-19T17:19:35.573203] [INFO ] [MAIN ] AS: Full history saved. [2025-09-19T17:19:35.573923] [INFO ] [MAIN ] Update Progress: 152/2372 symbols completed. AS took 33.7s. Estimated remaining: 4h 45m 7s. Rate: 7.8 symbols/min [2025-09-19T17:19:35.750929] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:35.756714] [DEBUG] [LOCAL ] ASBA: Loaded 3449 existing records from primary storage. [2025-09-19T17:19:35.756806] [INFO ] [MAIN ] ASBA: Loaded 3449 existing records. [2025-09-19T17:19:35.850331] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-19T17:19:35.943664] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:35.943949] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-19T17:19:35.944003] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-19T17:19:35.944318] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-19T17:19:35.944379] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-19T17:19:36.140901] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T17:19:36.339992] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:36.371827] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T17:19:36.643265] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-19T17:19:37.443320] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-19T17:19:37.937878] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T17:19:38.243260] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-19T17:19:38.489163] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T17:19:38.643078] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:19:39.043257] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-19T17:19:39.843268] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-19T17:19:40.403794] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T17:19:40.447870] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T17:19:40.489084] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T17:19:40.643276] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-19T17:19:41.443261] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-19T17:19:41.591225] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T17:19:42.243266] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-19T17:19:42.899624] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:19:42.903341] [INFO ] [REMOTE ] ASA: Full fetch complete (18344 records). [2025-09-19T17:19:42.903431] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-19T17:19:43.048713] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-19T17:19:43.285740] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-19T17:19:43.285822] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-19T17:19:43.286120] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-19T17:19:43.286159] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-19T17:19:43.286749] [DEBUG] [LOCAL ] ASA: Trimmed 18344 records to 13682 (keeping 200 days of data) [2025-09-19T17:19:43.367103] [DEBUG] [LOCAL ] ASA: Primary data saved (13682 records). [2025-09-19T17:19:43.367251] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-19T17:19:43.367378] [INFO ] [MAIN ] Update Progress: 153/2372 symbols completed. ASA took 26.3s. Estimated remaining: 4h 45m 1s. Rate: 7.8 symbols/min [2025-09-19T17:19:43.539018] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:43.576561] [DEBUG] [LOCAL ] ASC: Loaded 38414 existing records from primary storage. [2025-09-19T17:19:43.576735] [INFO ] [MAIN ] ASC: Loaded 38414 existing records. [2025-09-19T17:19:43.683434] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-19T17:19:43.762804] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:43.763097] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-19T17:19:43.763152] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-19T17:19:43.764048] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-19T17:19:43.764112] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-19T17:19:43.848517] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-19T17:19:44.150116] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:44.179106] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:19:44.643281] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-19T17:19:45.056995] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T17:19:45.443265] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-19T17:19:46.243238] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-19T17:19:46.295773] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T17:19:46.865434] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T17:19:47.043331] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-19T17:19:47.843261] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-19T17:19:48.206898] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T17:19:48.416516] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:19:48.569561] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T17:19:48.643236] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-19T17:19:49.443306] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-19T17:19:50.243318] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-19T17:19:50.415822] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T17:19:50.442088] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T17:19:51.043345] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-19T17:19:51.535111] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-19T17:19:51.843274] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-19T17:19:52.187528] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T17:19:52.195124] [INFO ] [REMOTE ] ASB: Full fetch complete (71575 records). [2025-09-19T17:19:52.195292] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-19T17:19:52.583197] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-19T17:19:52.583282] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-19T17:19:52.584063] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-19T17:19:52.584128] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-19T17:19:52.585542] [DEBUG] [LOCAL ] ASB: Trimmed 71575 records to 50356 (keeping 200 days of data) [2025-09-19T17:19:52.647785] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-19T17:19:52.898525] [DEBUG] [LOCAL ] ASB: Primary data saved (50356 records). [2025-09-19T17:19:52.898753] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-19T17:19:52.898879] [INFO ] [MAIN ] Update Progress: 154/2372 symbols completed. ASB took 28.1s. Estimated remaining: 4h 45m 20s. Rate: 7.8 symbols/min [2025-09-19T17:19:53.070401] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:53.091463] [DEBUG] [LOCAL ] ASG: Loaded 21240 existing records from primary storage. [2025-09-19T17:19:53.091597] [INFO ] [MAIN ] ASG: Loaded 21240 existing records. [2025-09-19T17:19:53.270191] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:53.270461] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-19T17:19:53.270521] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-19T17:19:53.271098] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-19T17:19:53.271158] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-19T17:19:53.455475] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-19T17:19:53.640733] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:54.099502] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T17:19:54.154553] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:19:54.188828] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T17:19:54.243247] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-19T17:19:55.043299] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-19T17:19:55.709578] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:19:55.843276] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-19T17:19:56.643342] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-19T17:19:57.136978] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:19:57.418133] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T17:19:57.426042] [INFO ] [REMOTE ] ASAN: Full fetch complete (76548 records). [2025-09-19T17:19:57.426178] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-19T17:19:57.448346] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-19T17:19:57.500949] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T17:19:57.821876] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-19T17:19:57.821959] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-19T17:19:57.822730] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-19T17:19:57.822794] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-19T17:19:57.824330] [DEBUG] [LOCAL ] ASAN: Trimmed 76548 records to 53526 (keeping 200 days of data) [2025-09-19T17:19:58.141816] [DEBUG] [LOCAL ] ASAN: Primary data saved (53526 records). [2025-09-19T17:19:58.141983] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-19T17:19:58.142098] [INFO ] [MAIN ] Update Progress: 155/2372 symbols completed. ASAN took 39.4s. Estimated remaining: 4h 44m 36s. Rate: 7.8 symbols/min [2025-09-19T17:19:58.248343] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-19T17:19:58.312587] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:58.335789] [DEBUG] [LOCAL ] ASGI: Loaded 22345 existing records from primary storage. [2025-09-19T17:19:58.335943] [INFO ] [MAIN ] ASGI: Loaded 22345 existing records. [2025-09-19T17:19:58.509711] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:58.509943] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-19T17:19:58.509990] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-19T17:19:58.510543] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-19T17:19:58.510603] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-19T17:19:58.862948] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:59.007100] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T17:19:59.043218] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-19T17:19:59.403684] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T17:19:59.720134] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T17:19:59.721222] [INFO ] [REMOTE ] ASBA: Full fetch complete (5281 records). [2025-09-19T17:19:59.721292] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-19T17:19:59.848341] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-19T17:20:00.093454] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-19T17:20:00.093544] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-19T17:20:00.093731] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-19T17:20:00.093793] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-19T17:20:00.094313] [DEBUG] [LOCAL ] ASBA: Trimmed 5281 records to 3461 (keeping 200 days of data) [2025-09-19T17:20:00.118328] [DEBUG] [LOCAL ] ASBA: Primary data saved (3461 records). [2025-09-19T17:20:00.118490] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-19T17:20:00.118611] [INFO ] [MAIN ] Update Progress: 156/2372 symbols completed. ASBA took 24.5s. Estimated remaining: 4h 43m 7s. Rate: 7.8 symbols/min [2025-09-19T17:20:00.295477] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:00.337813] [DEBUG] [LOCAL ] ASGN: Loaded 36292 existing records from primary storage. [2025-09-19T17:20:00.337957] [INFO ] [MAIN ] ASGN: Loaded 36292 existing records. [2025-09-19T17:20:00.513372] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:20:00.513711] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-19T17:20:00.513769] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-19T17:20:00.514550] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-19T17:20:00.514610] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-19T17:20:00.652021] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-19T17:20:00.869297] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:01.383001] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T17:20:01.443315] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-19T17:20:01.946811] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:20:02.243334] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-19T17:20:02.963802] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:20:03.043270] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-19T17:20:03.423361] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T17:20:03.843234] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-19T17:20:04.384245] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T17:20:04.643307] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-19T17:20:05.451600] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-19T17:20:05.452899] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T17:20:05.477547] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T17:20:06.243222] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-19T17:20:06.691088] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T17:20:07.043298] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-19T17:20:07.782176] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:20:07.823486] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T17:20:07.843223] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-19T17:20:08.643270] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-19T17:20:09.443290] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-19T17:20:09.858256] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T17:20:09.969153] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T17:20:10.243290] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-19T17:20:10.343014] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:20:11.043267] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-19T17:20:11.107995] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T17:20:11.843278] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-19T17:20:12.643284] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-19T17:20:12.779151] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T17:20:13.165703] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T17:20:13.443277] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-19T17:20:14.243278] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-19T17:20:14.337360] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T17:20:14.526352] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T17:20:15.043264] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-19T17:20:15.564025] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T17:20:15.843280] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-19T17:20:16.522732] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:20:16.526889] [INFO ] [REMOTE ] ASGI: Full fetch complete (33297 records). [2025-09-19T17:20:16.527004] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-19T17:20:16.648471] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-19T17:20:16.910179] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-19T17:20:16.910273] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-19T17:20:16.910711] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-19T17:20:16.910773] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-19T17:20:16.912380] [DEBUG] [LOCAL ] ASGI: Trimmed 33297 records to 22591 (keeping 200 days of data) [2025-09-19T17:20:17.047725] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T17:20:17.085216] [DEBUG] [LOCAL ] ASGI: Primary data saved (22591 records). [2025-09-19T17:20:17.085360] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-19T17:20:17.085454] [INFO ] [MAIN ] Update Progress: 157/2372 symbols completed. ASGI took 18.9s. Estimated remaining: 4h 45m 11s. Rate: 7.8 symbols/min [2025-09-19T17:20:17.443284] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-19T17:20:17.820705] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:20:18.243341] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-19T17:20:18.953356] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T17:20:19.043214] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-19T17:20:19.679611] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T17:20:19.843286] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-19T17:20:20.587307] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T17:20:20.643299] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-19T17:20:21.129573] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T17:20:21.443313] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-19T17:20:22.243302] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-19T17:20:22.522053] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T17:20:23.043390] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-19T17:20:23.113897] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:20:23.205511] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T17:20:23.843273] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-19T17:20:24.643255] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-19T17:20:24.769579] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:20:25.182962] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T17:20:25.186546] [INFO ] [REMOTE ] ASG: Full fetch complete (31560 records). [2025-09-19T17:20:25.186676] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-19T17:20:25.461561] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-19T17:20:25.585872] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-19T17:20:25.585976] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-19T17:20:25.586399] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-19T17:20:25.586493] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-19T17:20:25.587405] [DEBUG] [LOCAL ] ASG: Trimmed 31560 records to 21328 (keeping 200 days of data) [2025-09-19T17:20:25.715255] [DEBUG] [LOCAL ] ASG: Primary data saved (21328 records). [2025-09-19T17:20:25.715391] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-19T17:20:25.715476] [INFO ] [MAIN ] Update Progress: 158/2372 symbols completed. ASG took 32.8s. Estimated remaining: 4h 45m 16s. Rate: 7.8 symbols/min [2025-09-19T17:20:26.036801] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T17:20:26.243273] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-19T17:20:27.279168] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T17:20:27.286973] [INFO ] [REMOTE ] ASGN: Full fetch complete (51466 records). [2025-09-19T17:20:27.287155] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-19T17:20:27.699360] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:20:27.750252] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-19T17:20:27.750476] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-19T17:20:27.751222] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-19T17:20:27.751461] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-19T17:20:27.751403] [INFO ] [REMOTE ] ASC: Full fetch complete (57458 records). [2025-09-19T17:20:27.751773] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-19T17:20:27.774940] [DEBUG] [LOCAL ] ASGN: Trimmed 51466 records to 36601 (keeping 200 days of data) [2025-09-19T17:20:28.282799] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-19T17:20:28.283521] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-19T17:20:28.284465] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-19T17:20:28.284895] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-19T17:20:28.288729] [DEBUG] [LOCAL ] ASC: Trimmed 57458 records to 38686 (keeping 200 days of data) [2025-09-19T17:20:28.616608] [DEBUG] [LOCAL ] ASGN: Primary data saved (36601 records). [2025-09-19T17:20:28.617469] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-19T17:20:28.617679] [INFO ] [MAIN ] Update Progress: 159/2372 symbols completed. ASGN took 28.5s. Estimated remaining: 4h 44m 1s. Rate: 7.8 symbols/min [2025-09-19T17:20:28.651441] [DEBUG] [LOCAL ] ASC: Primary data saved (38686 records). [2025-09-19T17:20:28.651611] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-19T17:20:28.651759] [INFO ] [MAIN ] Update Progress: 160/2372 symbols completed. ASC took 45.3s. Estimated remaining: 4h 42m 7s. Rate: 7.8 symbols/min [2025-09-19T17:20:29.326638] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:29.334736] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:29.382429] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-09-19T17:20:29.405210] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:29.425040] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-09-19T17:20:29.425662] [DEBUG] [LOCAL ] ASPN: No existing data file found in primary storage. [2025-09-19T17:20:29.424952] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:29.425573] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-19T17:20:29.425738] [WARN ] [MAIN ] ASPN: No existing data found, performing full refresh instead. [2025-09-19T17:20:29.426387] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-19T17:20:29.426534] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-19T17:20:29.426601] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-19T17:20:29.426903] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-09-19T17:20:29.426816] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-19T17:20:29.427274] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-19T17:20:29.427326] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-19T17:20:29.619398] [DEBUG] [LOCAL ] ASR: Loaded 9250 existing records from primary storage. [2025-09-19T17:20:29.645688] [INFO ] [MAIN ] ASR: Loaded 9250 existing records. [2025-09-19T17:20:29.738868] [DEBUG] [LOCAL ] ASH: Loaded 38304 existing records from primary storage. [2025-09-19T17:20:29.791346] [INFO ] [MAIN ] ASH: Loaded 38304 existing records. [2025-09-19T17:20:30.413748] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:20:30.489728] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-19T17:20:30.498708] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-19T17:20:30.569631] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:20:30.622775] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:30.613485] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-19T17:20:30.643826] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-19T17:20:30.681523] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-19T17:20:30.678185] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-19T17:20:30.685009] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-19T17:20:30.684736] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:30.686668] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-19T17:20:30.700312] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-19T17:20:30.740671] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-19T17:20:31.403017] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:31.413779] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-19T17:20:31.474763] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:31.475720] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-19T17:20:31.490283] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T17:20:31.494533] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-19T17:20:32.611014] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T17:20:32.613395] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-19T17:20:32.735393] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:20:32.741681] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-19T17:20:32.989977] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T17:20:33.001311] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-19T17:20:33.023003] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T17:20:33.443304] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-19T17:20:33.476920] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T17:20:33.650165] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T17:20:34.243270] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-19T17:20:34.383946] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T17:20:35.043266] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-19T17:20:35.189061] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T17:20:35.213628] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T17:20:35.843247] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-19T17:20:36.332438] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T17:20:36.643286] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-19T17:20:37.443300] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-19T17:20:37.687912] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T17:20:37.787994] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T17:20:38.243302] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-19T17:20:39.043270] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-19T17:20:39.132737] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T17:20:39.505871] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-19T17:20:39.843247] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-19T17:20:39.865981] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T17:20:40.643300] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-19T17:20:41.443277] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-19T17:20:41.667168] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:20:41.839816] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T17:20:42.098461] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T17:20:42.243266] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-19T17:20:43.043237] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-19T17:20:43.315988] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T17:20:43.843273] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-19T17:20:44.643291] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-19T17:20:45.088712] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T17:20:45.155246] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T17:20:45.380598] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T17:20:45.443222] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-19T17:20:46.243304] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-19T17:20:46.308140] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T17:20:47.043334] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-19T17:20:47.843270] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-19T17:20:48.241369] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:20:48.450754] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T17:20:48.454319] [INFO ] [REMOTE ] ASIX: Full fetch complete (29542 records). [2025-09-19T17:20:48.454460] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-19T17:20:48.455034] [FATAL] [VALIDATOR ] ASIX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:20:48.455148] [FATAL] [MAIN ] ASIX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:20:48.455203] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:20:48.455277] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-19T17:20:48.455363] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-19T17:20:48.455418] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-09-19T17:20:48.455497] [DEBUG] [LOCAL ] ASIX: No derivative data file found to delete. [2025-09-19T17:20:48.455587] [INFO ] [MAIN ] Update Progress: 161/2372 symbols completed. ASIX took 19.8s. Estimated remaining: 4h 44m 47s. Rate: 7.8 symbols/min [2025-09-19T17:20:48.632241] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:48.643254] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-19T17:20:48.695325] [DEBUG] [LOCAL ] ASX: Loaded 53316 existing records from primary storage. [2025-09-19T17:20:48.695509] [INFO ] [MAIN ] ASX: Loaded 53316 existing records. [2025-09-19T17:20:48.931552] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:20:48.932023] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-19T17:20:48.932107] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-19T17:20:48.935762] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-19T17:20:48.935839] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-19T17:20:49.209062] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:20:49.321190] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:49.443286] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-19T17:20:50.243286] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-19T17:20:50.296812] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T17:20:50.545563] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T17:20:51.043283] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-19T17:20:51.848425] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-19T17:20:51.871405] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T17:20:52.165579] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T17:20:52.168263] [INFO ] [REMOTE ] ASR: Full fetch complete (12256 records). [2025-09-19T17:20:52.168366] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-19T17:20:52.534862] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-19T17:20:52.534955] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-19T17:20:52.535291] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-19T17:20:52.535353] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-19T17:20:52.535925] [DEBUG] [LOCAL ] ASR: Trimmed 12256 records to 9307 (keeping 200 days of data) [2025-09-19T17:20:52.603230] [DEBUG] [LOCAL ] ASR: Primary data saved (9307 records). [2025-09-19T17:20:52.603376] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-19T17:20:52.603494] [INFO ] [MAIN ] Update Progress: 162/2372 symbols completed. ASR took 23.9s. Estimated remaining: 4h 43m 50s. Rate: 7.8 symbols/min [2025-09-19T17:20:52.648489] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-19T17:20:52.776290] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:52.776475] [DEBUG] [LOCAL ] ATEN: No existing data file found in primary storage. [2025-09-19T17:20:52.776512] [WARN ] [MAIN ] ATEN: No existing data found, performing full refresh instead. [2025-09-19T17:20:52.776693] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-19T17:20:52.776757] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-19T17:20:52.776808] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-09-19T17:20:52.776846] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-19T17:20:53.130793] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:53.257373] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:20:53.443308] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-19T17:20:54.243283] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-19T17:20:55.033997] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T17:20:55.044477] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-19T17:20:55.145953] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T17:20:55.843278] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-19T17:20:55.889828] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T17:20:56.643254] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-19T17:20:56.682866] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T17:20:57.142276] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T17:20:57.443301] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-19T17:20:58.104854] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T17:20:58.243291] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-19T17:20:59.043313] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-19T17:20:59.509719] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T17:20:59.843237] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-19T17:21:00.473251] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T17:21:00.585396] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:21:00.643218] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-19T17:21:01.443269] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-19T17:21:01.605726] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:21:02.243265] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-19T17:21:02.663562] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:21:02.669191] [INFO ] [REMOTE ] ASH: Full fetch complete (54407 records). [2025-09-19T17:21:02.669335] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-19T17:21:03.048693] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-19T17:21:03.051896] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-19T17:21:03.052835] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-19T17:21:03.053440] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-19T17:21:03.053503] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-19T17:21:03.057519] [DEBUG] [LOCAL ] ASH: Trimmed 54407 records to 38526 (keeping 200 days of data) [2025-09-19T17:21:03.300713] [DEBUG] [LOCAL ] ASH: Primary data saved (38526 records). [2025-09-19T17:21:03.300853] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-19T17:21:03.300967] [INFO ] [MAIN ] Update Progress: 163/2372 symbols completed. ASH took 34.6s. Estimated remaining: 4h 44m 23s. Rate: 7.8 symbols/min [2025-09-19T17:21:03.473284] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:03.511502] [DEBUG] [LOCAL ] ATGE: Loaded 32387 existing records from primary storage. [2025-09-19T17:21:03.511636] [INFO ] [MAIN ] ATGE: Loaded 32387 existing records. [2025-09-19T17:21:03.688292] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:03.688672] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-19T17:21:03.688733] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-19T17:21:03.690764] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-19T17:21:03.690828] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-19T17:21:04.041867] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:04.042177] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-19T17:21:04.767168] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (3.32 seconds). [2025-09-19T17:21:04.780448] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-19T17:21:05.159047] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T17:21:05.211090] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-09-19T17:21:05.443297] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-19T17:21:06.099104] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (3.05 seconds). [2025-09-19T17:21:06.243276] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-19T17:21:06.844363] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T17:21:06.851772] [INFO ] [REMOTE ] ASPN: Full fetch complete (72344 records). [2025-09-19T17:21:06.851940] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-19T17:21:07.051875] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-19T17:21:07.312307] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:21:07.312700] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-19T17:21:07.312848] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-19T17:21:07.320753] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-19T17:21:07.321199] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-19T17:21:07.322852] [DEBUG] [LOCAL ] ASPN: Trimmed 72344 records to 50351 (keeping 200 days of data) [2025-09-19T17:21:07.632797] [DEBUG] [LOCAL ] ASPN: Primary data saved (50351 records). [2025-09-19T17:21:07.632934] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-19T17:21:07.633011] [INFO ] [MAIN ] Update Progress: 164/2372 symbols completed. ASPN took 39.0s. Estimated remaining: 4h 43m 29s. Rate: 7.8 symbols/min [2025-09-19T17:21:07.808968] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:07.843594] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-19T17:21:07.843481] [DEBUG] [LOCAL ] ATHM: Loaded 33337 existing records from primary storage. [2025-09-19T17:21:07.844855] [INFO ] [MAIN ] ATHM: Loaded 33337 existing records. [2025-09-19T17:21:08.036456] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:08.036766] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-19T17:21:08.036824] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-19T17:21:08.038444] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-19T17:21:08.038505] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-19T17:21:08.399755] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:08.425142] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T17:21:08.643266] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-19T17:21:09.428593] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T17:21:09.443210] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-19T17:21:09.568760] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T17:21:10.243325] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-19T17:21:10.459461] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T17:21:11.043304] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-19T17:21:11.843451] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-19T17:21:12.088467] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-19T17:21:12.205695] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T17:21:12.643336] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-19T17:21:13.443318] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-19T17:21:13.700294] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T17:21:14.109744] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (3.07 seconds). [2025-09-19T17:21:14.243301] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-19T17:21:15.043299] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-19T17:21:15.765375] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-19T17:21:15.843291] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-19T17:21:15.892138] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-19T17:21:16.326384] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T17:21:16.643282] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-19T17:21:16.767957] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T17:21:17.443284] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-19T17:21:18.056481] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:21:18.184888] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-19T17:21:18.243271] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-19T17:21:19.043289] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-19T17:21:19.236825] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T17:21:19.336441] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T17:21:19.843280] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-19T17:21:20.188336] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T17:21:20.643272] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-19T17:21:20.990273] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T17:21:20.996204] [INFO ] [REMOTE ] ATEN: Full fetch complete (57608 records). [2025-09-19T17:21:20.996359] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-19T17:21:21.397555] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-19T17:21:21.397909] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-19T17:21:21.398708] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-19T17:21:21.398772] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-19T17:21:21.400119] [DEBUG] [LOCAL ] ATEN: Trimmed 57608 records to 40681 (keeping 200 days of data) [2025-09-19T17:21:21.463691] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-19T17:21:21.665844] [DEBUG] [LOCAL ] ATEN: Primary data saved (40681 records). [2025-09-19T17:21:21.665981] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-19T17:21:21.666059] [INFO ] [MAIN ] Update Progress: 165/2372 symbols completed. ATEN took 29.1s. Estimated remaining: 4h 44m 46s. Rate: 7.8 symbols/min [2025-09-19T17:21:21.838087] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:21.847928] [DEBUG] [LOCAL ] ATHS: Loaded 7270 existing records from primary storage. [2025-09-19T17:21:21.848084] [INFO ] [MAIN ] ATHS: Loaded 7270 existing records. [2025-09-19T17:21:22.029808] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:22.030195] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-19T17:21:22.030280] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-19T17:21:22.031094] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-19T17:21:22.031202] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-19T17:21:22.251758] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-19T17:21:22.409144] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:22.470139] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T17:21:22.515032] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T17:21:23.043266] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-19T17:21:23.843299] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-19T17:21:24.269774] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T17:21:24.322042] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T17:21:24.420552] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T17:21:24.643329] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-19T17:21:25.443288] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-19T17:21:25.630117] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T17:21:25.635119] [INFO ] [REMOTE ] ATGE: Full fetch complete (46313 records). [2025-09-19T17:21:25.635355] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-19T17:21:26.045267] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-19T17:21:26.045397] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-19T17:21:26.045949] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-19T17:21:26.046012] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-19T17:21:26.047204] [DEBUG] [LOCAL ] ATGE: Trimmed 46313 records to 32625 (keeping 200 days of data) [2025-09-19T17:21:26.243311] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-19T17:21:26.246696] [DEBUG] [LOCAL ] ATGE: Primary data saved (32625 records). [2025-09-19T17:21:26.246855] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-19T17:21:26.246951] [INFO ] [MAIN ] Update Progress: 166/2372 symbols completed. ATGE took 22.9s. Estimated remaining: 4h 43m 57s. Rate: 7.8 symbols/min [2025-09-19T17:21:26.419091] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:26.467882] [DEBUG] [LOCAL ] ATI: Loaded 52046 existing records from primary storage. [2025-09-19T17:21:26.468032] [INFO ] [MAIN ] ATI: Loaded 52046 existing records. [2025-09-19T17:21:26.652547] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:26.652824] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-19T17:21:26.652875] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-19T17:21:26.655482] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-19T17:21:26.655559] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-19T17:21:27.041596] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:27.043220] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-19T17:21:27.198523] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:21:27.843312] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-19T17:21:28.105172] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T17:21:28.643317] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-19T17:21:28.915106] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T17:21:29.337057] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T17:21:29.348054] [INFO ] [REMOTE ] ASX: Full fetch complete (76648 records). [2025-09-19T17:21:29.348343] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-19T17:21:29.450767] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-19T17:21:29.754760] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-19T17:21:29.754853] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-19T17:21:29.755673] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-19T17:21:29.755737] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-19T17:21:29.757258] [DEBUG] [LOCAL ] ASX: Trimmed 76648 records to 53698 (keeping 200 days of data) [2025-09-19T17:21:30.109522] [DEBUG] [LOCAL ] ASX: Primary data saved (53698 records). [2025-09-19T17:21:30.109719] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-19T17:21:30.109821] [INFO ] [MAIN ] Update Progress: 167/2372 symbols completed. ASX took 41.7s. Estimated remaining: 4h 42m 58s. Rate: 7.8 symbols/min [2025-09-19T17:21:30.252904] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-19T17:21:30.288343] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:30.288565] [DEBUG] [LOCAL ] ATKR: No existing data file found in primary storage. [2025-09-19T17:21:30.288615] [WARN ] [MAIN ] ATKR: No existing data found, performing full refresh instead. [2025-09-19T17:21:30.288810] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-19T17:21:30.288867] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-19T17:21:30.288911] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-09-19T17:21:30.288945] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-19T17:21:30.670245] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:30.693530] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T17:21:30.924809] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T17:21:31.043311] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-19T17:21:31.102369] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T17:21:31.843266] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-19T17:21:32.643277] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-19T17:21:32.769824] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T17:21:33.443279] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-19T17:21:33.789807] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T17:21:34.241519] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T17:21:34.247727] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-19T17:21:35.043245] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-19T17:21:35.166329] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T17:21:35.183367] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T17:21:35.843270] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-19T17:21:36.643261] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-19T17:21:36.965998] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T17:21:37.443230] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-19T17:21:37.726391] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T17:21:37.990086] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T17:21:38.243268] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-19T17:21:39.043268] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-19T17:21:39.490966] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T17:21:39.839977] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:21:39.846706] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-19T17:21:39.967946] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T17:21:40.643294] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-19T17:21:41.443286] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-19T17:21:41.593949] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:21:41.871328] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-19T17:21:42.126296] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:21:42.130359] [INFO ] [REMOTE ] ATHM: Full fetch complete (52285 records). [2025-09-19T17:21:42.130458] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-19T17:21:42.248475] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-19T17:21:42.551919] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-19T17:21:42.552084] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-19T17:21:42.553201] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-19T17:21:42.553282] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-19T17:21:42.554572] [DEBUG] [LOCAL ] ATHM: Trimmed 52285 records to 33480 (keeping 200 days of data) [2025-09-19T17:21:42.797056] [DEBUG] [LOCAL ] ATHM: Primary data saved (33480 records). [2025-09-19T17:21:42.797241] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-19T17:21:42.797338] [INFO ] [MAIN ] Update Progress: 168/2372 symbols completed. ATHM took 35.2s. Estimated remaining: 4h 43m 56s. Rate: 7.8 symbols/min [2025-09-19T17:21:42.974586] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:43.014780] [DEBUG] [LOCAL ] ATMU: Loaded 40021 existing records from primary storage. [2025-09-19T17:21:43.014937] [INFO ] [MAIN ] ATMU: Loaded 40021 existing records. [2025-09-19T17:21:43.048394] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-19T17:21:43.200522] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:43.200824] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-19T17:21:43.200879] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-19T17:21:43.206315] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-19T17:21:43.206432] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-19T17:21:43.593962] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:43.843243] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-19T17:21:44.643334] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-19T17:21:44.713484] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-19T17:21:44.713866] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T17:21:45.056685] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:21:45.443295] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-19T17:21:45.802375] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T17:21:46.243276] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-19T17:21:46.473810] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T17:21:47.043324] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-19T17:21:47.843244] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-19T17:21:47.961302] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:21:47.973014] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T17:21:48.643504] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-19T17:21:49.443314] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-19T17:21:49.513703] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T17:21:50.235703] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T17:21:50.243204] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-19T17:21:50.293507] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T17:21:51.043304] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-19T17:21:51.843247] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-19T17:21:51.950472] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T17:21:52.572304] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T17:21:52.574195] [INFO ] [REMOTE ] ATHS: Full fetch complete (10035 records). [2025-09-19T17:21:52.574281] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-19T17:21:52.651149] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-19T17:21:52.868015] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:21:52.993596] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-19T17:21:52.993726] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-19T17:21:52.993999] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-19T17:21:52.994041] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-19T17:21:52.994480] [DEBUG] [LOCAL ] ATHS: Trimmed 10035 records to 7291 (keeping 200 days of data) [2025-09-19T17:21:53.040386] [DEBUG] [LOCAL ] ATHS: Primary data saved (7291 records). [2025-09-19T17:21:53.040512] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-19T17:21:53.040620] [INFO ] [MAIN ] Update Progress: 169/2372 symbols completed. ATHS took 31.4s. Estimated remaining: 4h 44m 21s. Rate: 7.7 symbols/min [2025-09-19T17:21:53.217763] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:53.274861] [DEBUG] [LOCAL ] ATO: Loaded 42420 existing records from primary storage. [2025-09-19T17:21:53.275008] [INFO ] [MAIN ] ATO: Loaded 42420 existing records. [2025-09-19T17:21:53.448672] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-19T17:21:53.451776] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:53.455900] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-19T17:21:53.456003] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-19T17:21:53.458037] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-19T17:21:53.458099] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-19T17:21:53.835333] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:54.243268] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-19T17:21:54.746440] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:21:55.043334] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-19T17:21:55.596168] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:21:55.843334] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-19T17:21:56.436331] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T17:21:56.643322] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-19T17:21:56.834733] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T17:21:57.443371] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-19T17:21:57.499153] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:21:57.504988] [INFO ] [REMOTE ] ATKR: Full fetch complete (53591 records). [2025-09-19T17:21:57.505134] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-19T17:21:57.907803] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-19T17:21:57.907937] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-19T17:21:57.908559] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-19T17:21:57.908609] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-19T17:21:57.909974] [DEBUG] [LOCAL ] ATKR: Trimmed 53591 records to 36395 (keeping 200 days of data) [2025-09-19T17:21:58.145405] [DEBUG] [LOCAL ] ATKR: Primary data saved (36395 records). [2025-09-19T17:21:58.145569] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-19T17:21:58.145679] [INFO ] [MAIN ] Update Progress: 170/2372 symbols completed. ATKR took 28.0s. Estimated remaining: 4h 43m 39s. Rate: 7.8 symbols/min [2025-09-19T17:21:58.253847] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-19T17:21:58.333707] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:58.381862] [DEBUG] [LOCAL ] ATR: Loaded 30720 existing records from primary storage. [2025-09-19T17:21:58.382082] [INFO ] [MAIN ] ATR: Loaded 30720 existing records. [2025-09-19T17:21:58.568826] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:58.569254] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-19T17:21:58.569368] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-19T17:21:58.578731] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-19T17:21:58.583970] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-19T17:21:58.688800] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T17:21:59.004886] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:59.043216] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-19T17:21:59.552875] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T17:21:59.843315] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-19T17:22:00.245426] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T17:22:00.530528] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T17:22:00.643272] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-19T17:22:01.255689] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T17:22:01.443260] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-19T17:22:02.243254] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-19T17:22:02.333844] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T17:22:03.043270] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-19T17:22:03.295546] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:22:03.843739] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-19T17:22:03.855391] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T17:22:04.284860] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T17:22:04.643317] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-19T17:22:05.443342] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-19T17:22:05.650889] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T17:22:06.243324] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-19T17:22:06.276847] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:22:06.573286] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T17:22:07.043283] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-19T17:22:07.843338] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-19T17:22:08.396967] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T17:22:08.643285] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-19T17:22:09.233903] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T17:22:09.242485] [INFO ] [REMOTE ] ATI: Full fetch complete (73408 records). [2025-09-19T17:22:09.242684] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-19T17:22:09.243767] [FATAL] [VALIDATOR ] ATI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:22:09.243877] [FATAL] [MAIN ] ATI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:22:09.243925] [WARN ] [MAIN ] ATI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:22:09.243964] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-19T17:22:09.244024] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-09-19T17:22:09.244060] [INFO ] [LOCAL ] ATI: Starting deletion of derivative data. [2025-09-19T17:22:09.244679] [DEBUG] [LOCAL ] ATI: Deleted derivative data file. [2025-09-19T17:22:09.244790] [INFO ] [MAIN ] Update Progress: 171/2372 symbols completed. ATI took 43.0s. Estimated remaining: 4h 44m 14s. Rate: 7.7 symbols/min [2025-09-19T17:22:09.431513] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:09.448223] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-19T17:22:09.452914] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T17:22:09.473756] [DEBUG] [LOCAL ] ATS: Loaded 18391 existing records from primary storage. [2025-09-19T17:22:09.473892] [INFO ] [MAIN ] ATS: Loaded 18391 existing records. [2025-09-19T17:22:09.653267] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:09.653540] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-19T17:22:09.653589] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-19T17:22:09.654801] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-19T17:22:09.654864] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-19T17:22:10.022939] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:10.243273] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-19T17:22:10.287514] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:22:10.801494] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T17:22:11.043274] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-19T17:22:11.843305] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-19T17:22:12.208456] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T17:22:12.643315] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-19T17:22:13.163446] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T17:22:13.185011] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:22:13.443299] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-19T17:22:13.755444] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T17:22:14.243285] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-19T17:22:14.680008] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:22:15.043272] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-19T17:22:15.843276] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-19T17:22:16.073349] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T17:22:16.109147] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:22:16.643271] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-19T17:22:17.443310] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-19T17:22:17.513362] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T17:22:18.185745] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:22:18.243272] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-19T17:22:19.043270] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-19T17:22:19.236022] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T17:22:19.242710] [INFO ] [REMOTE ] ATO: Full fetch complete (60379 records). [2025-09-19T17:22:19.242899] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-19T17:22:19.673704] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-19T17:22:19.673877] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-19T17:22:19.675476] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-19T17:22:19.675677] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-19T17:22:19.698042] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T17:22:19.705821] [DEBUG] [LOCAL ] ATO: Trimmed 60379 records to 42708 (keeping 200 days of data) [2025-09-19T17:22:19.890571] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-19T17:22:19.984474] [DEBUG] [LOCAL ] ATO: Primary data saved (42708 records). [2025-09-19T17:22:19.984610] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-19T17:22:19.984740] [INFO ] [MAIN ] Update Progress: 172/2372 symbols completed. ATO took 26.9s. Estimated remaining: 4h 44m 45s. Rate: 7.7 symbols/min [2025-09-19T17:22:20.151503] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:20.196859] [DEBUG] [LOCAL ] ATUS: Loaded 49567 existing records from primary storage. [2025-09-19T17:22:20.197030] [INFO ] [MAIN ] ATUS: Loaded 49567 existing records. [2025-09-19T17:22:20.400944] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:20.402298] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T17:22:20.409099] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-19T17:22:20.409169] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-19T17:22:20.410854] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-19T17:22:20.410922] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-19T17:22:20.648353] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-19T17:22:20.765063] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:21.258062] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T17:22:21.443248] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-19T17:22:22.052561] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T17:22:22.243238] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-19T17:22:22.370758] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T17:22:22.377907] [INFO ] [REMOTE ] ATMU: Full fetch complete (56770 records). [2025-09-19T17:22:22.378100] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-19T17:22:22.774091] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-19T17:22:22.774194] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-19T17:22:22.774818] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-19T17:22:22.774886] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-19T17:22:22.776115] [DEBUG] [LOCAL ] ATMU: Trimmed 56770 records to 40306 (keeping 200 days of data) [2025-09-19T17:22:23.018087] [DEBUG] [LOCAL ] ATMU: Primary data saved (40306 records). [2025-09-19T17:22:23.018253] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-19T17:22:23.018438] [INFO ] [MAIN ] Update Progress: 173/2372 symbols completed. ATMU took 40.2s. Estimated remaining: 4h 43m 37s. Rate: 7.8 symbols/min [2025-09-19T17:22:23.049340] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-19T17:22:23.195075] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:23.253761] [DEBUG] [LOCAL ] AU: Loaded 53292 existing records from primary storage. [2025-09-19T17:22:23.253948] [INFO ] [MAIN ] AU: Loaded 53292 existing records. [2025-09-19T17:22:23.461152] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:23.461458] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-19T17:22:23.461516] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-19T17:22:23.463954] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-19T17:22:23.464021] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-19T17:22:23.839350] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T17:22:23.858564] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-19T17:22:23.870215] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:24.333601] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T17:22:24.643290] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-19T17:22:25.443267] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-19T17:22:25.765707] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T17:22:26.243350] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-19T17:22:26.393365] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T17:22:26.711591] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:22:27.043281] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-19T17:22:27.561806] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:22:27.843317] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-19T17:22:28.250952] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T17:22:28.255836] [INFO ] [REMOTE ] ATS: Full fetch complete (25939 records). [2025-09-19T17:22:28.256151] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-19T17:22:28.648443] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-19T17:22:28.705613] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-19T17:22:28.705790] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-19T17:22:28.706331] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-19T17:22:28.706413] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-19T17:22:28.707850] [DEBUG] [LOCAL ] ATS: Trimmed 25939 records to 18502 (keeping 200 days of data) [2025-09-19T17:22:28.816625] [DEBUG] [LOCAL ] ATS: Primary data saved (18502 records). [2025-09-19T17:22:28.816824] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-19T17:22:28.816918] [INFO ] [MAIN ] Update Progress: 174/2372 symbols completed. ATS took 19.6s. Estimated remaining: 4h 43m 5s. Rate: 7.8 symbols/min [2025-09-19T17:22:28.989923] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:29.035325] [DEBUG] [LOCAL ] AUB: Loaded 46863 existing records from primary storage. [2025-09-19T17:22:29.035507] [INFO ] [MAIN ] AUB: Loaded 46863 existing records. [2025-09-19T17:22:29.231734] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:29.232343] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-19T17:22:29.232525] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-19T17:22:29.239693] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-19T17:22:29.247816] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-19T17:22:29.255132] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T17:22:29.347993] [INFO ] [REMOTE ] ATR: Full fetch complete (43250 records). [2025-09-19T17:22:29.371359] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-19T17:22:29.483380] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-19T17:22:29.974185] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:30.058082] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-19T17:22:30.058180] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-19T17:22:30.058916] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-19T17:22:30.058988] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-19T17:22:30.060203] [DEBUG] [LOCAL ] ATR: Trimmed 43250 records to 30949 (keeping 200 days of data) [2025-09-19T17:22:30.249250] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-19T17:22:30.271242] [DEBUG] [LOCAL ] ATR: Primary data saved (30949 records). [2025-09-19T17:22:30.271396] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-19T17:22:30.271500] [INFO ] [MAIN ] Update Progress: 175/2372 symbols completed. ATR took 32.1s. Estimated remaining: 4h 41m 38s. Rate: 7.8 symbols/min [2025-09-19T17:22:30.446365] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:30.446581] [DEBUG] [LOCAL ] AUNA: No existing data file found in primary storage. [2025-09-19T17:22:30.446636] [WARN ] [MAIN ] AUNA: No existing data found, performing full refresh instead. [2025-09-19T17:22:30.446806] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-19T17:22:30.446848] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-19T17:22:30.446888] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-09-19T17:22:30.446921] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-19T17:22:30.838956] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:30.867141] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-19T17:22:31.043256] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-19T17:22:31.114884] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:22:31.843291] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-19T17:22:32.190855] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T17:22:32.643259] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-19T17:22:32.785423] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T17:22:32.868527] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T17:22:33.443304] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-19T17:22:34.243260] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-19T17:22:34.387623] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T17:22:34.467635] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T17:22:35.043259] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-19T17:22:35.843278] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-19T17:22:36.228368] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T17:22:36.375322] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T17:22:36.580255] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T17:22:36.643218] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-19T17:22:37.443257] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-19T17:22:38.219219] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T17:22:38.243230] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-19T17:22:38.686628] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T17:22:38.720380] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T17:22:39.043284] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-19T17:22:39.843264] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-19T17:22:39.885506] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T17:22:40.643266] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-19T17:22:41.443313] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-19T17:22:41.793347] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:22:42.243284] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-19T17:22:42.620595] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T17:22:43.043310] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-19T17:22:43.494611] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T17:22:43.748191] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T17:22:43.843318] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-19T17:22:44.056153] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T17:22:44.643275] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-19T17:22:45.383403] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:22:45.443223] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-19T17:22:45.943782] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T17:22:46.217893] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T17:22:46.243231] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-19T17:22:46.916865] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T17:22:46.918169] [INFO ] [REMOTE ] AUNA: Full fetch complete (7332 records). [2025-09-19T17:22:46.918240] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-19T17:22:46.918740] [FATAL] [VALIDATOR ] AUNA: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:22:46.918824] [FATAL] [MAIN ] AUNA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:22:46.918867] [WARN ] [MAIN ] AUNA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:22:46.918904] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-19T17:22:46.918982] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-09-19T17:22:46.919038] [INFO ] [LOCAL ] AUNA: Starting deletion of derivative data. [2025-09-19T17:22:46.919081] [DEBUG] [LOCAL ] AUNA: No derivative data file found to delete. [2025-09-19T17:22:46.919135] [INFO ] [MAIN ] Update Progress: 176/2372 symbols completed. AUNA took 16.6s. Estimated remaining: 4h 43m 22s. Rate: 7.7 symbols/min [2025-09-19T17:22:47.048350] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-19T17:22:47.099436] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:47.141820] [DEBUG] [LOCAL ] AVA: Loaded 40043 existing records from primary storage. [2025-09-19T17:22:47.141987] [INFO ] [MAIN ] AVA: Loaded 40043 existing records. [2025-09-19T17:22:47.336908] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:47.337291] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-19T17:22:47.337353] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-19T17:22:47.340923] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-19T17:22:47.340989] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-19T17:22:47.724730] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:47.843259] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-19T17:22:48.643276] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-19T17:22:48.984797] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:22:49.443288] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-19T17:22:49.596915] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:22:49.977504] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T17:22:50.243280] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-19T17:22:51.043291] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-19T17:22:51.113001] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:22:51.843265] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-19T17:22:52.079470] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T17:22:52.643295] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-19T17:22:52.793425] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T17:22:53.443315] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-19T17:22:53.478022] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T17:22:54.243248] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-19T17:22:54.295246] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T17:22:54.943806] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:22:55.043273] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-19T17:22:55.253437] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T17:22:55.843287] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-19T17:22:56.643320] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-19T17:22:56.945626] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T17:22:56.953768] [INFO ] [REMOTE ] ATUS: Full fetch complete (70915 records). [2025-09-19T17:22:56.953955] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-19T17:22:57.429783] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-19T17:22:57.429923] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-19T17:22:57.431293] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-19T17:22:57.431395] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-19T17:22:57.433780] [DEBUG] [LOCAL ] ATUS: Trimmed 70915 records to 49936 (keeping 200 days of data) [2025-09-19T17:22:57.507714] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-19T17:22:57.836628] [DEBUG] [LOCAL ] ATUS: Primary data saved (49936 records). [2025-09-19T17:22:57.836859] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-19T17:22:57.836969] [INFO ] [MAIN ] Update Progress: 177/2372 symbols completed. ATUS took 37.9s. Estimated remaining: 4h 43m 54s. Rate: 7.7 symbols/min [2025-09-19T17:22:58.158199] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:58.186127] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:22:58.209595] [DEBUG] [LOCAL ] AVAL: Loaded 9597 existing records from primary storage. [2025-09-19T17:22:58.209820] [INFO ] [MAIN ] AVAL: Loaded 9597 existing records. [2025-09-19T17:22:58.243880] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-19T17:22:58.441674] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-19T17:22:58.558333] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:58.558667] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-19T17:22:58.558748] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-19T17:22:58.559960] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-19T17:22:58.560071] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-19T17:22:58.955179] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:59.043300] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-19T17:22:59.458128] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T17:22:59.613710] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T17:22:59.843287] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-19T17:23:00.147497] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T17:23:00.643278] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-19T17:23:01.443320] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-19T17:23:01.720458] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T17:23:02.119295] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T17:23:02.243314] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-19T17:23:02.922085] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-19T17:23:03.043284] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-19T17:23:03.173623] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T17:23:03.843271] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-19T17:23:04.643264] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-19T17:23:05.443289] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-19T17:23:05.730558] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T17:23:06.243297] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-19T17:23:06.364746] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:23:06.671827] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T17:23:06.678256] [INFO ] [REMOTE ] AUB: Full fetch complete (65043 records). [2025-09-19T17:23:06.678381] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-19T17:23:06.679083] [FATAL] [VALIDATOR ] AUB: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:23:06.679169] [FATAL] [MAIN ] AUB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:23:06.679223] [WARN ] [MAIN ] AUB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:23:06.679286] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-19T17:23:06.679358] [DEBUG] [LOCAL ] AUB: No primary data file found to delete. [2025-09-19T17:23:06.679414] [INFO ] [LOCAL ] AUB: Starting deletion of derivative data. [2025-09-19T17:23:06.679863] [DEBUG] [LOCAL ] AUB: Deleted derivative data file. [2025-09-19T17:23:06.679989] [INFO ] [MAIN ] Update Progress: 178/2372 symbols completed. AUB took 37.9s. Estimated remaining: 4h 43m 60s. Rate: 7.7 symbols/min [2025-09-19T17:23:06.867912] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:06.916450] [DEBUG] [LOCAL ] AVB: Loaded 41875 existing records from primary storage. [2025-09-19T17:23:06.916624] [INFO ] [MAIN ] AVB: Loaded 41875 existing records. [2025-09-19T17:23:07.046754] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-19T17:23:07.112955] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:07.113388] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-19T17:23:07.113580] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-19T17:23:07.116894] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-19T17:23:07.116996] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-19T17:23:07.367071] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (3.52 seconds). [2025-09-19T17:23:07.488777] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T17:23:07.574073] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:07.843297] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-19T17:23:08.235432] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T17:23:08.643308] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-19T17:23:09.443277] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-19T17:23:10.235366] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T17:23:10.243233] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-19T17:23:10.243406] [INFO ] [REMOTE ] AU: Full fetch complete (76253 records). [2025-09-19T17:23:10.244304] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-19T17:23:10.754755] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-19T17:23:10.760188] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-19T17:23:10.761555] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-19T17:23:10.763943] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-19T17:23:10.763800] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T17:23:10.775174] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T17:23:10.780084] [DEBUG] [LOCAL ] AU: Trimmed 76253 records to 53682 (keeping 200 days of data) [2025-09-19T17:23:11.044946] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-19T17:23:11.132852] [DEBUG] [LOCAL ] AU: Primary data saved (53682 records). [2025-09-19T17:23:11.133005] [INFO ] [MAIN ] AU: Full history saved. [2025-09-19T17:23:11.134522] [INFO ] [MAIN ] Update Progress: 179/2372 symbols completed. AU took 48.1s. Estimated remaining: 4h 43m 11s. Rate: 7.7 symbols/min [2025-09-19T17:23:11.312213] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:11.312434] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-19T17:23:11.312505] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-19T17:23:11.312930] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-19T17:23:11.312997] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-19T17:23:11.313065] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-19T17:23:11.313121] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-19T17:23:11.680263] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:11.819027] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T17:23:11.842524] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T17:23:11.849466] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-19T17:23:12.643279] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-19T17:23:13.105356] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T17:23:13.443262] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-19T17:23:14.243279] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-19T17:23:14.329825] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T17:23:14.375847] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T17:23:14.483437] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:14.483939] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-19T17:23:15.043324] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-19T17:23:15.843297] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-19T17:23:15.923806] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T17:23:15.926236] [INFO ] [REMOTE ] AVAL: Full fetch complete (14664 records). [2025-09-19T17:23:15.926369] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-19T17:23:16.311012] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-19T17:23:16.311115] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-19T17:23:16.311416] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-19T17:23:16.311502] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-19T17:23:16.312441] [DEBUG] [LOCAL ] AVAL: Trimmed 14664 records to 9642 (keeping 200 days of data) [2025-09-19T17:23:16.379714] [DEBUG] [LOCAL ] AVAL: Primary data saved (9642 records). [2025-09-19T17:23:16.379857] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-19T17:23:16.380041] [INFO ] [MAIN ] Update Progress: 180/2372 symbols completed. AVAL took 18.5s. Estimated remaining: 4h 42m 33s. Rate: 7.8 symbols/min [2025-09-19T17:23:16.550843] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:16.578402] [DEBUG] [LOCAL ] AVD: Loaded 23445 existing records from primary storage. [2025-09-19T17:23:16.578557] [INFO ] [MAIN ] AVD: Loaded 23445 existing records. [2025-09-19T17:23:16.652264] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-19T17:23:16.759278] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:16.759506] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-19T17:23:16.759559] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-19T17:23:16.760881] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-19T17:23:16.760960] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-19T17:23:17.142017] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:17.443323] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-19T17:23:17.674620] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:17.675015] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-19T17:23:17.777455] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:23:17.900860] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T17:23:18.243311] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-19T17:23:19.043314] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-19T17:23:19.843298] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-19T17:23:20.125717] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:23:20.488613] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:20.488983] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-19T17:23:20.514285] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:23:20.643265] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-19T17:23:20.880373] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:20.880704] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-19T17:23:21.443285] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-19T17:23:21.905969] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:21.906294] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-19T17:23:22.243263] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-19T17:23:23.043284] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-19T17:23:23.843267] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-19T17:23:23.949346] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T17:23:23.955720] [INFO ] [REMOTE ] AVA: Full fetch complete (55499 records). [2025-09-19T17:23:23.955835] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-19T17:23:24.353741] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-19T17:23:24.353833] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-19T17:23:24.354415] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-19T17:23:24.354456] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-19T17:23:24.355792] [DEBUG] [LOCAL ] AVA: Trimmed 55499 records to 40280 (keeping 200 days of data) [2025-09-19T17:23:24.631909] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T17:23:24.643242] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-19T17:23:24.653857] [DEBUG] [LOCAL ] AVA: Primary data saved (40280 records). [2025-09-19T17:23:24.654007] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-19T17:23:24.654111] [INFO ] [MAIN ] Update Progress: 181/2372 symbols completed. AVA took 37.7s. Estimated remaining: 4h 42m 32s. Rate: 7.8 symbols/min [2025-09-19T17:23:24.839728] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:24.875605] [DEBUG] [LOCAL ] AVK: Loaded 18339 existing records from primary storage. [2025-09-19T17:23:24.875976] [INFO ] [MAIN ] AVK: Loaded 18339 existing records. [2025-09-19T17:23:24.955857] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:24.983876] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-19T17:23:25.074276] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:25.074697] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-19T17:23:25.074757] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-19T17:23:25.076075] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-19T17:23:25.076137] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-19T17:23:25.449495] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-19T17:23:25.455842] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:25.799175] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T17:23:26.243247] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-19T17:23:26.827576] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T17:23:27.043263] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-19T17:23:27.581486] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:23:27.843283] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-19T17:23:28.073351] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:28.073725] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-19T17:23:28.643292] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-19T17:23:28.808628] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T17:23:29.443262] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-19T17:23:29.857193] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T17:23:30.243262] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-19T17:23:31.043276] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-19T17:23:31.297160] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:31.297802] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-19T17:23:31.300182] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T17:23:31.786853] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:23:31.843261] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-19T17:23:32.643281] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-19T17:23:33.203443] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:23:33.443248] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-19T17:23:33.949014] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:23:34.243271] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-19T17:23:34.710258] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T17:23:35.043278] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-19T17:23:35.493352] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T17:23:35.497344] [INFO ] [REMOTE ] AVBC: Full fetch complete (4364 records). [2025-09-19T17:23:35.497475] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-19T17:23:35.679787] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 35 unique days, need 200 days [2025-09-19T17:23:35.679994] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:23:35.680040] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:23:35.680124] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-19T17:23:35.680204] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-19T17:23:35.680253] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-19T17:23:35.680335] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-19T17:23:35.680415] [INFO ] [MAIN ] Update Progress: 182/2372 symbols completed. AVBC took 24.5s. Estimated remaining: 4h 43m 4s. Rate: 7.7 symbols/min [2025-09-19T17:23:35.861992] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:35.858147] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-19T17:23:35.911594] [DEBUG] [LOCAL ] AVNS: Loaded 33953 existing records from primary storage. [2025-09-19T17:23:35.911792] [INFO ] [MAIN ] AVNS: Loaded 33953 existing records. [2025-09-19T17:23:36.104893] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:36.106074] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-19T17:23:36.106132] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-19T17:23:36.108822] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-19T17:23:36.108885] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-19T17:23:36.471820] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:36.643261] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-19T17:23:36.937760] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T17:23:37.076936] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T17:23:37.443286] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-19T17:23:37.873218] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T17:23:38.243317] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-19T17:23:39.043287] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-19T17:23:39.274324] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T17:23:39.517052] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T17:23:39.843321] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-19T17:23:39.875556] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T17:23:40.643311] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-19T17:23:41.146691] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:23:41.443275] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-19T17:23:42.138056] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T17:23:42.243334] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-19T17:23:42.857149] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T17:23:42.882267] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T17:23:43.043293] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-19T17:23:43.843302] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-19T17:23:43.960324] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T17:23:44.643267] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-19T17:23:45.383536] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:23:45.400190] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T17:23:45.403689] [INFO ] [REMOTE ] AVD: Full fetch complete (33994 records). [2025-09-19T17:23:45.403808] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-19T17:23:45.448542] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-19T17:23:45.787320] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-19T17:23:45.787414] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-19T17:23:45.787911] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-19T17:23:45.787973] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-19T17:23:45.788833] [DEBUG] [LOCAL ] AVD: Trimmed 33994 records to 23590 (keeping 200 days of data) [2025-09-19T17:23:45.923204] [DEBUG] [LOCAL ] AVD: Primary data saved (23590 records). [2025-09-19T17:23:45.923347] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-19T17:23:45.923434] [INFO ] [MAIN ] Update Progress: 183/2372 symbols completed. AVD took 29.5s. Estimated remaining: 4h 43m 26s. Rate: 7.7 symbols/min [2025-09-19T17:23:46.092484] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:46.143774] [DEBUG] [LOCAL ] AVNT: Loaded 39891 existing records from primary storage. [2025-09-19T17:23:46.143988] [INFO ] [MAIN ] AVNT: Loaded 39891 existing records. [2025-09-19T17:23:46.247896] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-19T17:23:46.332681] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:46.333006] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-19T17:23:46.333069] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-19T17:23:46.334628] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-19T17:23:46.334731] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-19T17:23:46.696021] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:47.043259] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-19T17:23:47.250270] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T17:23:47.555378] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T17:23:47.561425] [INFO ] [REMOTE ] AVB: Full fetch complete (57645 records). [2025-09-19T17:23:47.561520] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-19T17:23:47.562135] [FATAL] [VALIDATOR ] AVB: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:23:47.562257] [FATAL] [MAIN ] AVB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:23:47.562315] [WARN ] [MAIN ] AVB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:23:47.562367] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-19T17:23:47.562459] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-09-19T17:23:47.562516] [INFO ] [LOCAL ] AVB: Starting deletion of derivative data. [2025-09-19T17:23:47.563013] [DEBUG] [LOCAL ] AVB: Deleted derivative data file. [2025-09-19T17:23:47.563140] [INFO ] [MAIN ] Update Progress: 184/2372 symbols completed. AVB took 40.9s. Estimated remaining: 4h 42m 5s. Rate: 7.8 symbols/min [2025-09-19T17:23:47.737441] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:47.805106] [DEBUG] [LOCAL ] AVTR: Loaded 53961 existing records from primary storage. [2025-09-19T17:23:47.805271] [INFO ] [MAIN ] AVTR: Loaded 53961 existing records. [2025-09-19T17:23:47.848462] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-19T17:23:47.994678] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:47.995012] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-19T17:23:47.995066] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-19T17:23:47.998930] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-19T17:23:47.998992] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-19T17:23:48.350729] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:48.643361] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-19T17:23:48.786571] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T17:23:49.443220] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-19T17:23:49.467577] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T17:23:49.600231] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:23:50.243279] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-19T17:23:50.754212] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T17:23:51.043357] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-19T17:23:51.771114] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T17:23:51.843332] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-19T17:23:52.173573] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T17:23:52.643267] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-19T17:23:53.035019] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:23:53.038292] [INFO ] [REMOTE ] AVK: Full fetch complete (26638 records). [2025-09-19T17:23:53.038382] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-19T17:23:53.430268] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-19T17:23:53.430347] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-19T17:23:53.430724] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-19T17:23:53.430803] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-19T17:23:53.431507] [DEBUG] [LOCAL ] AVK: Trimmed 26638 records to 18451 (keeping 200 days of data) [2025-09-19T17:23:53.479878] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-19T17:23:53.549015] [DEBUG] [LOCAL ] AVK: Primary data saved (18451 records). [2025-09-19T17:23:53.549166] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-19T17:23:53.549255] [INFO ] [MAIN ] Update Progress: 185/2372 symbols completed. AVK took 28.9s. Estimated remaining: 4h 41m 37s. Rate: 7.8 symbols/min [2025-09-19T17:23:53.728782] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:53.783428] [DEBUG] [LOCAL ] AVY: Loaded 38091 existing records from primary storage. [2025-09-19T17:23:53.783564] [INFO ] [MAIN ] AVY: Loaded 38091 existing records. [2025-09-19T17:23:53.971504] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:53.971845] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-19T17:23:53.971916] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-19T17:23:53.973788] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-19T17:23:53.973852] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-19T17:23:54.250528] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-19T17:23:54.354040] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:54.704196] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:23:54.809194] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T17:23:55.043262] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-19T17:23:55.843240] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-19T17:23:55.865387] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T17:23:56.643266] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-19T17:23:57.198474] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-19T17:23:57.443263] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-19T17:23:57.495611] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T17:23:57.686096] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T17:23:58.243274] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-19T17:23:59.043304] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-19T17:23:59.351433] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:23:59.843305] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-19T17:23:59.876553] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T17:24:00.643263] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-19T17:24:00.889784] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:24:01.443338] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-19T17:24:01.882443] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:24:02.243287] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-19T17:24:03.043342] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-19T17:24:04.117097] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (3.47 seconds). [2025-09-19T17:24:04.126401] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-19T17:24:04.913867] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-09-19T17:24:04.926342] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-19T17:24:05.006869] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:24:05.443276] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-19T17:24:05.626769] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (3.38 seconds). [2025-09-19T17:24:06.168036] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T17:24:06.243226] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-19T17:24:06.296225] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T17:24:06.533999] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T17:24:06.539561] [INFO ] [REMOTE ] AVNS: Full fetch complete (47724 records). [2025-09-19T17:24:06.539739] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-19T17:24:06.946945] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-19T17:24:06.947056] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-19T17:24:06.947619] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-19T17:24:06.947697] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-19T17:24:06.949236] [DEBUG] [LOCAL ] AVNS: Trimmed 47724 records to 34169 (keeping 200 days of data) [2025-09-19T17:24:07.043883] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-19T17:24:07.175387] [DEBUG] [LOCAL ] AVNS: Primary data saved (34169 records). [2025-09-19T17:24:07.175579] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-19T17:24:07.175709] [INFO ] [MAIN ] Update Progress: 186/2372 symbols completed. AVNS took 31.5s. Estimated remaining: 4h 42m 38s. Rate: 7.7 symbols/min [2025-09-19T17:24:07.355010] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:07.355279] [DEBUG] [LOCAL ] AWF: No existing data file found in primary storage. [2025-09-19T17:24:07.355336] [WARN ] [MAIN ] AWF: No existing data found, performing full refresh instead. [2025-09-19T17:24:07.355499] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-19T17:24:07.355542] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-19T17:24:07.355582] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-09-19T17:24:07.355614] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-19T17:24:07.723454] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:07.843354] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-19T17:24:08.113601] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T17:24:08.439447] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T17:24:08.643313] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-19T17:24:09.449033] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-19T17:24:09.466982] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T17:24:10.243328] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-19T17:24:10.498120] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T17:24:11.043286] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-19T17:24:11.446959] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:24:11.843302] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-19T17:24:12.089590] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T17:24:12.643313] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-19T17:24:13.198944] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T17:24:13.443269] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-19T17:24:14.243342] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-19T17:24:14.451679] [DEBUG] [REMOTE ] AVNT: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-19T17:24:14.452099] [WARN ] [REMOTE ] AVNT: No data returned for month 2025-08 [2025-09-19T17:24:14.748958] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-19T17:24:15.043305] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-19T17:24:15.684710] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-09-19T17:24:15.843245] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-19T17:24:16.409118] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T17:24:16.643300] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-19T17:24:16.799861] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-19T17:24:17.443279] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-19T17:24:17.574665] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T17:24:17.580070] [INFO ] [REMOTE ] AVNT: Full fetch complete (49986 records). [2025-09-19T17:24:17.580200] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-19T17:24:17.769587] [WARN ] [VALIDATOR ] AVNT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-19T17:24:17.770249] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:24:17.770325] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:24:17.770412] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-19T17:24:17.770508] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-19T17:24:17.770555] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-09-19T17:24:17.770944] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-09-19T17:24:17.771062] [INFO ] [MAIN ] Update Progress: 187/2372 symbols completed. AVNT took 31.8s. Estimated remaining: 4h 43m 4s. Rate: 7.7 symbols/min [2025-09-19T17:24:17.947570] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:17.976704] [DEBUG] [LOCAL ] AWI: Loaded 26410 existing records from primary storage. [2025-09-19T17:24:17.976842] [INFO ] [MAIN ] AWI: Loaded 26410 existing records. [2025-09-19T17:24:18.155532] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:18.155832] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-19T17:24:18.155884] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-19T17:24:18.157381] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-19T17:24:18.157443] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-19T17:24:18.253008] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-19T17:24:18.477004] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T17:24:18.565580] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:19.043298] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-19T17:24:19.509805] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T17:24:19.553871] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:24:19.561892] [INFO ] [REMOTE ] AVTR: Full fetch complete (77440 records). [2025-09-19T17:24:19.562036] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-19T17:24:19.848333] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-19T17:24:19.970997] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-19T17:24:19.971091] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-19T17:24:19.971862] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-19T17:24:19.971928] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-19T17:24:19.973480] [DEBUG] [LOCAL ] AVTR: Trimmed 77440 records to 54351 (keeping 200 days of data) [2025-09-19T17:24:20.090000] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T17:24:20.335814] [DEBUG] [LOCAL ] AVTR: Primary data saved (54351 records). [2025-09-19T17:24:20.336011] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-19T17:24:20.336139] [INFO ] [MAIN ] Update Progress: 188/2372 symbols completed. AVTR took 32.8s. Estimated remaining: 4h 41m 55s. Rate: 7.7 symbols/min [2025-09-19T17:24:20.512109] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:20.565760] [DEBUG] [LOCAL ] AWK: Loaded 49258 existing records from primary storage. [2025-09-19T17:24:20.565910] [INFO ] [MAIN ] AWK: Loaded 49258 existing records. [2025-09-19T17:24:20.648534] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-19T17:24:20.744874] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:20.745155] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-19T17:24:20.745208] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-19T17:24:20.747973] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-19T17:24:20.748034] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-19T17:24:21.131361] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:21.132995] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T17:24:21.443265] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-19T17:24:21.632620] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T17:24:22.243262] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-19T17:24:22.743970] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T17:24:23.043286] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-19T17:24:23.843277] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-19T17:24:24.580442] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T17:24:24.643278] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-19T17:24:24.676371] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-19T17:24:24.990263] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T17:24:25.443269] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-19T17:24:26.243272] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-19T17:24:26.282068] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T17:24:27.043346] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-19T17:24:27.694190] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-19T17:24:27.738867] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T17:24:27.843311] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-19T17:24:28.598559] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:24:28.643277] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-19T17:24:29.443269] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-19T17:24:29.629063] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T17:24:29.972535] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T17:24:30.243226] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-19T17:24:30.378437] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T17:24:31.043260] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-19T17:24:31.843284] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-19T17:24:31.878586] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-19T17:24:31.913528] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T17:24:32.643314] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-19T17:24:33.248734] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:24:33.443224] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-19T17:24:34.243275] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-19T17:24:34.505430] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T17:24:34.905836] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T17:24:35.043276] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-19T17:24:35.800026] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:24:35.843248] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-19T17:24:36.605182] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T17:24:36.643211] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-19T17:24:37.299015] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T17:24:37.443345] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-19T17:24:37.656700] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T17:24:37.661141] [INFO ] [REMOTE ] AWI: Full fetch complete (35421 records). [2025-09-19T17:24:37.661353] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-19T17:24:38.052144] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-19T17:24:38.052241] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-19T17:24:38.052718] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-19T17:24:38.052780] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-19T17:24:38.053684] [DEBUG] [LOCAL ] AWI: Trimmed 35421 records to 26546 (keeping 200 days of data) [2025-09-19T17:24:38.218139] [DEBUG] [LOCAL ] AWI: Primary data saved (26546 records). [2025-09-19T17:24:38.218283] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-19T17:24:38.218380] [INFO ] [MAIN ] Update Progress: 189/2372 symbols completed. AWI took 20.4s. Estimated remaining: 4h 43m 45s. Rate: 7.7 symbols/min [2025-09-19T17:24:38.249520] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-19T17:24:38.400207] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:38.423110] [DEBUG] [LOCAL ] AWP: Loaded 22372 existing records from primary storage. [2025-09-19T17:24:38.423303] [INFO ] [MAIN ] AWP: Loaded 22372 existing records. [2025-09-19T17:24:38.626023] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:38.626341] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-19T17:24:38.626398] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-19T17:24:38.627141] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-19T17:24:38.627201] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-19T17:24:39.018437] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:39.043361] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-19T17:24:39.043234] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:24:39.575328] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T17:24:39.583386] [INFO ] [REMOTE ] AVY: Full fetch complete (56007 records). [2025-09-19T17:24:39.583570] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-19T17:24:39.855734] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-19T17:24:40.011135] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-19T17:24:40.011225] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-19T17:24:40.011991] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-19T17:24:40.012058] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-19T17:24:40.013351] [DEBUG] [LOCAL ] AVY: Trimmed 56007 records to 38393 (keeping 200 days of data) [2025-09-19T17:24:40.270938] [DEBUG] [LOCAL ] AVY: Primary data saved (38393 records). [2025-09-19T17:24:40.271087] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-19T17:24:40.271191] [INFO ] [MAIN ] Update Progress: 190/2372 symbols completed. AVY took 46.7s. Estimated remaining: 4h 42m 31s. Rate: 7.7 symbols/min [2025-09-19T17:24:40.509120] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:40.524783] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T17:24:40.549701] [DEBUG] [LOCAL ] AWR: Loaded 22621 existing records from primary storage. [2025-09-19T17:24:40.549836] [INFO ] [MAIN ] AWR: Loaded 22621 existing records. [2025-09-19T17:24:40.648903] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-19T17:24:40.736793] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:40.737075] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-19T17:24:40.737132] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-19T17:24:40.737816] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-19T17:24:40.737878] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-19T17:24:41.030390] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T17:24:41.066314] [INFO ] [REMOTE ] AWF: Full fetch complete (36025 records). [2025-09-19T17:24:41.082099] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-19T17:24:41.222770] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:41.448426] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-19T17:24:41.540215] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-19T17:24:41.540318] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-19T17:24:41.540915] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-19T17:24:41.540981] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-19T17:24:41.542108] [DEBUG] [LOCAL ] AWF: Trimmed 36025 records to 24565 (keeping 200 days of data) [2025-09-19T17:24:41.697089] [DEBUG] [LOCAL ] AWF: Primary data saved (24565 records). [2025-09-19T17:24:41.697232] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-19T17:24:41.697308] [INFO ] [MAIN ] Update Progress: 191/2372 symbols completed. AWF took 34.5s. Estimated remaining: 4h 41m 11s. Rate: 7.8 symbols/min [2025-09-19T17:24:41.874549] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:41.903679] [DEBUG] [LOCAL ] AX: Loaded 29039 existing records from primary storage. [2025-09-19T17:24:41.903824] [INFO ] [MAIN ] AX: Loaded 29039 existing records. [2025-09-19T17:24:42.092072] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:42.092676] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-19T17:24:42.092787] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-19T17:24:42.098771] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-19T17:24:42.101984] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-19T17:24:42.176284] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T17:24:42.248330] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-19T17:24:42.501908] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:42.855467] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:24:43.043256] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-19T17:24:43.628627] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T17:24:43.843261] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-19T17:24:44.521318] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T17:24:44.643302] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-19T17:24:45.124804] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:24:45.443316] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-19T17:24:46.084251] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:24:46.243353] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-19T17:24:47.043277] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-19T17:24:47.115909] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T17:24:47.806684] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:24:47.843233] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-19T17:24:48.650558] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-19T17:24:48.656326] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T17:24:48.671862] [INFO ] [REMOTE ] AWK: Full fetch complete (70531 records). [2025-09-19T17:24:48.672032] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-19T17:24:49.081125] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-19T17:24:49.081229] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-19T17:24:49.082039] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-19T17:24:49.082121] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-19T17:24:49.083806] [DEBUG] [LOCAL ] AWK: Trimmed 70531 records to 49612 (keeping 200 days of data) [2025-09-19T17:24:49.396430] [DEBUG] [LOCAL ] AWK: Primary data saved (49612 records). [2025-09-19T17:24:49.396579] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-19T17:24:49.396696] [INFO ] [MAIN ] Update Progress: 192/2372 symbols completed. AWK took 29.1s. Estimated remaining: 4h 41m 3s. Rate: 7.8 symbols/min [2025-09-19T17:24:49.453484] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-19T17:24:49.569016] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T17:24:49.617521] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:49.668617] [DEBUG] [LOCAL ] AXL: Loaded 50932 existing records from primary storage. [2025-09-19T17:24:49.668789] [INFO ] [MAIN ] AXL: Loaded 50932 existing records. [2025-09-19T17:24:49.853810] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:49.854125] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-19T17:24:49.854183] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-19T17:24:49.855255] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-19T17:24:49.855319] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-19T17:24:50.217237] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:50.230798] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T17:24:50.243213] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-19T17:24:50.357698] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T17:24:51.043280] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-19T17:24:51.137113] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T17:24:51.843262] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-19T17:24:52.643308] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-19T17:24:52.989802] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T17:24:53.036802] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T17:24:53.443274] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-19T17:24:54.234318] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T17:24:54.243236] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-19T17:24:54.762353] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T17:24:55.043273] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-19T17:24:55.843285] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-19T17:24:56.137968] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T17:24:56.175940] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T17:24:56.643260] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-19T17:24:57.130606] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T17:24:57.443314] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-19T17:24:58.007261] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T17:24:58.240930] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-19T17:24:58.246551] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-19T17:24:59.043300] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-19T17:24:59.843318] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-19T17:25:00.150478] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T17:25:00.643276] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-19T17:25:00.918822] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T17:25:01.059609] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:25:01.443277] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-19T17:25:02.214073] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T17:25:02.243309] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-19T17:25:03.041674] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T17:25:03.051984] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-19T17:25:03.484884] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:25:03.843431] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-19T17:25:04.040796] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T17:25:04.044619] [INFO ] [REMOTE ] AWP: Full fetch complete (32575 records). [2025-09-19T17:25:04.044827] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-19T17:25:04.482246] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-19T17:25:04.482354] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-19T17:25:04.482858] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-19T17:25:04.482923] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-19T17:25:04.483992] [DEBUG] [LOCAL ] AWP: Trimmed 32575 records to 22526 (keeping 200 days of data) [2025-09-19T17:25:04.618616] [DEBUG] [LOCAL ] AWP: Primary data saved (22526 records). [2025-09-19T17:25:04.618774] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-19T17:25:04.618863] [INFO ] [MAIN ] Update Progress: 193/2372 symbols completed. AWP took 26.4s. Estimated remaining: 4h 42m 19s. Rate: 7.7 symbols/min [2025-09-19T17:25:04.650514] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-19T17:25:04.796893] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:04.856484] [DEBUG] [LOCAL ] AXP: Loaded 53656 existing records from primary storage. [2025-09-19T17:25:04.856659] [INFO ] [MAIN ] AXP: Loaded 53656 existing records. [2025-09-19T17:25:05.041905] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:05.042243] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-19T17:25:05.042300] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-19T17:25:05.045509] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-19T17:25:05.045574] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-19T17:25:05.407029] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:05.426091] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:25:05.443220] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-19T17:25:06.086573] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T17:25:06.243258] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-19T17:25:07.043268] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-19T17:25:07.623265] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T17:25:07.737732] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T17:25:07.843276] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-19T17:25:08.481058] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T17:25:08.643265] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-19T17:25:09.331509] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T17:25:09.443264] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-19T17:25:10.202978] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:25:10.243220] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-19T17:25:10.801353] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:25:11.043316] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-19T17:25:11.843313] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-19T17:25:12.121203] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T17:25:12.467369] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T17:25:12.643324] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-19T17:25:13.443372] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-19T17:25:14.087300] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:25:14.092108] [INFO ] [REMOTE ] AX: Full fetch complete (42785 records). [2025-09-19T17:25:14.092258] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-19T17:25:14.250076] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-19T17:25:14.530752] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-19T17:25:14.530998] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-19T17:25:14.533162] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T17:25:14.532004] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-19T17:25:14.543365] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-19T17:25:14.544888] [DEBUG] [LOCAL ] AX: Trimmed 42785 records to 29273 (keeping 200 days of data) [2025-09-19T17:25:14.715068] [DEBUG] [LOCAL ] AX: Primary data saved (29273 records). [2025-09-19T17:25:14.715206] [INFO ] [MAIN ] AX: Full history saved. [2025-09-19T17:25:14.715290] [INFO ] [MAIN ] Update Progress: 194/2372 symbols completed. AX took 33.0s. Estimated remaining: 4h 42m 38s. Rate: 7.7 symbols/min [2025-09-19T17:25:14.904991] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:14.910417] [DEBUG] [LOCAL ] AXR: Loaded 3173 existing records from primary storage. [2025-09-19T17:25:14.910522] [INFO ] [MAIN ] AXR: Loaded 3173 existing records. [2025-09-19T17:25:15.052050] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-19T17:25:15.095626] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:15.097552] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-19T17:25:15.109804] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-19T17:25:15.110873] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-19T17:25:15.111370] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T17:25:15.111470] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-19T17:25:15.137452] [INFO ] [REMOTE ] AWR: Full fetch complete (31620 records). [2025-09-19T17:25:15.161704] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-19T17:25:15.942377] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:15.942831] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-19T17:25:15.943862] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-19T17:25:15.943960] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-19T17:25:15.944469] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-19T17:25:15.944511] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-19T17:25:15.945537] [DEBUG] [LOCAL ] AWR: Trimmed 31620 records to 22805 (keeping 200 days of data) [2025-09-19T17:25:16.087663] [DEBUG] [LOCAL ] AWR: Primary data saved (22805 records). [2025-09-19T17:25:16.087818] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-19T17:25:16.087927] [INFO ] [MAIN ] Update Progress: 195/2372 symbols completed. AWR took 35.8s. Estimated remaining: 4h 41m 18s. Rate: 7.7 symbols/min [2025-09-19T17:25:16.295846] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:16.297978] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T17:25:16.349800] [DEBUG] [LOCAL ] AXS: Loaded 38587 existing records from primary storage. [2025-09-19T17:25:16.349955] [INFO ] [MAIN ] AXS: Loaded 38587 existing records. [2025-09-19T17:25:16.530979] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:16.531209] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-19T17:25:16.531257] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-19T17:25:16.532207] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-19T17:25:16.532269] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-19T17:25:16.648391] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-19T17:25:16.895162] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:16.900235] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T17:25:17.266539] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-19T17:25:17.443268] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-19T17:25:18.149338] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:25:18.243229] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-19T17:25:18.403481] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T17:25:19.043270] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-19T17:25:19.843273] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-19T17:25:20.643261] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-19T17:25:20.679184] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T17:25:20.727875] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-19T17:25:20.817870] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T17:25:20.825609] [INFO ] [REMOTE ] AXL: Full fetch complete (72362 records). [2025-09-19T17:25:20.825801] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-19T17:25:21.252127] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-19T17:25:21.252266] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-19T17:25:21.253180] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-19T17:25:21.253259] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-19T17:25:21.255282] [DEBUG] [LOCAL ] AXL: Trimmed 72362 records to 51287 (keeping 200 days of data) [2025-09-19T17:25:21.453968] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-19T17:25:21.556617] [DEBUG] [LOCAL ] AXL: Primary data saved (51287 records). [2025-09-19T17:25:21.556794] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-19T17:25:21.556938] [INFO ] [MAIN ] Update Progress: 196/2372 symbols completed. AXL took 32.2s. Estimated remaining: 4h 40m 45s. Rate: 7.8 symbols/min [2025-09-19T17:25:21.738035] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:21.792505] [DEBUG] [LOCAL ] AXTA: Loaded 52428 existing records from primary storage. [2025-09-19T17:25:21.792752] [INFO ] [MAIN ] AXTA: Loaded 52428 existing records. [2025-09-19T17:25:21.987162] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:21.987499] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-19T17:25:21.987560] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-19T17:25:21.988631] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-19T17:25:21.988738] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-19T17:25:22.244377] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-19T17:25:22.272518] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T17:25:22.353196] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:22.580328] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T17:25:23.043299] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-19T17:25:23.843307] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-19T17:25:24.592731] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T17:25:24.643274] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-19T17:25:24.741968] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T17:25:24.836860] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-19T17:25:25.321238] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T17:25:25.443286] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-19T17:25:26.243262] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-19T17:25:27.043265] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-19T17:25:27.843271] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-19T17:25:27.902452] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-19T17:25:27.946872] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T17:25:28.121287] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T17:25:28.643270] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-19T17:25:28.712463] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-19T17:25:29.443298] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-19T17:25:30.243285] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-19T17:25:30.814107] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T17:25:30.979576] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:25:31.043218] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-19T17:25:31.139740] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-19T17:25:31.612560] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T17:25:31.843280] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-19T17:25:32.643312] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-19T17:25:33.354804] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T17:25:33.356144] [INFO ] [REMOTE ] AXR: Full fetch complete (5013 records). [2025-09-19T17:25:33.356235] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-19T17:25:33.450525] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-19T17:25:33.734218] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-19T17:25:33.734320] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-19T17:25:33.734511] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-19T17:25:33.734563] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-19T17:25:33.734972] [DEBUG] [LOCAL ] AXR: Trimmed 5013 records to 3219 (keeping 200 days of data) [2025-09-19T17:25:33.753940] [DEBUG] [LOCAL ] AXR: Primary data saved (3219 records). [2025-09-19T17:25:33.754011] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-19T17:25:33.754102] [INFO ] [MAIN ] Update Progress: 197/2372 symbols completed. AXR took 19.0s. Estimated remaining: 4h 41m 27s. Rate: 7.7 symbols/min [2025-09-19T17:25:34.244036] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-19T17:25:34.247018] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T17:25:35.043280] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-19T17:25:35.320034] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T17:25:35.843299] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-19T17:25:36.091769] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T17:25:36.643281] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-19T17:25:36.792102] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T17:25:37.443319] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-19T17:25:37.604268] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:25:38.243274] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-19T17:25:38.831013] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T17:25:39.043299] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-19T17:25:39.454622] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T17:25:39.843246] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-19T17:25:39.917185] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-19T17:25:39.930560] [INFO ] [REMOTE ] AXP: Full fetch complete (76928 records). [2025-09-19T17:25:39.930785] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-19T17:25:40.330275] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-19T17:25:40.330360] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-19T17:25:40.331147] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-19T17:25:40.331229] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-19T17:25:40.332809] [DEBUG] [LOCAL ] AXP: Trimmed 76928 records to 54046 (keeping 200 days of data) [2025-09-19T17:25:40.707527] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:25:40.722379] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-19T17:25:40.732389] [DEBUG] [LOCAL ] AXP: Primary data saved (54046 records). [2025-09-19T17:25:40.732543] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-19T17:25:40.732688] [INFO ] [MAIN ] Update Progress: 198/2372 symbols completed. AXP took 36.1s. Estimated remaining: 4h 41m 10s. Rate: 7.7 symbols/min [2025-09-19T17:25:41.614384] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T17:25:41.623780] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-19T17:25:42.120183] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T17:25:42.243337] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-19T17:25:43.497507] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T17:25:43.507336] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-19T17:25:44.123473] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T17:25:44.134384] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-19T17:25:45.205443] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T17:25:45.217061] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-19T17:25:45.554440] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T17:25:45.567529] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-19T17:25:46.814737] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T17:25:46.820632] [INFO ] [REMOTE ] AXS: Full fetch complete (55309 records). [2025-09-19T17:25:46.820808] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-19T17:25:47.209713] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-19T17:25:47.209806] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-19T17:25:47.210393] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-19T17:25:47.210436] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-19T17:25:47.211714] [DEBUG] [LOCAL ] AXS: Trimmed 55309 records to 38897 (keeping 200 days of data) [2025-09-19T17:25:47.476523] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T17:25:47.492530] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-19T17:25:47.511388] [DEBUG] [LOCAL ] AXS: Primary data saved (38897 records). [2025-09-19T17:25:47.511556] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-19T17:25:47.511695] [INFO ] [MAIN ] Update Progress: 199/2372 symbols completed. AXS took 31.4s. Estimated remaining: 4h 40m 52s. Rate: 7.7 symbols/min [2025-09-19T17:25:49.441998] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T17:25:49.450213] [INFO ] [REMOTE ] AXTA: Full fetch complete (74701 records). [2025-09-19T17:25:49.450367] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-19T17:25:49.867288] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-19T17:25:49.867431] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-19T17:25:49.868239] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-19T17:25:49.868303] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-19T17:25:49.869832] [DEBUG] [LOCAL ] AXTA: Trimmed 74701 records to 52811 (keeping 200 days of data) [2025-09-19T17:25:50.186612] [DEBUG] [LOCAL ] AXTA: Primary data saved (52811 records). [2025-09-19T17:25:50.186785] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-19T17:25:50.186878] [INFO ] [MAIN ] Update Progress: 200/2372 symbols completed. AXTA took 28.6s. Estimated remaining: 4h 39m 49s. Rate: 7.8 symbols/min [2025-09-19T17:25:50.783546] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:50.885126] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:50.903286] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-19T17:25:50.925077] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:50.928980] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:50.929339] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-19T17:25:50.931962] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-19T17:25:50.932034] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-19T17:25:50.932082] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-19T17:25:50.932127] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-19T17:25:51.080572] [DEBUG] [LOCAL ] AZO: Loaded 11696 existing records from primary storage. [2025-09-19T17:25:51.099263] [INFO ] [MAIN ] AZO: Loaded 11696 existing records. [2025-09-19T17:25:51.180383] [DEBUG] [LOCAL ] AZZ: Loaded 22399 existing records from primary storage. [2025-09-19T17:25:51.263976] [INFO ] [MAIN ] AZZ: Loaded 22399 existing records. [2025-09-19T17:25:51.320484] [DEBUG] [LOCAL ] AYI: Loaded 25741 existing records from primary storage. [2025-09-19T17:25:51.369621] [INFO ] [MAIN ] AYI: Loaded 25741 existing records. [2025-09-19T17:25:51.649179] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:51.727621] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-19T17:25:51.747665] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-19T17:25:51.804490] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-19T17:25:51.812893] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:51.804666] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-19T17:25:51.852610] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-19T17:25:51.969472] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:52.064509] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-19T17:25:52.090190] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-19T17:25:52.103599] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:52.108835] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-19T17:25:52.128866] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-19T17:25:52.114222] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-19T17:25:52.134147] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-19T17:25:52.161274] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-19T17:25:52.222676] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-19T17:25:52.810934] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:52.864862] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-19T17:25:53.116212] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:53.116859] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-19T17:25:53.138312] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:53.138747] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-19T17:25:53.708760] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T17:25:53.715554] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-19T17:25:54.480881] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T17:25:54.484368] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-19T17:25:54.537241] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:25:54.543534] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-19T17:25:54.659870] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T17:25:54.666149] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-19T17:25:54.686197] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T17:25:54.691559] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-19T17:25:54.922119] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:25:54.922504] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-19T17:25:54.922987] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-19T17:25:55.087925] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T17:25:55.090827] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-19T17:25:55.162179] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:25:55.162524] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-19T17:25:55.301160] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T17:25:55.637870] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T17:25:55.790243] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T17:25:55.843265] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-19T17:25:56.078287] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:25:56.078608] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-19T17:25:56.643326] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-19T17:25:57.443285] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-19T17:25:57.881857] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T17:25:58.122568] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T17:25:58.243254] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-19T17:25:59.043312] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-19T17:25:59.568811] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T17:25:59.843276] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-19T17:26:00.528505] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T17:26:00.643277] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-19T17:26:00.781457] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T17:26:01.443306] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-19T17:26:02.243299] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-19T17:26:02.678756] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T17:26:02.738388] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T17:26:03.043233] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-19T17:26:03.166074] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T17:26:03.843268] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-19T17:26:04.549777] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T17:26:04.643302] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-19T17:26:05.443279] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-19T17:26:05.520508] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-19T17:26:05.966696] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:26:06.183680] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T17:26:06.243240] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-19T17:26:07.043343] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-19T17:26:07.704711] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T17:26:07.843281] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-19T17:26:08.254766] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T17:26:08.643265] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-19T17:26:09.443246] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-19T17:26:09.638451] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T17:26:10.248365] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-19T17:26:10.258597] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:26:10.861465] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T17:26:11.043255] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-19T17:26:11.453571] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:26:11.843263] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-19T17:26:12.643299] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-19T17:26:12.720438] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T17:26:12.723166] [INFO ] [REMOTE ] AZO: Full fetch complete (16398 records). [2025-09-19T17:26:12.723331] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-19T17:26:13.168101] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-19T17:26:13.168363] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-19T17:26:13.169007] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-19T17:26:13.169174] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-19T17:26:13.170819] [DEBUG] [LOCAL ] AZO: Trimmed 16398 records to 11785 (keeping 200 days of data) [2025-09-19T17:26:13.188451] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:26:13.279076] [DEBUG] [LOCAL ] AZO: Primary data saved (11785 records). [2025-09-19T17:26:13.279329] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-19T17:26:13.279451] [INFO ] [MAIN ] Update Progress: 201/2372 symbols completed. AZO took 23.1s. Estimated remaining: 4h 42m 27s. Rate: 7.7 symbols/min [2025-09-19T17:26:13.453372] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-19T17:26:13.486433] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:13.573531] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T17:26:13.581135] [DEBUG] [LOCAL ] BA: Loaded 54181 existing records from primary storage. [2025-09-19T17:26:13.581384] [INFO ] [MAIN ] BA: Loaded 54181 existing records. [2025-09-19T17:26:13.765507] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:13.765871] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-19T17:26:13.765927] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-19T17:26:13.769936] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-19T17:26:13.770008] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-19T17:26:14.177597] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:14.243296] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-19T17:26:15.043271] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-19T17:26:15.843324] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-19T17:26:16.108330] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T17:26:16.139231] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T17:26:16.349205] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T17:26:16.643260] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-19T17:26:16.761546] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T17:26:16.764965] [INFO ] [REMOTE ] AZZ: Full fetch complete (30866 records). [2025-09-19T17:26:16.765052] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-19T17:26:17.151341] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-19T17:26:17.151429] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-19T17:26:17.151837] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-19T17:26:17.151909] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-19T17:26:17.152742] [DEBUG] [LOCAL ] AZZ: Trimmed 30866 records to 22536 (keeping 200 days of data) [2025-09-19T17:26:17.298454] [DEBUG] [LOCAL ] AZZ: Primary data saved (22536 records). [2025-09-19T17:26:17.298630] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-19T17:26:17.298763] [INFO ] [MAIN ] Update Progress: 202/2372 symbols completed. AZZ took 27.1s. Estimated remaining: 4h 41m 39s. Rate: 7.7 symbols/min [2025-09-19T17:26:17.453159] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-19T17:26:17.479923] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:17.547052] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-09-19T17:26:17.547233] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-09-19T17:26:17.732123] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:17.732569] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-19T17:26:17.732619] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-19T17:26:17.735093] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-19T17:26:17.735156] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-19T17:26:18.121086] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:18.243275] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-19T17:26:18.756887] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:26:18.764954] [INFO ] [REMOTE ] B: Full fetch complete (44641 records). [2025-09-19T17:26:18.765106] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-19T17:26:18.958750] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-19T17:26:18.959430] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:26:18.959516] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:26:18.959620] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-19T17:26:18.959908] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-19T17:26:18.960112] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-19T17:26:18.960258] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-19T17:26:18.960422] [INFO ] [MAIN ] Update Progress: 203/2372 symbols completed. B took 28.8s. Estimated remaining: 4h 40m 25s. Rate: 7.7 symbols/min [2025-09-19T17:26:19.062898] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-19T17:26:19.078268] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T17:26:19.159149] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:19.217912] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-09-19T17:26:19.218118] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-09-19T17:26:19.394079] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:19.394343] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-19T17:26:19.394391] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-19T17:26:19.397284] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-19T17:26:19.397348] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-19T17:26:19.749861] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:19.843232] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-19T17:26:20.643277] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-19T17:26:21.069348] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-19T17:26:21.443279] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-19T17:26:21.911682] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:26:21.963350] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.90 seconds). [2025-09-19T17:26:22.243274] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-19T17:26:22.594591] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-19T17:26:23.043269] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-19T17:26:23.843265] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-19T17:26:24.213189] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-09-19T17:26:24.315412] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T17:26:24.643235] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-19T17:26:24.852969] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T17:26:24.856331] [INFO ] [REMOTE ] AYI: Full fetch complete (36811 records). [2025-09-19T17:26:24.856429] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-19T17:26:25.258427] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-19T17:26:25.258564] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-19T17:26:25.259047] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-19T17:26:25.259125] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-19T17:26:25.260465] [DEBUG] [LOCAL ] AYI: Trimmed 36811 records to 25858 (keeping 200 days of data) [2025-09-19T17:26:25.395662] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T17:26:25.444381] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-19T17:26:25.483836] [DEBUG] [LOCAL ] AYI: Primary data saved (25858 records). [2025-09-19T17:26:25.483959] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-19T17:26:25.484048] [INFO ] [MAIN ] Update Progress: 204/2372 symbols completed. AYI took 35.3s. Estimated remaining: 4h 40m 4s. Rate: 7.7 symbols/min [2025-09-19T17:26:25.665807] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:25.665996] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-09-19T17:26:25.666034] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-09-19T17:26:25.666180] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-19T17:26:25.666223] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-19T17:26:25.666266] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-19T17:26:25.666299] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-19T17:26:26.020001] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:26.243269] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-19T17:26:26.952599] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-19T17:26:27.043303] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-19T17:26:27.843269] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-19T17:26:28.282610] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-19T17:26:28.328307] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T17:26:28.643267] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-19T17:26:29.443260] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-19T17:26:30.117483] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T17:26:30.244358] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-19T17:26:30.247556] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (3.20 seconds). [2025-09-19T17:26:31.043266] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-19T17:26:31.314086] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-19T17:26:31.843236] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-19T17:26:32.164872] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T17:26:32.214619] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-19T17:26:32.643312] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-19T17:26:33.443309] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-19T17:26:34.113529] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-19T17:26:34.243265] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-19T17:26:34.308421] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T17:26:35.043335] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-19T17:26:35.204628] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:26:35.309568] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-19T17:26:35.843266] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-19T17:26:36.643268] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-19T17:26:37.105930] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T17:26:37.360968] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-19T17:26:37.443231] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-19T17:26:38.243302] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-19T17:26:38.812529] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:26:38.864942] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-09-19T17:26:39.043281] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-19T17:26:39.843307] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-19T17:26:39.922097] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-19T17:26:40.643296] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-19T17:26:40.847259] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-19T17:26:40.970436] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T17:26:41.443279] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-19T17:26:42.243289] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-19T17:26:42.635041] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-19T17:26:42.813159] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T17:26:43.043223] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-19T17:26:43.091541] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T17:26:43.843276] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-19T17:26:44.468914] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:26:44.558299] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T17:26:44.643260] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-19T17:26:45.443263] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-19T17:26:46.243284] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-19T17:26:46.752799] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T17:26:46.875791] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-09-19T17:26:47.043244] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-19T17:26:47.243618] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T17:26:47.843296] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-19T17:26:48.643312] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-19T17:26:48.917538] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-19T17:26:49.443282] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-19T17:26:50.057579] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-19T17:26:50.071841] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-19T17:26:50.072157] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-19T17:26:50.676147] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-19T17:26:50.736627] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-19T17:26:50.737015] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-19T17:26:50.737229] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-19T17:26:50.739078] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-19T17:26:50.739371] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-19T17:26:50.739198] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-19T17:26:50.927867] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54600 (keeping 200 days of data) [2025-09-19T17:26:50.936873] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T17:26:51.072544] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-19T17:26:51.449194] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-19T17:26:51.449566] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-19T17:26:51.450848] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-19T17:26:51.451522] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-19T17:26:51.457017] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54588 (keeping 200 days of data) [2025-09-19T17:26:51.876637] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-19T17:26:51.894716] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-19T17:26:51.896587] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-19T17:26:52.479160] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-19T17:26:52.480343] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-19T17:26:52.482637] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-19T17:26:52.483042] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-19T17:26:52.522737] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 54571 (keeping 200 days of data) [2025-09-19T17:26:52.521972] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-09-19T17:26:52.523998] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-19T17:26:52.524949] [INFO ] [MAIN ] Update Progress: 205/2372 symbols completed. BABA took 35.2s. Estimated remaining: 4h 43m 21s. Rate: 7.6 symbols/min [2025-09-19T17:26:52.835384] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:52.856302] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-09-19T17:26:52.857011] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-19T17:26:52.857272] [INFO ] [MAIN ] Update Progress: 206/2372 symbols completed. BAC took 33.9s. Estimated remaining: 4h 41m 54s. Rate: 7.7 symbols/min [2025-09-19T17:26:53.179479] [DEBUG] [LOCAL ] BAK: Loaded 39196 existing records from primary storage. [2025-09-19T17:26:53.180751] [INFO ] [MAIN ] BAK: Loaded 39196 existing records. [2025-09-19T17:26:53.177500] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:53.401398] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:53.415975] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-19T17:26:53.416136] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-19T17:26:53.434759] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-19T17:26:53.436240] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-19T17:26:53.458945] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T17:26:53.519833] [INFO ] [REMOTE ] BAH: Full fetch complete (74827 records). [2025-09-19T17:26:53.567532] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-19T17:26:53.737289] [DEBUG] [LOCAL ] BALL: Loaded 52223 existing records from primary storage. [2025-09-19T17:26:53.766937] [INFO ] [MAIN ] BALL: Loaded 52223 existing records. [2025-09-19T17:26:54.458560] [DEBUG] [LOCAL ] BA: Primary data saved (54571 records). [2025-09-19T17:26:54.387616] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:54.454616] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:54.464153] [INFO ] [MAIN ] BA: Full history saved. [2025-09-19T17:26:54.464558] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-19T17:26:54.491284] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-19T17:26:54.475118] [INFO ] [MAIN ] Update Progress: 207/2372 symbols completed. BA took 41.2s. Estimated remaining: 4h 40m 41s. Rate: 7.7 symbols/min [2025-09-19T17:26:54.491597] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-19T17:26:54.534592] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-19T17:26:54.534751] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-19T17:26:54.890282] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-19T17:26:54.942699] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-19T17:26:54.968496] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:54.964818] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-19T17:26:54.968669] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-19T17:26:55.002783] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-19T17:26:55.023409] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-19T17:26:55.023871] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-19T17:26:55.024036] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-19T17:26:55.024243] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-19T17:26:55.024306] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-19T17:26:55.035935] [DEBUG] [LOCAL ] BAH: Trimmed 74827 records to 52533 (keeping 200 days of data) [2025-09-19T17:26:55.439237] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:55.467937] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-19T17:26:55.670665] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:55.671487] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-19T17:26:55.907007] [DEBUG] [LOCAL ] BAH: Primary data saved (52533 records). [2025-09-19T17:26:55.907200] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-19T17:26:55.907318] [INFO ] [MAIN ] Update Progress: 208/2372 symbols completed. BAH took 30.4s. Estimated remaining: 4h 39m 27s. Rate: 7.7 symbols/min [2025-09-19T17:26:56.083191] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:56.083421] [DEBUG] [LOCAL ] BAM: No existing data file found in primary storage. [2025-09-19T17:26:56.083465] [WARN ] [MAIN ] BAM: No existing data found, performing full refresh instead. [2025-09-19T17:26:56.083612] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-19T17:26:56.083697] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-19T17:26:56.083764] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-09-19T17:26:56.083799] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-19T17:26:56.450992] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:56.451346] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-19T17:26:56.483797] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T17:26:56.494607] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-19T17:26:56.762285] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T17:26:56.767198] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-19T17:26:57.530450] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:26:57.540933] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-19T17:26:57.620392] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T17:26:57.626991] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-19T17:26:58.255414] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:26:58.263597] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-19T17:26:58.410461] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T17:26:58.412839] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-19T17:26:58.439136] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T17:26:59.043271] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-19T17:26:59.450378] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:26:59.486489] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T17:26:59.553684] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T17:26:59.843271] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-19T17:27:00.643272] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-19T17:27:00.853340] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T17:27:00.882564] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T17:27:01.443257] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-19T17:27:02.243270] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-19T17:27:02.279069] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T17:27:03.043267] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-19T17:27:03.843267] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-19T17:27:04.114794] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T17:27:04.361253] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-09-19T17:27:04.643276] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-19T17:27:05.443295] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-19T17:27:05.500046] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:27:05.570058] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-19T17:27:06.243277] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-19T17:27:06.638326] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T17:27:06.704373] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T17:27:07.043324] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-19T17:27:07.786619] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:27:07.843237] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-19T17:27:08.101923] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T17:27:08.250912] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-19T17:27:08.643298] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-19T17:27:09.443275] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-19T17:27:09.881585] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:27:10.243246] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-19T17:27:10.405852] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T17:27:10.407715] [INFO ] [REMOTE ] BALY: Full fetch complete (17573 records). [2025-09-19T17:27:10.407793] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-19T17:27:10.408299] [FATAL] [VALIDATOR ] BALY: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:27:10.408386] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:27:10.408430] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:27:10.408494] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-19T17:27:10.408560] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-19T17:27:10.408601] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-19T17:27:10.408707] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-19T17:27:10.408827] [INFO ] [MAIN ] Update Progress: 209/2372 symbols completed. BALY took 15.9s. Estimated remaining: 4h 40m 30s. Rate: 7.7 symbols/min [2025-09-19T17:27:10.599996] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:10.657454] [DEBUG] [LOCAL ] BANC: Loaded 51659 existing records from primary storage. [2025-09-19T17:27:10.657623] [INFO ] [MAIN ] BANC: Loaded 51659 existing records. [2025-09-19T17:27:10.840617] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:27:10.840929] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-19T17:27:10.840988] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-19T17:27:10.843489] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-19T17:27:10.843554] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-19T17:27:11.048547] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-19T17:27:11.197028] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:11.843334] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-19T17:27:12.033546] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T17:27:12.643278] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-19T17:27:13.443331] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-19T17:27:14.514884] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T17:27:14.531909] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-19T17:27:14.770496] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T17:27:14.813212] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (3.76 seconds). [2025-09-19T17:27:15.043239] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-19T17:27:15.571154] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T17:27:15.843286] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-19T17:27:15.992576] [DEBUG] [REMOTE ] BANC: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T17:27:15.992924] [WARN ] [REMOTE ] BANC: No data returned for month 2025-01 [2025-09-19T17:27:16.461865] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T17:27:16.561766] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:27:16.643274] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-19T17:27:17.443280] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-19T17:27:18.243295] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-19T17:27:18.650931] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:27:19.030962] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T17:27:19.043224] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-19T17:27:19.543975] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T17:27:19.549527] [INFO ] [REMOTE ] BAK: Full fetch complete (56861 records). [2025-09-19T17:27:19.549715] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-19T17:27:19.550521] [FATAL] [VALIDATOR ] BAK: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:27:19.550614] [FATAL] [MAIN ] BAK: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:27:19.550693] [WARN ] [MAIN ] BAK: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:27:19.550748] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-19T17:27:19.550809] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-09-19T17:27:19.550846] [INFO ] [LOCAL ] BAK: Starting deletion of derivative data. [2025-09-19T17:27:19.551306] [DEBUG] [LOCAL ] BAK: Deleted derivative data file. [2025-09-19T17:27:19.551411] [INFO ] [MAIN ] Update Progress: 210/2372 symbols completed. BAK took 27.0s. Estimated remaining: 4h 40m 36s. Rate: 7.7 symbols/min [2025-09-19T17:27:19.725446] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:19.725671] [DEBUG] [LOCAL ] BAP: No existing data file found in primary storage. [2025-09-19T17:27:19.725729] [WARN ] [MAIN ] BAP: No existing data found, performing full refresh instead. [2025-09-19T17:27:19.725871] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-19T17:27:19.725915] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-19T17:27:19.725957] [DEBUG] [LOCAL ] BAP: No primary data file found to delete. [2025-09-19T17:27:19.725989] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-19T17:27:19.848485] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-19T17:27:20.103884] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:20.600327] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T17:27:20.643258] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-19T17:27:21.443277] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-19T17:27:22.100070] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T17:27:22.243265] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-19T17:27:22.547427] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T17:27:22.644106] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:27:23.043294] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-19T17:27:23.789454] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T17:27:23.843264] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-19T17:27:24.643263] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-19T17:27:25.216799] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:27:25.443313] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-19T17:27:25.517865] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T17:27:25.588475] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T17:27:26.243273] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-19T17:27:27.043284] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-19T17:27:27.423181] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T17:27:27.843233] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-19T17:27:28.558124] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T17:27:28.643267] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-19T17:27:29.049900] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T17:27:29.057595] [INFO ] [REMOTE ] BAM: Full fetch complete (73914 records). [2025-09-19T17:27:29.057744] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-19T17:27:29.458543] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-19T17:27:29.454919] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-19T17:27:29.458783] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-19T17:27:29.460621] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-19T17:27:29.460877] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-19T17:27:29.477361] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:27:29.476580] [DEBUG] [LOCAL ] BAM: Trimmed 73914 records to 52787 (keeping 200 days of data) [2025-09-19T17:27:29.807309] [DEBUG] [LOCAL ] BAM: Primary data saved (52787 records). [2025-09-19T17:27:29.807452] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-19T17:27:29.807529] [INFO ] [MAIN ] Update Progress: 211/2372 symbols completed. BAM took 33.9s. Estimated remaining: 4h 40m 53s. Rate: 7.7 symbols/min [2025-09-19T17:27:29.980734] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:30.026023] [DEBUG] [LOCAL ] BARK: Loaded 38908 existing records from primary storage. [2025-09-19T17:27:30.026158] [INFO ] [MAIN ] BARK: Loaded 38908 existing records. [2025-09-19T17:27:30.206922] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:27:30.207324] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-19T17:27:30.207430] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-19T17:27:30.218076] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-19T17:27:30.236011] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-19T17:27:30.248998] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-19T17:27:30.270042] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T17:27:30.642161] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:31.043264] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-19T17:27:31.584372] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T17:27:31.615073] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T17:27:31.843296] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-19T17:27:32.643255] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-19T17:27:33.159040] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T17:27:33.166610] [INFO ] [REMOTE ] BALL: Full fetch complete (75316 records). [2025-09-19T17:27:33.166780] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-19T17:27:33.444351] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-19T17:27:33.574629] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-19T17:27:33.583254] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-19T17:27:33.598639] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-19T17:27:33.598903] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-19T17:27:33.601460] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T17:27:33.611671] [DEBUG] [LOCAL ] BALL: Trimmed 75316 records to 52602 (keeping 200 days of data) [2025-09-19T17:27:33.929879] [DEBUG] [LOCAL ] BALL: Primary data saved (52602 records). [2025-09-19T17:27:33.930005] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-19T17:27:33.930108] [INFO ] [MAIN ] Update Progress: 212/2372 symbols completed. BALL took 41.1s. Estimated remaining: 4h 40m 8s. Rate: 7.7 symbols/min [2025-09-19T17:27:34.097177] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:34.151308] [DEBUG] [LOCAL ] BAX: Loaded 53879 existing records from primary storage. [2025-09-19T17:27:34.151463] [INFO ] [MAIN ] BAX: Loaded 53879 existing records. [2025-09-19T17:27:34.251432] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-19T17:27:34.348016] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:27:34.348350] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-19T17:27:34.348417] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-19T17:27:34.351363] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-19T17:27:34.351451] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-19T17:27:34.738461] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:34.769018] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T17:27:35.003429] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:27:35.043218] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-19T17:27:35.843302] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-19T17:27:35.916722] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T17:27:36.007276] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T17:27:36.643310] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-19T17:27:37.443299] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-19T17:27:38.020144] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T17:27:38.082684] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T17:27:38.243291] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-19T17:27:39.043238] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-19T17:27:39.077368] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:27:39.249988] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T17:27:39.843264] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-19T17:27:40.432960] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T17:27:40.643285] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-19T17:27:41.443257] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-19T17:27:42.030991] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T17:27:42.243241] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-19T17:27:42.276546] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T17:27:42.306438] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:27:43.043323] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-19T17:27:43.843352] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-19T17:27:44.133908] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T17:27:44.142430] [INFO ] [REMOTE ] BANC: Full fetch complete (66483 records). [2025-09-19T17:27:44.142689] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-19T17:27:44.368121] [WARN ] [VALIDATOR ] BANC: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T17:27:44.369184] [FATAL] [MAIN ] BANC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:27:44.369496] [WARN ] [MAIN ] BANC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:27:44.369592] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-19T17:27:44.369868] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-09-19T17:27:44.369981] [INFO ] [LOCAL ] BANC: Starting deletion of derivative data. [2025-09-19T17:27:44.375997] [DEBUG] [LOCAL ] BANC: Deleted derivative data file. [2025-09-19T17:27:44.376165] [INFO ] [MAIN ] Update Progress: 213/2372 symbols completed. BANC took 34.0s. Estimated remaining: 4h 40m 27s. Rate: 7.7 symbols/min [2025-09-19T17:27:44.413419] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T17:27:44.463480] [INFO ] [REMOTE ] BAP: Full fetch complete (38228 records). [2025-09-19T17:27:44.484844] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-19T17:27:44.662618] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-19T17:27:44.704877] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:45.034983] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-19T17:27:45.036234] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-19T17:27:45.036845] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-19T17:27:45.036964] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-19T17:27:45.038002] [DEBUG] [LOCAL ] BB: Loaded 53314 existing records from primary storage. [2025-09-19T17:27:45.038493] [INFO ] [MAIN ] BB: Loaded 53314 existing records. [2025-09-19T17:27:45.105379] [DEBUG] [LOCAL ] BAP: Trimmed 38228 records to 26919 (keeping 200 days of data) [2025-09-19T17:27:45.320464] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:27:45.321841] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-19T17:27:45.322489] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-19T17:27:45.326878] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-19T17:27:45.327197] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-19T17:27:45.717376] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:45.721200] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-19T17:27:45.777184] [DEBUG] [LOCAL ] BAP: Primary data saved (26919 records). [2025-09-19T17:27:45.777353] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-19T17:27:45.777514] [INFO ] [MAIN ] Update Progress: 214/2372 symbols completed. BAP took 26.2s. Estimated remaining: 4h 39m 15s. Rate: 7.7 symbols/min [2025-09-19T17:27:45.910455] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T17:27:45.991406] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:45.991603] [DEBUG] [LOCAL ] BBAI: No existing data file found in primary storage. [2025-09-19T17:27:45.991683] [WARN ] [MAIN ] BBAI: No existing data found, performing full refresh instead. [2025-09-19T17:27:45.991837] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-19T17:27:45.991883] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-19T17:27:45.991962] [DEBUG] [LOCAL ] BBAI: No primary data file found to delete. [2025-09-19T17:27:45.992010] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-19T17:27:46.248387] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-19T17:27:46.401714] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:46.555636] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T17:27:47.043327] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-19T17:27:47.843308] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-19T17:27:48.069173] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T17:27:48.381047] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T17:27:48.643260] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-19T17:27:49.443277] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-19T17:27:49.543917] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T17:27:49.951495] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-19T17:27:50.243277] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-19T17:27:50.806229] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T17:27:50.998485] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T17:27:51.043304] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-19T17:27:51.843318] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-19T17:27:52.595809] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T17:27:52.643253] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-19T17:27:53.443323] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-19T17:27:53.643771] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-19T17:27:53.952728] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T17:27:54.243278] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-19T17:27:55.043307] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-19T17:27:55.507139] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-09-19T17:27:55.609977] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T17:27:55.843368] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-19T17:27:56.171600] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T17:27:56.643258] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-19T17:27:57.311412] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-19T17:27:57.443284] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-19T17:27:58.243232] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-19T17:27:58.679251] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-19T17:27:58.921363] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T17:27:59.043238] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-19T17:27:59.109856] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:27:59.607509] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:27:59.843279] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-19T17:28:00.643267] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-19T17:28:00.932814] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:28:00.966218] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T17:28:01.443288] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-19T17:28:02.243280] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-19T17:28:03.011893] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T17:28:03.022540] [INFO ] [REMOTE ] BAX: Full fetch complete (77436 records). [2025-09-19T17:28:03.022742] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-19T17:28:03.057661] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-19T17:28:03.447601] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-19T17:28:03.447866] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-19T17:28:03.448746] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-19T17:28:03.448872] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-19T17:28:03.450928] [DEBUG] [LOCAL ] BAX: Trimmed 77436 records to 54268 (keeping 200 days of data) [2025-09-19T17:28:03.714168] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-19T17:28:03.843710] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-19T17:28:03.854071] [DEBUG] [LOCAL ] BAX: Primary data saved (54268 records). [2025-09-19T17:28:03.854529] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-19T17:28:03.854745] [INFO ] [MAIN ] Update Progress: 215/2372 symbols completed. BAX took 29.9s. Estimated remaining: 4h 40m 51s. Rate: 7.7 symbols/min [2025-09-19T17:28:03.903345] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:28:03.977229] [INFO ] [REMOTE ] BARK: Full fetch complete (57265 records). [2025-09-19T17:28:03.979826] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-19T17:28:04.154234] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:04.484730] [DEBUG] [LOCAL ] BBAR: Loaded 41348 existing records from primary storage. [2025-09-19T17:28:04.505509] [INFO ] [MAIN ] BBAR: Loaded 41348 existing records. [2025-09-19T17:28:04.563248] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-19T17:28:04.586018] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-19T17:28:04.603359] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-19T17:28:04.614080] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-19T17:28:04.676919] [DEBUG] [LOCAL ] BARK: Trimmed 57265 records to 39179 (keeping 200 days of data) [2025-09-19T17:28:04.758115] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:04.767727] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-19T17:28:04.793322] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-19T17:28:04.795413] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-19T17:28:04.796318] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-19T17:28:05.280621] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:05.281511] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-19T17:28:05.310627] [DEBUG] [LOCAL ] BARK: Primary data saved (39179 records). [2025-09-19T17:28:05.310822] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-19T17:28:05.311794] [INFO ] [MAIN ] Update Progress: 216/2372 symbols completed. BARK took 35.5s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-19T17:28:05.491775] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:05.550072] [DEBUG] [LOCAL ] BBD: Loaded 53566 existing records from primary storage. [2025-09-19T17:28:05.550221] [INFO ] [MAIN ] BBD: Loaded 53566 existing records. [2025-09-19T17:28:05.740205] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:05.740581] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-19T17:28:05.740637] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-19T17:28:05.759280] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-19T17:28:05.759574] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-19T17:28:05.866142] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-19T17:28:05.898914] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-19T17:28:06.160172] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:06.243275] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-19T17:28:06.794520] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T17:28:06.837679] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-09-19T17:28:07.043272] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-19T17:28:07.843242] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-19T17:28:08.326290] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-19T17:28:08.447369] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T17:28:08.643263] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-19T17:28:09.361549] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:28:09.443233] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-19T17:28:09.876429] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-09-19T17:28:10.243272] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-19T17:28:10.695635] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T17:28:10.901580] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T17:28:11.043260] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-19T17:28:11.843267] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-19T17:28:12.174319] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T17:28:12.322700] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:28:12.643285] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-19T17:28:13.443280] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-19T17:28:13.582499] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T17:28:14.243270] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-19T17:28:15.043260] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-19T17:28:15.454586] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T17:28:15.758082] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:28:15.767974] [INFO ] [REMOTE ] BB: Full fetch complete (76947 records). [2025-09-19T17:28:15.768215] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-19T17:28:15.848722] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-19T17:28:16.198473] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.56 seconds). [2025-09-19T17:28:16.234375] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-19T17:28:16.234551] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-19T17:28:16.235625] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-19T17:28:16.235878] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-19T17:28:16.237862] [DEBUG] [LOCAL ] BB: Trimmed 76947 records to 53703 (keeping 200 days of data) [2025-09-19T17:28:16.559851] [DEBUG] [LOCAL ] BB: Primary data saved (53703 records). [2025-09-19T17:28:16.560011] [INFO ] [MAIN ] BB: Full history saved. [2025-09-19T17:28:16.560159] [INFO ] [MAIN ] Update Progress: 217/2372 symbols completed. BB took 32.2s. Estimated remaining: 4h 40m 6s. Rate: 7.7 symbols/min [2025-09-19T17:28:16.653833] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-19T17:28:16.744290] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:16.780823] [DEBUG] [LOCAL ] BBDC: Loaded 33755 existing records from primary storage. [2025-09-19T17:28:16.780959] [INFO ] [MAIN ] BBDC: Loaded 33755 existing records. [2025-09-19T17:28:16.997603] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:28:16.995859] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:17.007001] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-19T17:28:17.007086] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-19T17:28:17.008851] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-19T17:28:17.008932] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-19T17:28:17.386964] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:17.419392] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:28:17.443223] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-19T17:28:18.243270] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-19T17:28:19.043239] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-19T17:28:19.504821] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:28:19.768728] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (3.11 seconds). [2025-09-19T17:28:19.843219] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-19T17:28:20.052822] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:28:20.533588] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T17:28:20.643268] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-19T17:28:21.443289] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-19T17:28:21.806771] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T17:28:22.243264] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-19T17:28:22.885862] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:28:23.043279] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-19T17:28:23.120386] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (3.28 seconds). [2025-09-19T17:28:23.131879] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-19T17:28:23.132167] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-19T17:28:23.557715] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-19T17:28:23.557931] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-19T17:28:23.558991] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-19T17:28:23.559082] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-19T17:28:23.561577] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-19T17:28:23.702006] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T17:28:23.844694] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-19T17:28:23.956124] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-09-19T17:28:23.956354] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-19T17:28:23.956459] [INFO ] [MAIN ] Update Progress: 218/2372 symbols completed. BBAI took 38.2s. Estimated remaining: 4h 39m 54s. Rate: 7.7 symbols/min [2025-09-19T17:28:24.139659] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:24.147892] [DEBUG] [LOCAL ] BBDO: Loaded 5090 existing records from primary storage. [2025-09-19T17:28:24.148040] [INFO ] [MAIN ] BBDO: Loaded 5090 existing records. [2025-09-19T17:28:24.350131] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:24.350529] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-19T17:28:24.350584] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-19T17:28:24.351020] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-19T17:28:24.351084] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-19T17:28:24.648860] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-19T17:28:24.747368] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:25.114469] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T17:28:25.443278] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-19T17:28:25.558014] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T17:28:26.243267] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-19T17:28:26.293780] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T17:28:27.043303] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-19T17:28:27.387012] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:28:27.789627] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T17:28:27.797234] [INFO ] [REMOTE ] BBAR: Full fetch complete (60459 records). [2025-09-19T17:28:27.797425] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-19T17:28:27.848466] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-19T17:28:28.205612] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-19T17:28:28.211391] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-19T17:28:28.212797] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-19T17:28:28.213244] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-19T17:28:28.213135] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T17:28:28.217109] [DEBUG] [LOCAL ] BBAR: Trimmed 60459 records to 41690 (keeping 200 days of data) [2025-09-19T17:28:28.479806] [DEBUG] [LOCAL ] BBAR: Primary data saved (41690 records). [2025-09-19T17:28:28.479943] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-19T17:28:28.480028] [INFO ] [MAIN ] Update Progress: 219/2372 symbols completed. BBAR took 24.6s. Estimated remaining: 4h 39m 14s. Rate: 7.7 symbols/min [2025-09-19T17:28:28.652905] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-19T17:28:28.656468] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:28.677699] [DEBUG] [LOCAL ] BBN: Loaded 18195 existing records from primary storage. [2025-09-19T17:28:28.677838] [INFO ] [MAIN ] BBN: Loaded 18195 existing records. [2025-09-19T17:28:28.853639] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:28.853963] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-19T17:28:28.854013] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-19T17:28:28.855462] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-19T17:28:28.855525] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-19T17:28:29.216925] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:29.325706] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T17:28:29.443240] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-19T17:28:30.243324] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-19T17:28:30.293843] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T17:28:30.419879] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-19T17:28:31.043344] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-19T17:28:31.836686] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T17:28:31.843204] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-19T17:28:32.592613] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:28:32.643217] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-19T17:28:33.046778] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T17:28:33.443292] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-19T17:28:34.243277] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-19T17:28:34.473053] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:28:34.483406] [INFO ] [REMOTE ] BBD: Full fetch complete (77118 records). [2025-09-19T17:28:34.483597] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-19T17:28:34.878934] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-19T17:28:34.879035] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-19T17:28:34.879838] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-19T17:28:34.879907] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-19T17:28:34.881609] [DEBUG] [LOCAL ] BBD: Trimmed 77118 records to 53954 (keeping 200 days of data) [2025-09-19T17:28:34.999956] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T17:28:35.080354] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-19T17:28:35.247396] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T17:28:35.265436] [DEBUG] [LOCAL ] BBD: Primary data saved (53954 records). [2025-09-19T17:28:35.265556] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-19T17:28:35.266568] [INFO ] [MAIN ] Update Progress: 220/2372 symbols completed. BBD took 30.0s. Estimated remaining: 4h 38m 57s. Rate: 7.7 symbols/min [2025-09-19T17:28:35.436516] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:35.436721] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-19T17:28:35.436769] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-19T17:28:35.436965] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-19T17:28:35.437018] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-19T17:28:35.437060] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-19T17:28:35.437092] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-19T17:28:35.804043] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:35.843230] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-19T17:28:36.238207] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:36.238537] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-19T17:28:36.249673] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T17:28:36.643301] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-19T17:28:37.130745] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:37.131066] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-19T17:28:37.443265] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-19T17:28:37.663982] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:37.664350] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-19T17:28:38.243271] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-19T17:28:39.043311] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-19T17:28:39.176103] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T17:28:39.277410] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:39.277801] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-19T17:28:39.843273] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-19T17:28:40.643321] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-19T17:28:40.741754] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:28:41.443298] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-19T17:28:42.243307] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-19T17:28:42.338515] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T17:28:42.381556] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T17:28:42.489087] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:42.489507] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-19T17:28:43.043282] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-19T17:28:43.622952] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T17:28:43.843261] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-19T17:28:44.581022] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T17:28:44.643230] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-19T17:28:45.378811] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:28:45.443345] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-19T17:28:45.680513] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:45.680964] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-19T17:28:46.243311] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-19T17:28:47.043293] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-19T17:28:47.548329] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T17:28:47.773316] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T17:28:47.843230] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-19T17:28:48.630492] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T17:28:48.631747] [INFO ] [REMOTE ] BBDO: Full fetch complete (7835 records). [2025-09-19T17:28:48.631822] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-19T17:28:48.648396] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-19T17:28:48.984254] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:49.010235] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-19T17:28:49.010445] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-19T17:28:49.010524] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-19T17:28:49.011067] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-19T17:28:49.011128] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-19T17:28:49.011540] [DEBUG] [LOCAL ] BBDO: Trimmed 7835 records to 5129 (keeping 200 days of data) [2025-09-19T17:28:49.041064] [DEBUG] [LOCAL ] BBDO: Primary data saved (5129 records). [2025-09-19T17:28:49.041140] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-19T17:28:49.041218] [INFO ] [MAIN ] Update Progress: 221/2372 symbols completed. BBDO took 25.1s. Estimated remaining: 4h 39m 47s. Rate: 7.7 symbols/min [2025-09-19T17:28:49.207201] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:49.213189] [DEBUG] [LOCAL ] BBU: Loaded 4094 existing records from primary storage. [2025-09-19T17:28:49.213284] [INFO ] [MAIN ] BBU: Loaded 4094 existing records. [2025-09-19T17:28:49.391940] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:49.392219] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-19T17:28:49.392318] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-19T17:28:49.392609] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-19T17:28:49.392696] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-19T17:28:49.452927] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-19T17:28:49.744601] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:50.243263] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-19T17:28:51.042300] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T17:28:51.044124] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-19T17:28:51.206928] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T17:28:51.836930] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T17:28:51.843213] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-19T17:28:52.585464] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T17:28:52.643319] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-19T17:28:53.443240] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-19T17:28:53.866719] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T17:28:53.930291] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T17:28:54.243330] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-19T17:28:54.855152] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T17:28:55.043348] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-19T17:28:55.273152] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:55.273551] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-19T17:28:55.843266] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-19T17:28:56.643273] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-19T17:28:57.452753] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-19T17:28:57.454678] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T17:28:57.582755] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:28:57.696427] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:57.696855] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-19T17:28:58.243263] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-19T17:28:59.043268] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-19T17:28:59.831602] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-19T17:28:59.843223] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-19T17:29:00.161541] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T17:29:00.168050] [INFO ] [REMOTE ] BBT: Full fetch complete (4305 records). [2025-09-19T17:29:00.168162] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-19T17:29:00.356210] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 14 unique days, need 200 days [2025-09-19T17:29:00.356430] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:29:00.356499] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:29:00.356569] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-19T17:29:00.356637] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-19T17:29:00.356717] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-19T17:29:00.356786] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-19T17:29:00.356848] [INFO ] [MAIN ] Update Progress: 222/2372 symbols completed. BBT took 25.1s. Estimated remaining: 4h 40m 14s. Rate: 7.7 symbols/min [2025-09-19T17:29:00.533892] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:00.550170] [DEBUG] [LOCAL ] BBUC: Loaded 13344 existing records from primary storage. [2025-09-19T17:29:00.550311] [INFO ] [MAIN ] BBUC: Loaded 13344 existing records. [2025-09-19T17:29:00.651269] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-19T17:29:00.740462] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:00.740785] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-19T17:29:00.740839] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-19T17:29:00.742745] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-19T17:29:00.742807] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-19T17:29:01.124941] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:01.126311] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T17:29:01.130319] [INFO ] [REMOTE ] BBN: Full fetch complete (27003 records). [2025-09-19T17:29:01.130415] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-19T17:29:01.437547] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T17:29:01.449942] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-19T17:29:01.512448] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-19T17:29:01.512535] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-19T17:29:01.513002] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-19T17:29:01.513078] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-19T17:29:01.513907] [DEBUG] [LOCAL ] BBN: Trimmed 27003 records to 18292 (keeping 200 days of data) [2025-09-19T17:29:01.630252] [DEBUG] [LOCAL ] BBN: Primary data saved (18292 records). [2025-09-19T17:29:01.630409] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-19T17:29:01.630495] [INFO ] [MAIN ] Update Progress: 223/2372 symbols completed. BBN took 33.2s. Estimated remaining: 4h 39m 3s. Rate: 7.7 symbols/min [2025-09-19T17:29:01.801664] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:01.852335] [DEBUG] [LOCAL ] BBVA: Loaded 49977 existing records from primary storage. [2025-09-19T17:29:01.852509] [INFO ] [MAIN ] BBVA: Loaded 49977 existing records. [2025-09-19T17:29:02.031534] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:02.031804] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-19T17:29:02.031861] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-19T17:29:02.035636] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-19T17:29:02.035722] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-19T17:29:02.144766] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T17:29:02.251208] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-19T17:29:02.411733] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:03.043267] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-19T17:29:03.376931] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T17:29:03.843273] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-19T17:29:03.996100] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:29:04.643282] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-19T17:29:05.443271] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-19T17:29:05.678060] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T17:29:06.200578] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T17:29:06.242163] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T17:29:06.248390] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-19T17:29:06.842103] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T17:29:06.843725] [INFO ] [REMOTE ] BBU: Full fetch complete (6042 records). [2025-09-19T17:29:06.843810] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-19T17:29:07.048491] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-19T17:29:07.224284] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-19T17:29:07.224370] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-19T17:29:07.224598] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-19T17:29:07.224682] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-19T17:29:07.225130] [DEBUG] [LOCAL ] BBU: Trimmed 6042 records to 4115 (keeping 200 days of data) [2025-09-19T17:29:07.250532] [DEBUG] [LOCAL ] BBU: Primary data saved (4115 records). [2025-09-19T17:29:07.250627] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-19T17:29:07.250788] [INFO ] [MAIN ] Update Progress: 224/2372 symbols completed. BBU took 18.2s. Estimated remaining: 4h 38m 34s. Rate: 7.7 symbols/min [2025-09-19T17:29:07.432797] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:07.462055] [DEBUG] [LOCAL ] BBW: Loaded 26696 existing records from primary storage. [2025-09-19T17:29:07.462250] [INFO ] [MAIN ] BBW: Loaded 26696 existing records. [2025-09-19T17:29:07.652950] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:07.653232] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-19T17:29:07.653284] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-19T17:29:07.655542] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-19T17:29:07.655606] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-19T17:29:07.852725] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-19T17:29:08.021437] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:08.643277] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-19T17:29:09.069964] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T17:29:09.176822] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T17:29:09.443284] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-19T17:29:09.694528] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T17:29:10.243272] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-19T17:29:11.043281] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-19T17:29:11.318447] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T17:29:11.662683] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:29:11.843302] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-19T17:29:12.067698] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T17:29:12.643285] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-19T17:29:13.443250] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-19T17:29:13.966425] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T17:29:14.161050] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T17:29:14.167728] [INFO ] [REMOTE ] BBDC: Full fetch complete (49067 records). [2025-09-19T17:29:14.167987] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-19T17:29:14.248581] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-19T17:29:14.597829] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-19T17:29:14.597937] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-19T17:29:14.598549] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-19T17:29:14.598594] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-19T17:29:14.600251] [DEBUG] [LOCAL ] BBDC: Trimmed 49067 records to 33965 (keeping 200 days of data) [2025-09-19T17:29:14.716226] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T17:29:14.828665] [DEBUG] [LOCAL ] BBDC: Primary data saved (33965 records). [2025-09-19T17:29:14.828824] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-19T17:29:14.828919] [INFO ] [MAIN ] Update Progress: 225/2372 symbols completed. BBDC took 58.3s. Estimated remaining: 4h 38m 24s. Rate: 7.7 symbols/min [2025-09-19T17:29:14.998147] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:15.049631] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-19T17:29:15.053170] [DEBUG] [LOCAL ] BBWI: Loaded 53964 existing records from primary storage. [2025-09-19T17:29:15.053353] [INFO ] [MAIN ] BBWI: Loaded 53964 existing records. [2025-09-19T17:29:15.230230] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:15.230528] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-19T17:29:15.230578] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-19T17:29:15.234231] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-19T17:29:15.234295] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-19T17:29:15.591363] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:15.843275] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-19T17:29:16.153446] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T17:29:16.430205] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T17:29:16.643271] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-19T17:29:17.443287] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-19T17:29:18.007481] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T17:29:18.033593] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T17:29:18.243269] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-19T17:29:18.989755] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T17:29:19.043219] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-19T17:29:19.721694] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T17:29:19.843263] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-19T17:29:20.643255] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-19T17:29:21.103247] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:29:21.213297] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T17:29:21.443278] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-19T17:29:21.793706] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T17:29:22.243268] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-19T17:29:22.929451] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T17:29:23.043233] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-19T17:29:23.843245] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-19T17:29:24.144238] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T17:29:24.369998] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T17:29:24.561205] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T17:29:24.643265] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-19T17:29:25.443246] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-19T17:29:25.902746] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T17:29:26.243290] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-19T17:29:27.043286] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-19T17:29:27.610669] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:29:27.816283] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T17:29:27.843210] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-19T17:29:28.269782] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:29:28.643276] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-19T17:29:29.063238] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T17:29:29.443254] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-19T17:29:30.243282] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-19T17:29:30.631917] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T17:29:30.713373] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T17:29:30.715688] [INFO ] [REMOTE ] BBUC: Full fetch complete (17234 records). [2025-09-19T17:29:30.715764] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-19T17:29:31.048365] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-19T17:29:31.091444] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-19T17:29:31.091578] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-19T17:29:31.091952] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-19T17:29:31.092016] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-19T17:29:31.092709] [DEBUG] [LOCAL ] BBUC: Trimmed 17234 records to 13440 (keeping 200 days of data) [2025-09-19T17:29:31.175475] [DEBUG] [LOCAL ] BBUC: Primary data saved (13440 records). [2025-09-19T17:29:31.175614] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-19T17:29:31.175823] [INFO ] [MAIN ] Update Progress: 226/2372 symbols completed. BBUC took 30.8s. Estimated remaining: 4h 39m 38s. Rate: 7.7 symbols/min [2025-09-19T17:29:31.344447] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:31.403845] [DEBUG] [LOCAL ] BBY: Loaded 53876 existing records from primary storage. [2025-09-19T17:29:31.404017] [INFO ] [MAIN ] BBY: Loaded 53876 existing records. [2025-09-19T17:29:31.588284] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:31.588636] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-19T17:29:31.588727] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-19T17:29:31.591461] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-19T17:29:31.591526] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-19T17:29:31.852385] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-19T17:29:31.994105] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:32.623381] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T17:29:32.648623] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-19T17:29:32.652424] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:29:33.443234] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-19T17:29:34.139607] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T17:29:34.243243] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-19T17:29:34.787570] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T17:29:35.043280] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-19T17:29:35.602952] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T17:29:35.843248] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-19T17:29:36.484719] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T17:29:36.548668] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T17:29:36.643252] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-19T17:29:37.443256] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-19T17:29:37.758113] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T17:29:38.243272] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-19T17:29:38.975682] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T17:29:39.043224] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-19T17:29:39.301679] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T17:29:39.307047] [INFO ] [REMOTE ] BBW: Full fetch complete (39110 records). [2025-09-19T17:29:39.307143] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-19T17:29:39.701192] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-19T17:29:39.701297] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-19T17:29:39.701857] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-19T17:29:39.701923] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-19T17:29:39.703054] [DEBUG] [LOCAL ] BBW: Trimmed 39110 records to 26896 (keeping 200 days of data) [2025-09-19T17:29:39.851314] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-19T17:29:39.865003] [DEBUG] [LOCAL ] BBW: Primary data saved (26896 records). [2025-09-19T17:29:39.865141] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-19T17:29:39.865249] [INFO ] [MAIN ] Update Progress: 227/2372 symbols completed. BBW took 32.6s. Estimated remaining: 4h 39m 38s. Rate: 7.7 symbols/min [2025-09-19T17:29:40.042242] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:40.092568] [DEBUG] [LOCAL ] BC: Loaded 45007 existing records from primary storage. [2025-09-19T17:29:40.092752] [INFO ] [MAIN ] BC: Loaded 45007 existing records. [2025-09-19T17:29:40.295274] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:40.295627] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-19T17:29:40.295729] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-19T17:29:40.299077] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-19T17:29:40.299228] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-19T17:29:40.688297] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:40.688766] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-19T17:29:40.740322] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-19T17:29:40.968803] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T17:29:41.443254] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-19T17:29:42.243253] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-19T17:29:42.391800] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-19T17:29:42.404569] [INFO ] [REMOTE ] BBVA: Full fetch complete (71578 records). [2025-09-19T17:29:42.404875] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-19T17:29:42.846871] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-19T17:29:42.847022] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-19T17:29:42.847786] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-19T17:29:42.847928] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-19T17:29:42.851108] [DEBUG] [LOCAL ] BBVA: Trimmed 71578 records to 50331 (keeping 200 days of data) [2025-09-19T17:29:42.963738] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T17:29:43.052061] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-19T17:29:43.181257] [DEBUG] [LOCAL ] BBVA: Primary data saved (50331 records). [2025-09-19T17:29:43.181396] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-19T17:29:43.181491] [INFO ] [MAIN ] Update Progress: 228/2372 symbols completed. BBVA took 41.6s. Estimated remaining: 4h 38m 48s. Rate: 7.7 symbols/min [2025-09-19T17:29:43.352003] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:43.352268] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-09-19T17:29:43.352325] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-09-19T17:29:43.352469] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-19T17:29:43.352514] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-19T17:29:43.352557] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-19T17:29:43.352590] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-19T17:29:43.731985] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:43.765808] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T17:29:43.843234] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-19T17:29:43.878996] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T17:29:44.159580] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:29:44.643283] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-19T17:29:45.443279] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-19T17:29:46.149484] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T17:29:46.243267] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-19T17:29:46.391385] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T17:29:47.043342] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-19T17:29:47.243291] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T17:29:47.668611] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:29:47.843292] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-19T17:29:48.392903] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T17:29:48.643281] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-19T17:29:49.443306] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-19T17:29:49.667765] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T17:29:50.243345] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-19T17:29:50.412368] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T17:29:50.420431] [INFO ] [REMOTE ] BBWI: Full fetch complete (77410 records). [2025-09-19T17:29:50.420586] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-19T17:29:50.827933] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-19T17:29:50.828056] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-19T17:29:50.829250] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-19T17:29:50.829333] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-19T17:29:50.831486] [DEBUG] [LOCAL ] BBWI: Trimmed 77410 records to 54354 (keeping 200 days of data) [2025-09-19T17:29:51.048359] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-19T17:29:51.177468] [DEBUG] [LOCAL ] BBWI: Primary data saved (54354 records). [2025-09-19T17:29:51.177620] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-19T17:29:51.177749] [INFO ] [MAIN ] Update Progress: 229/2372 symbols completed. BBWI took 36.3s. Estimated remaining: 4h 38m 42s. Rate: 7.7 symbols/min [2025-09-19T17:29:51.351910] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:51.381771] [DEBUG] [LOCAL ] BCC: Loaded 28653 existing records from primary storage. [2025-09-19T17:29:51.381908] [INFO ] [MAIN ] BCC: Loaded 28653 existing records. [2025-09-19T17:29:51.607527] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:51.607905] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-19T17:29:51.607972] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-19T17:29:51.609062] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-19T17:29:51.609124] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-19T17:29:52.005449] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:52.006031] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-19T17:29:52.009160] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-19T17:29:52.039346] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T17:29:52.643273] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-19T17:29:53.220760] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T17:29:53.297718] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T17:29:53.443261] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-19T17:29:54.243274] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-19T17:29:54.376438] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T17:29:55.043275] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-19T17:29:55.612203] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T17:29:55.620019] [INFO ] [REMOTE ] BBY: Full fetch complete (77254 records). [2025-09-19T17:29:55.620144] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-19T17:29:55.852810] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-19T17:29:56.027252] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-19T17:29:56.027425] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-19T17:29:56.028341] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-19T17:29:56.028459] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-19T17:29:56.048529] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:29:56.055714] [DEBUG] [LOCAL ] BBY: Trimmed 77254 records to 54263 (keeping 200 days of data) [2025-09-19T17:29:56.404874] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T17:29:56.441219] [DEBUG] [LOCAL ] BBY: Primary data saved (54263 records). [2025-09-19T17:29:56.441360] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-19T17:29:56.443189] [INFO ] [MAIN ] Update Progress: 230/2372 symbols completed. BBY took 25.3s. Estimated remaining: 4h 38m 11s. Rate: 7.7 symbols/min [2025-09-19T17:29:56.614543] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:56.647986] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-19T17:29:56.669941] [DEBUG] [LOCAL ] BCE: Loaded 52752 existing records from primary storage. [2025-09-19T17:29:56.670108] [INFO ] [MAIN ] BCE: Loaded 52752 existing records. [2025-09-19T17:29:56.855589] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:56.855865] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-19T17:29:56.855923] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-19T17:29:56.857252] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-19T17:29:56.857325] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-19T17:29:57.223706] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:57.388966] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:29:57.443229] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-19T17:29:58.243263] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-19T17:29:58.457104] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T17:29:58.995159] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T17:29:59.043226] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-19T17:29:59.843262] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-19T17:29:59.998836] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T17:30:00.619905] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T17:30:00.643212] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-19T17:30:01.201589] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:30:01.443287] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-19T17:30:02.243317] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-19T17:30:02.719858] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T17:30:03.043298] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-19T17:30:03.843326] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-19T17:30:04.294883] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-09-19T17:30:04.643281] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-19T17:30:05.645992] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (3.40 seconds). [2025-09-19T17:30:05.659473] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-19T17:30:05.752745] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-19T17:30:06.243355] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-19T17:30:06.435692] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-19T17:30:07.031072] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T17:30:07.040288] [INFO ] [REMOTE ] BC: Full fetch complete (63325 records). [2025-09-19T17:30:07.040444] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-19T17:30:07.042458] [FATAL] [VALIDATOR ] BC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:30:07.042572] [FATAL] [MAIN ] BC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:30:07.042639] [WARN ] [MAIN ] BC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:30:07.042724] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-19T17:30:07.042821] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-09-19T17:30:07.042878] [INFO ] [LOCAL ] BC: Starting deletion of derivative data. [2025-09-19T17:30:07.043301] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-19T17:30:07.043541] [DEBUG] [LOCAL ] BC: Deleted derivative data file. [2025-09-19T17:30:07.043808] [INFO ] [MAIN ] Update Progress: 231/2372 symbols completed. BC took 27.2s. Estimated remaining: 4h 38m 29s. Rate: 7.7 symbols/min [2025-09-19T17:30:07.229257] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:07.229499] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-09-19T17:30:07.229583] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-09-19T17:30:07.229829] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-19T17:30:07.229898] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-19T17:30:07.229967] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-19T17:30:07.230048] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-19T17:30:07.684549] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:07.775210] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T17:30:07.843299] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-19T17:30:08.048272] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-19T17:30:08.643286] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-19T17:30:09.142879] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:30:09.268940] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:30:09.443273] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-19T17:30:10.051015] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T17:30:10.243278] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-19T17:30:11.019765] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T17:30:11.043229] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-19T17:30:11.552512] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T17:30:11.843266] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-19T17:30:12.643250] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-19T17:30:13.064396] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:30:13.069134] [INFO ] [REMOTE ] BCC: Full fetch complete (40036 records). [2025-09-19T17:30:13.069274] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-19T17:30:13.452900] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-19T17:30:13.457054] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-19T17:30:13.457124] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-19T17:30:13.457708] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-19T17:30:13.457799] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-19T17:30:13.459550] [DEBUG] [LOCAL ] BCC: Trimmed 40036 records to 28900 (keeping 200 days of data) [2025-09-19T17:30:13.653465] [DEBUG] [LOCAL ] BCC: Primary data saved (28900 records). [2025-09-19T17:30:13.653611] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-19T17:30:13.653792] [INFO ] [MAIN ] Update Progress: 232/2372 symbols completed. BCC took 22.5s. Estimated remaining: 4h 38m 10s. Rate: 7.7 symbols/min [2025-09-19T17:30:13.831639] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:13.851603] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:30:13.879198] [DEBUG] [LOCAL ] BCO: Loaded 26698 existing records from primary storage. [2025-09-19T17:30:13.879337] [INFO ] [MAIN ] BCO: Loaded 26698 existing records. [2025-09-19T17:30:14.062785] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:14.063059] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-19T17:30:14.063108] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-19T17:30:14.063930] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-19T17:30:14.064002] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-19T17:30:14.253522] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-19T17:30:14.438273] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:15.043264] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-19T17:30:15.123950] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-19T17:30:15.843275] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-19T17:30:15.940487] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T17:30:16.643278] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-19T17:30:17.612482] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T17:30:17.618110] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-19T17:30:17.877345] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T17:30:17.886828] [INFO ] [REMOTE ] BCAT: Full fetch complete (49927 records). [2025-09-19T17:30:17.887071] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-19T17:30:18.278755] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (3.24 seconds). [2025-09-19T17:30:18.306102] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-19T17:30:18.401442] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-19T17:30:18.402120] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-19T17:30:18.407234] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-19T17:30:18.407961] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-19T17:30:18.409728] [DEBUG] [LOCAL ] BCAT: Trimmed 49927 records to 35198 (keeping 200 days of data) [2025-09-19T17:30:18.677515] [DEBUG] [LOCAL ] BCAT: Primary data saved (35198 records). [2025-09-19T17:30:18.678275] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-19T17:30:18.678409] [INFO ] [MAIN ] Update Progress: 233/2372 symbols completed. BCAT took 35.5s. Estimated remaining: 4h 37m 37s. Rate: 7.7 symbols/min [2025-09-19T17:30:18.695598] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (5.24 seconds). [2025-09-19T17:30:18.890848] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:18.889295] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T17:30:18.957896] [DEBUG] [LOCAL ] BCS: Loaded 53865 existing records from primary storage. [2025-09-19T17:30:18.958049] [INFO ] [MAIN ] BCS: Loaded 53865 existing records. [2025-09-19T17:30:19.048406] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-19T17:30:19.141590] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:19.141866] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-19T17:30:19.141914] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-19T17:30:19.143210] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-19T17:30:19.143273] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-19T17:30:19.489751] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:30:19.528717] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:19.843275] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-19T17:30:20.643247] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-19T17:30:21.163599] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T17:30:21.335024] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T17:30:21.443286] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-19T17:30:22.243237] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-19T17:30:22.322539] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:30:22.879379] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T17:30:23.043302] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-19T17:30:23.843265] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-19T17:30:24.435387] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T17:30:24.643266] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-19T17:30:25.443267] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-19T17:30:25.642804] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:30:25.732679] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T17:30:26.243233] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-19T17:30:26.828292] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:30:26.946599] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T17:30:27.043270] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-19T17:30:27.765367] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T17:30:27.843271] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-19T17:30:27.961060] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T17:30:28.643315] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-19T17:30:29.443268] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-19T17:30:29.603488] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T17:30:29.909761] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T17:30:30.243285] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-19T17:30:31.043304] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-19T17:30:31.344554] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T17:30:31.843309] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-19T17:30:32.525107] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T17:30:32.643283] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-19T17:30:33.207231] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T17:30:33.350711] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T17:30:33.443302] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-19T17:30:34.243294] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-19T17:30:34.806334] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:30:35.043242] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-19T17:30:35.272237] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-19T17:30:35.843277] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-19T17:30:35.994175] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T17:30:36.566442] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:30:36.643290] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-19T17:30:37.443305] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-19T17:30:38.223745] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-19T17:30:38.243227] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-19T17:30:38.317385] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T17:30:39.043285] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-19T17:30:39.560249] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T17:30:39.575401] [INFO ] [REMOTE ] BCE: Full fetch complete (76183 records). [2025-09-19T17:30:39.575638] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-19T17:30:39.849371] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-19T17:30:40.004773] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-19T17:30:40.004884] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-19T17:30:40.005638] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-19T17:30:40.005734] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-19T17:30:40.007377] [DEBUG] [LOCAL ] BCE: Trimmed 76183 records to 53142 (keeping 200 days of data) [2025-09-19T17:30:40.400585] [DEBUG] [LOCAL ] BCE: Primary data saved (53142 records). [2025-09-19T17:30:40.401002] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-19T17:30:40.402349] [INFO ] [MAIN ] Update Progress: 234/2372 symbols completed. BCE took 44.0s. Estimated remaining: 4h 39m 36s. Rate: 7.6 symbols/min [2025-09-19T17:30:40.653197] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:40.676909] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:30:40.685545] [INFO ] [REMOTE ] BCH: Full fetch complete (40790 records). [2025-09-19T17:30:40.685840] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-19T17:30:40.910757] [DEBUG] [LOCAL ] BCSF: Loaded 28159 existing records from primary storage. [2025-09-19T17:30:40.917460] [INFO ] [MAIN ] BCSF: Loaded 28159 existing records. [2025-09-19T17:30:40.928539] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-19T17:30:41.083007] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-19T17:30:41.452398] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:41.490177] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-19T17:30:41.490883] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-19T17:30:41.506670] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-19T17:30:41.512143] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-19T17:30:41.724921] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-19T17:30:41.737213] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-19T17:30:41.739026] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-19T17:30:41.744792] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-19T17:30:41.799454] [DEBUG] [LOCAL ] BCH: Trimmed 40790 records to 30018 (keeping 200 days of data) [2025-09-19T17:30:41.890315] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T17:30:42.050039] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-19T17:30:42.167146] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:42.242931] [DEBUG] [LOCAL ] BCH: Primary data saved (30018 records). [2025-09-19T17:30:42.243166] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-19T17:30:42.243362] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-19T17:30:42.243278] [INFO ] [MAIN ] Update Progress: 235/2372 symbols completed. BCH took 35.2s. Estimated remaining: 4h 38m 34s. Rate: 7.7 symbols/min [2025-09-19T17:30:42.425373] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:42.449900] [DEBUG] [LOCAL ] BCX: Loaded 22175 existing records from primary storage. [2025-09-19T17:30:42.450096] [INFO ] [MAIN ] BCX: Loaded 22175 existing records. [2025-09-19T17:30:42.637086] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:42.637433] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-19T17:30:42.637490] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-19T17:30:42.638208] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-19T17:30:42.638278] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-19T17:30:43.014007] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:43.043306] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-19T17:30:43.110671] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T17:30:43.565519] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T17:30:43.569554] [INFO ] [REMOTE ] BCO: Full fetch complete (36851 records). [2025-09-19T17:30:43.569709] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-19T17:30:43.849426] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-19T17:30:43.977598] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-19T17:30:43.977923] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-19T17:30:43.978534] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-19T17:30:43.978630] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-19T17:30:43.993338] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:30:43.998896] [DEBUG] [LOCAL ] BCO: Trimmed 36851 records to 26929 (keeping 200 days of data) [2025-09-19T17:30:44.173804] [DEBUG] [LOCAL ] BCO: Primary data saved (26929 records). [2025-09-19T17:30:44.173954] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-19T17:30:44.174047] [INFO ] [MAIN ] Update Progress: 236/2372 symbols completed. BCO took 30.5s. Estimated remaining: 4h 37m 33s. Rate: 7.7 symbols/min [2025-09-19T17:30:44.345565] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:44.373049] [DEBUG] [LOCAL ] BDC: Loaded 25249 existing records from primary storage. [2025-09-19T17:30:44.373194] [INFO ] [MAIN ] BDC: Loaded 25249 existing records. [2025-09-19T17:30:44.555942] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:44.556249] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-19T17:30:44.556303] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-19T17:30:44.556957] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-19T17:30:44.557017] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-19T17:30:44.659456] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-19T17:30:44.962226] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:44.956326] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T17:30:45.443271] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-19T17:30:46.227750] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T17:30:46.243228] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-19T17:30:46.363975] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T17:30:46.392931] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-19T17:30:46.401337] [INFO ] [REMOTE ] BCS: Full fetch complete (77247 records). [2025-09-19T17:30:46.401556] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-19T17:30:46.836222] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-19T17:30:46.836330] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-19T17:30:46.837261] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-19T17:30:46.837331] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-19T17:30:46.838919] [DEBUG] [LOCAL ] BCS: Trimmed 77247 records to 54253 (keeping 200 days of data) [2025-09-19T17:30:47.045983] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-19T17:30:47.201452] [DEBUG] [LOCAL ] BCS: Primary data saved (54253 records). [2025-09-19T17:30:47.201611] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-19T17:30:47.201744] [INFO ] [MAIN ] Update Progress: 237/2372 symbols completed. BCS took 28.5s. Estimated remaining: 4h 36m 42s. Rate: 7.7 symbols/min [2025-09-19T17:30:47.506299] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T17:30:47.843282] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-19T17:30:47.924385] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T17:30:48.643294] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-19T17:30:49.443321] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-19T17:30:49.566908] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T17:30:49.641571] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T17:30:50.243317] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-19T17:30:50.826352] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T17:30:51.043273] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-19T17:30:51.758331] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T17:30:51.843279] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-19T17:30:52.597198] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T17:30:52.643240] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-19T17:30:52.673921] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T17:30:53.443271] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-19T17:30:53.861914] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T17:30:54.243312] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-19T17:30:55.043284] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-19T17:30:55.159620] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:30:55.670096] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:30:55.843295] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-19T17:30:56.205689] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T17:30:56.643236] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-19T17:30:57.359791] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T17:30:57.443247] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-19T17:30:58.015939] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:30:58.243262] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-19T17:30:58.378581] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T17:30:59.039968] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-19T17:30:59.044434] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-19T17:30:59.843328] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-19T17:31:00.388486] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:31:00.643293] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-19T17:31:01.168789] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T17:31:01.172112] [INFO ] [REMOTE ] BCX: Full fetch complete (34093 records). [2025-09-19T17:31:01.172252] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-19T17:31:01.451077] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-19T17:31:01.575659] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-19T17:31:01.575765] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-19T17:31:01.576241] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-19T17:31:01.576285] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-19T17:31:01.577238] [DEBUG] [LOCAL ] BCX: Trimmed 34093 records to 22297 (keeping 200 days of data) [2025-09-19T17:31:01.708216] [DEBUG] [LOCAL ] BCX: Primary data saved (22297 records). [2025-09-19T17:31:01.708361] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-19T17:31:01.708446] [INFO ] [MAIN ] Update Progress: 238/2372 symbols completed. BCX took 19.5s. Estimated remaining: 4h 37m 35s. Rate: 7.7 symbols/min [2025-09-19T17:31:02.078673] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:31:02.083036] [INFO ] [REMOTE ] BCSF: Full fetch complete (37699 records). [2025-09-19T17:31:02.083127] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-19T17:31:02.526717] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-19T17:31:02.526820] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-19T17:31:02.527292] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-19T17:31:02.527333] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-19T17:31:02.528176] [DEBUG] [LOCAL ] BCSF: Trimmed 37699 records to 28369 (keeping 200 days of data) [2025-09-19T17:31:02.700405] [DEBUG] [LOCAL ] BCSF: Primary data saved (28369 records). [2025-09-19T17:31:02.700540] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-19T17:31:02.700624] [INFO ] [MAIN ] Update Progress: 239/2372 symbols completed. BCSF took 22.3s. Estimated remaining: 4h 36m 26s. Rate: 7.7 symbols/min [2025-09-19T17:31:02.758144] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T17:31:02.764319] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-19T17:31:04.419836] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:31:04.426478] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-19T17:31:05.773550] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:31:05.779330] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-19T17:31:06.528780] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T17:31:06.537608] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-19T17:31:08.347603] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:31:08.353670] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-19T17:31:09.877369] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T17:31:09.883244] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-19T17:31:11.445871] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T17:31:11.449630] [INFO ] [REMOTE ] BDC: Full fetch complete (35613 records). [2025-09-19T17:31:11.449789] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-19T17:31:11.829665] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-19T17:31:11.829761] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-19T17:31:11.830233] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-19T17:31:11.830282] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-19T17:31:11.831239] [DEBUG] [LOCAL ] BDC: Trimmed 35613 records to 25371 (keeping 200 days of data) [2025-09-19T17:31:11.991739] [DEBUG] [LOCAL ] BDC: Primary data saved (25371 records). [2025-09-19T17:31:11.991882] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-19T17:31:11.991965] [INFO ] [MAIN ] Update Progress: 240/2372 symbols completed. BDC took 27.8s. Estimated remaining: 4h 36m 32s. Rate: 7.7 symbols/min [2025-09-19T17:31:12.643256] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:12.649327] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:12.733452] [DEBUG] [LOCAL ] BDJ: No existing data file found in primary storage. [2025-09-19T17:31:12.733319] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:12.712308] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:12.734356] [WARN ] [MAIN ] BDJ: No existing data found, performing full refresh instead. [2025-09-19T17:31:12.734827] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-19T17:31:12.734968] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-19T17:31:12.735187] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-09-19T17:31:12.735282] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-19T17:31:13.180804] [DEBUG] [LOCAL ] BDN: Loaded 48037 existing records from primary storage. [2025-09-19T17:31:13.179835] [DEBUG] [LOCAL ] BDX: Loaded 52896 existing records from primary storage. [2025-09-19T17:31:13.206245] [INFO ] [MAIN ] BDN: Loaded 48037 existing records. [2025-09-19T17:31:13.206059] [INFO ] [MAIN ] BDX: Loaded 52896 existing records. [2025-09-19T17:31:13.212602] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-09-19T17:31:13.312923] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:13.328059] [INFO ] [MAIN ] BE: Loaded 54043 existing records. [2025-09-19T17:31:13.393604] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-19T17:31:13.834283] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:13.840154] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:13.840625] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-19T17:31:13.834143] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:13.840784] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-19T17:31:13.841139] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-19T17:31:13.841384] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-19T17:31:13.841336] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-19T17:31:13.841531] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-19T17:31:13.842582] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-19T17:31:13.842683] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-19T17:31:13.854260] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-19T17:31:13.864599] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-19T17:31:13.854446] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-19T17:31:13.886226] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-19T17:31:14.878909] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:14.911383] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:14.927114] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-19T17:31:14.908341] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-19T17:31:14.998762] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:14.999211] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-19T17:31:15.306705] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T17:31:15.314626] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-19T17:31:16.616597] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T17:31:16.627584] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-19T17:31:16.872688] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T17:31:16.879375] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-19T17:31:17.004422] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:31:17.014553] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-19T17:31:17.273722] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T17:31:17.284636] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-19T17:31:17.858628] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T17:31:17.864898] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-19T17:31:18.024046] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T17:31:18.034819] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-19T17:31:18.453040] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:31:18.463497] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-19T17:31:19.340249] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T17:31:19.346683] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-19T17:31:19.606618] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T17:31:19.617739] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-19T17:31:19.749612] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T17:31:19.759612] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-19T17:31:19.890193] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T17:31:19.899942] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-19T17:31:20.330540] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T17:31:20.338618] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-19T17:31:21.392053] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T17:31:21.402560] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-19T17:31:21.488212] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T17:31:21.500060] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-19T17:31:21.616207] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T17:31:21.821412] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T17:31:22.243340] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-19T17:31:23.043423] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-19T17:31:23.459143] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T17:31:23.603705] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:31:23.843335] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-19T17:31:23.953227] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T17:31:24.584810] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T17:31:24.643248] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-19T17:31:25.194935] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:31:25.443270] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-19T17:31:26.243299] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-19T17:31:26.410194] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T17:31:27.043271] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-19T17:31:27.438050] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T17:31:27.843290] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-19T17:31:28.146207] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T17:31:28.508716] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T17:31:28.643260] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-19T17:31:29.272243] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:31:29.443261] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-19T17:31:30.243320] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-19T17:31:30.932385] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-19T17:31:31.043231] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-19T17:31:31.838526] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T17:31:31.843124] [INFO ] [REMOTE ] BDJ: Full fetch complete (42828 records). [2025-09-19T17:31:31.843250] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-19T17:31:31.843431] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-19T17:31:32.249663] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-19T17:31:32.249868] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-19T17:31:32.250451] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-19T17:31:32.250525] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-19T17:31:32.251990] [DEBUG] [LOCAL ] BDJ: Trimmed 42828 records to 29626 (keeping 200 days of data) [2025-09-19T17:31:32.375464] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-19T17:31:32.472195] [DEBUG] [LOCAL ] BDJ: Primary data saved (29626 records). [2025-09-19T17:31:32.472346] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-19T17:31:32.472428] [INFO ] [MAIN ] Update Progress: 241/2372 symbols completed. BDJ took 20.5s. Estimated remaining: 4h 38m 16s. Rate: 7.7 symbols/min [2025-09-19T17:31:32.648013] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-19T17:31:32.647924] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:32.648281] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-19T17:31:32.648361] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-19T17:31:32.649730] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-19T17:31:32.649784] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-19T17:31:32.650016] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-19T17:31:32.650048] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-19T17:31:33.107717] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:33.149183] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T17:31:33.211074] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:31:33.443336] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-19T17:31:34.243318] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-19T17:31:34.365146] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T17:31:34.749728] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-19T17:31:35.043270] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-19T17:31:35.314447] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-19T17:31:35.425277] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:31:35.432785] [INFO ] [REMOTE ] BDN: Full fetch complete (69267 records). [2025-09-19T17:31:35.432928] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-19T17:31:35.846390] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-19T17:31:35.846517] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-19T17:31:35.847378] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-19T17:31:35.847510] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-19T17:31:35.845958] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-19T17:31:35.850718] [DEBUG] [LOCAL ] BDN: Trimmed 69267 records to 48364 (keeping 200 days of data) [2025-09-19T17:31:36.147870] [DEBUG] [LOCAL ] BDN: Primary data saved (48364 records). [2025-09-19T17:31:36.148010] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-19T17:31:36.148162] [INFO ] [MAIN ] Update Progress: 242/2372 symbols completed. BDN took 24.2s. Estimated remaining: 4h 37m 32s. Rate: 7.7 symbols/min [2025-09-19T17:31:36.345001] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:36.402875] [DEBUG] [LOCAL ] BEKE: Loaded 53656 existing records from primary storage. [2025-09-19T17:31:36.403054] [INFO ] [MAIN ] BEKE: Loaded 53656 existing records. [2025-09-19T17:31:36.602268] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:36.602542] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-19T17:31:36.602592] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-19T17:31:36.604137] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-19T17:31:36.604200] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-19T17:31:36.652525] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-19T17:31:37.005261] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:37.194557] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T17:31:37.443258] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-19T17:31:37.498481] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T17:31:38.243298] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-19T17:31:39.043291] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-19T17:31:39.726814] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T17:31:39.843266] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-19T17:31:40.007328] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:31:40.643286] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-19T17:31:41.443291] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-19T17:31:41.620869] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-19T17:31:42.017796] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:31:42.243300] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-19T17:31:42.275834] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:31:42.283742] [INFO ] [REMOTE ] BDX: Full fetch complete (75924 records). [2025-09-19T17:31:42.283915] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-19T17:31:42.727154] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-19T17:31:42.729163] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-19T17:31:42.729376] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-19T17:31:42.741060] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-19T17:31:42.741676] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-19T17:31:42.743695] [DEBUG] [LOCAL ] BDX: Trimmed 75924 records to 53259 (keeping 200 days of data) [2025-09-19T17:31:43.051161] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-19T17:31:43.077518] [DEBUG] [LOCAL ] BDX: Primary data saved (53259 records). [2025-09-19T17:31:43.077697] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-19T17:31:43.077798] [INFO ] [MAIN ] Update Progress: 243/2372 symbols completed. BDX took 31.1s. Estimated remaining: 4h 37m 16s. Rate: 7.7 symbols/min [2025-09-19T17:31:43.257158] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:43.312679] [DEBUG] [LOCAL ] BEN: Loaded 53466 existing records from primary storage. [2025-09-19T17:31:43.312829] [INFO ] [MAIN ] BEN: Loaded 53466 existing records. [2025-09-19T17:31:43.494308] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:43.494593] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-19T17:31:43.494671] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-19T17:31:43.496075] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-19T17:31:43.496135] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-19T17:31:43.845734] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-19T17:31:43.848960] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:44.296659] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T17:31:44.375062] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T17:31:44.643290] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-19T17:31:45.191224] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T17:31:45.443244] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-19T17:31:45.713582] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-19T17:31:45.792561] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-19T17:31:45.800572] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-19T17:31:45.800759] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-19T17:31:46.202140] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-19T17:31:46.202250] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-19T17:31:46.203111] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-19T17:31:46.203177] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-19T17:31:46.204744] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54433 (keeping 200 days of data) [2025-09-19T17:31:46.257389] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-19T17:31:46.539701] [DEBUG] [LOCAL ] BE: Primary data saved (54433 records). [2025-09-19T17:31:46.539976] [INFO ] [MAIN ] BE: Full history saved. [2025-09-19T17:31:46.540127] [INFO ] [MAIN ] Update Progress: 244/2372 symbols completed. BE took 34.5s. Estimated remaining: 4h 36m 30s. Rate: 7.7 symbols/min [2025-09-19T17:31:46.615482] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-19T17:31:46.719177] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:46.758212] [DEBUG] [LOCAL ] BEP: Loaded 39066 existing records from primary storage. [2025-09-19T17:31:46.758354] [INFO ] [MAIN ] BEP: Loaded 39066 existing records. [2025-09-19T17:31:46.939324] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:46.939697] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-19T17:31:46.939779] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-19T17:31:46.940841] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-19T17:31:46.940914] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-19T17:31:47.047278] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-19T17:31:47.318624] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:47.346423] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-19T17:31:47.843263] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-19T17:31:48.207936] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-19T17:31:48.208815] [INFO ] [REMOTE ] BEDU: Full fetch complete (1395 records). [2025-09-19T17:31:48.208888] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-19T17:31:48.400164] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-19T17:31:48.400352] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:31:48.400422] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:31:48.400494] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-19T17:31:48.400575] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-19T17:31:48.400633] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-19T17:31:48.400734] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-19T17:31:48.400816] [INFO ] [MAIN ] Update Progress: 245/2372 symbols completed. BEDU took 15.9s. Estimated remaining: 4h 35m 31s. Rate: 7.7 symbols/min [2025-09-19T17:31:48.578194] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:48.626367] [DEBUG] [LOCAL ] BEPC: Loaded 46987 existing records from primary storage. [2025-09-19T17:31:48.626515] [INFO ] [MAIN ] BEPC: Loaded 46987 existing records. [2025-09-19T17:31:48.648375] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-19T17:31:48.860458] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:48.860737] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-19T17:31:48.860794] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-19T17:31:48.863554] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-19T17:31:48.863615] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-19T17:31:49.242857] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:49.443254] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-19T17:31:50.243272] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-19T17:31:50.600399] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T17:31:51.043266] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-19T17:31:51.258690] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:31:51.843274] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-19T17:31:52.158913] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T17:31:52.643280] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-19T17:31:53.443242] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-19T17:31:53.619457] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-19T17:31:53.995985] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T17:31:54.100332] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T17:31:54.243344] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-19T17:31:54.996571] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T17:31:55.043253] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-19T17:31:55.843289] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-19T17:31:56.077684] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T17:31:56.643260] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-19T17:31:56.820263] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T17:31:57.443261] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-19T17:31:57.964523] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T17:31:58.243226] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-19T17:31:58.347275] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T17:31:59.043302] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-19T17:31:59.494634] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T17:31:59.589472] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T17:31:59.843270] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-19T17:32:00.643317] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-19T17:32:01.272066] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T17:32:01.443263] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-19T17:32:02.248323] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-19T17:32:02.265500] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T17:32:02.463018] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T17:32:02.803557] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:32:03.043331] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-19T17:32:03.843295] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-19T17:32:04.546301] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T17:32:04.653565] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-19T17:32:04.659355] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:32:05.443261] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-19T17:32:05.636809] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T17:32:06.190953] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T17:32:06.243251] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-19T17:32:06.767115] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:32:07.043263] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-19T17:32:07.674040] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:32:07.843256] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-19T17:32:08.643310] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-19T17:32:09.054858] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T17:32:09.084150] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T17:32:09.443288] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-19T17:32:10.243312] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-19T17:32:10.745425] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T17:32:10.833061] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T17:32:11.043299] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-19T17:32:11.494210] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T17:32:11.499778] [INFO ] [REMOTE ] BEP: Full fetch complete (58332 records). [2025-09-19T17:32:11.499928] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-19T17:32:11.868496] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-19T17:32:11.889564] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-19T17:32:11.889633] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-19T17:32:11.890440] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-19T17:32:11.890612] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-19T17:32:11.891927] [DEBUG] [LOCAL ] BEP: Trimmed 58332 records to 39400 (keeping 200 days of data) [2025-09-19T17:32:12.131231] [DEBUG] [LOCAL ] BEP: Primary data saved (39400 records). [2025-09-19T17:32:12.131381] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-19T17:32:12.131469] [INFO ] [MAIN ] Update Progress: 246/2372 symbols completed. BEP took 25.6s. Estimated remaining: 4h 37m 41s. Rate: 7.7 symbols/min [2025-09-19T17:32:12.300355] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:12.307750] [DEBUG] [LOCAL ] BEPH: Loaded 5249 existing records from primary storage. [2025-09-19T17:32:12.307865] [INFO ] [MAIN ] BEPH: Loaded 5249 existing records. [2025-09-19T17:32:12.487245] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:12.487515] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-19T17:32:12.487563] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-19T17:32:12.487928] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-19T17:32:12.487998] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-19T17:32:12.650284] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-19T17:32:12.852881] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:12.879518] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:32:12.887483] [INFO ] [REMOTE ] BEPC: Full fetch complete (68421 records). [2025-09-19T17:32:12.887751] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-19T17:32:13.301616] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-19T17:32:13.301746] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-19T17:32:13.302490] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-19T17:32:13.302561] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-19T17:32:13.304126] [DEBUG] [LOCAL ] BEPC: Trimmed 68421 records to 47318 (keeping 200 days of data) [2025-09-19T17:32:13.481380] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-19T17:32:13.602276] [DEBUG] [LOCAL ] BEPC: Primary data saved (47318 records). [2025-09-19T17:32:13.602436] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-19T17:32:13.602531] [INFO ] [MAIN ] Update Progress: 247/2372 symbols completed. BEPC took 25.2s. Estimated remaining: 4h 36m 39s. Rate: 7.7 symbols/min [2025-09-19T17:32:13.786725] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:13.793066] [DEBUG] [LOCAL ] BEPI: Loaded 3451 existing records from primary storage. [2025-09-19T17:32:13.793178] [INFO ] [MAIN ] BEPI: Loaded 3451 existing records. [2025-09-19T17:32:13.996328] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:13.996585] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-19T17:32:13.996665] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-19T17:32:13.997001] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-19T17:32:13.997062] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-19T17:32:14.363934] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T17:32:14.393738] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-19T17:32:14.440612] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:14.476167] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-19T17:32:15.048340] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-19T17:32:15.065211] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-19T17:32:15.280684] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T17:32:15.843277] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-19T17:32:16.643279] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-19T17:32:16.702765] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T17:32:17.203312] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T17:32:17.339117] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T17:32:17.443253] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-19T17:32:18.243277] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-19T17:32:18.690157] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-19T17:32:19.043301] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-19T17:32:19.421042] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T17:32:19.611283] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:32:19.843277] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-19T17:32:20.643293] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-19T17:32:20.685350] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T17:32:21.215732] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T17:32:21.443264] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-19T17:32:22.242980] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T17:32:22.243927] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-19T17:32:22.811397] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:32:23.043272] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-19T17:32:23.843301] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-19T17:32:24.643288] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-19T17:32:24.899924] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T17:32:25.306728] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T17:32:25.443236] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-19T17:32:26.243273] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-19T17:32:26.941501] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-19T17:32:27.043243] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-19T17:32:27.135768] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T17:32:27.792693] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-19T17:32:27.843324] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-19T17:32:28.643300] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-19T17:32:29.119914] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T17:32:29.128273] [INFO ] [REMOTE ] BEKE: Full fetch complete (77209 records). [2025-09-19T17:32:29.128441] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-19T17:32:29.270296] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-19T17:32:29.448466] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-19T17:32:29.547526] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-19T17:32:29.547614] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-19T17:32:29.548422] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-19T17:32:29.548487] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-19T17:32:29.550062] [DEBUG] [LOCAL ] BEKE: Trimmed 77209 records to 54042 (keeping 200 days of data) [2025-09-19T17:32:29.670797] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:32:29.680342] [INFO ] [REMOTE ] BEN: Full fetch complete (76893 records). [2025-09-19T17:32:29.681629] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-19T17:32:30.133078] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-19T17:32:30.133871] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-19T17:32:30.135584] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-19T17:32:30.135728] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-19T17:32:30.143404] [DEBUG] [LOCAL ] BEN: Trimmed 76893 records to 53847 (keeping 200 days of data) [2025-09-19T17:32:30.251429] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-19T17:32:30.328832] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T17:32:30.592593] [DEBUG] [LOCAL ] BEKE: Primary data saved (54042 records). [2025-09-19T17:32:30.593817] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-19T17:32:30.594237] [INFO ] [MAIN ] Update Progress: 248/2372 symbols completed. BEKE took 54.4s. Estimated remaining: 4h 37m 49s. Rate: 7.6 symbols/min [2025-09-19T17:32:30.788966] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:30.798749] [DEBUG] [LOCAL ] BEPJ: Loaded 3312 existing records from primary storage. [2025-09-19T17:32:30.799383] [INFO ] [MAIN ] BEPJ: Loaded 3312 existing records. [2025-09-19T17:32:31.047809] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-19T17:32:31.082713] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:31.084874] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-19T17:32:31.085216] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-19T17:32:31.086145] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-19T17:32:31.086489] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-19T17:32:31.295258] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T17:32:31.468348] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T17:32:31.509456] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:31.515513] [DEBUG] [LOCAL ] BEN: Primary data saved (53847 records). [2025-09-19T17:32:31.515770] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-19T17:32:31.518754] [INFO ] [MAIN ] Update Progress: 249/2372 symbols completed. BEN took 48.4s. Estimated remaining: 4h 36m 43s. Rate: 7.7 symbols/min [2025-09-19T17:32:31.708819] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:31.760262] [DEBUG] [LOCAL ] BFAM: Loaded 33173 existing records from primary storage. [2025-09-19T17:32:31.760516] [INFO ] [MAIN ] BFAM: Loaded 33173 existing records. [2025-09-19T17:32:31.848690] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-19T17:32:31.985628] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:31.986098] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-19T17:32:31.986206] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-19T17:32:31.987143] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-19T17:32:31.987262] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-19T17:32:32.361709] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:32.643262] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-19T17:32:32.842439] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T17:32:33.068594] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-19T17:32:33.443253] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-19T17:32:34.243277] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-19T17:32:34.920606] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T17:32:35.043288] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-19T17:32:35.180900] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T17:32:35.485035] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T17:32:35.486451] [INFO ] [REMOTE ] BEPI: Full fetch complete (4988 records). [2025-09-19T17:32:35.486539] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-19T17:32:35.850699] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-19T17:32:35.868125] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-19T17:32:35.868230] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-19T17:32:35.868438] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-19T17:32:35.868501] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-19T17:32:35.869117] [DEBUG] [LOCAL ] BEPI: Trimmed 4988 records to 3470 (keeping 200 days of data) [2025-09-19T17:32:35.893515] [DEBUG] [LOCAL ] BEPI: Primary data saved (3470 records). [2025-09-19T17:32:35.893707] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-19T17:32:35.893822] [INFO ] [MAIN ] Update Progress: 250/2372 symbols completed. BEPI took 22.3s. Estimated remaining: 4h 36m 6s. Rate: 7.7 symbols/min [2025-09-19T17:32:36.071815] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:36.125063] [DEBUG] [LOCAL ] BFH: Loaded 42319 existing records from primary storage. [2025-09-19T17:32:36.125254] [INFO ] [MAIN ] BFH: Loaded 42319 existing records. [2025-09-19T17:32:36.303011] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:36.303284] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-19T17:32:36.303371] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-19T17:32:36.304820] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-19T17:32:36.304882] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-19T17:32:36.647933] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-19T17:32:36.687465] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:36.688521] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-19T17:32:37.041574] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T17:32:37.443286] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-19T17:32:38.011411] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:32:38.243325] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-19T17:32:39.043357] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-19T17:32:39.629927] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T17:32:39.631394] [INFO ] [REMOTE ] BEPH: Full fetch complete (7534 records). [2025-09-19T17:32:39.631470] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-19T17:32:39.848466] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-19T17:32:40.067493] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-19T17:32:40.069938] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-19T17:32:40.069808] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T17:32:40.070311] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-19T17:32:40.070564] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-19T17:32:40.082033] [DEBUG] [LOCAL ] BEPH: Trimmed 7534 records to 5269 (keeping 200 days of data) [2025-09-19T17:32:40.121152] [DEBUG] [LOCAL ] BEPH: Primary data saved (5269 records). [2025-09-19T17:32:40.121415] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-19T17:32:40.121632] [INFO ] [MAIN ] Update Progress: 251/2372 symbols completed. BEPH took 28.0s. Estimated remaining: 4h 35m 27s. Rate: 7.7 symbols/min [2025-09-19T17:32:40.343797] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:40.368945] [DEBUG] [LOCAL ] BFK: Loaded 14147 existing records from primary storage. [2025-09-19T17:32:40.369150] [INFO ] [MAIN ] BFK: Loaded 14147 existing records. [2025-09-19T17:32:40.575316] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:40.575774] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-19T17:32:40.575834] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-19T17:32:40.576523] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-19T17:32:40.576585] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-19T17:32:40.652485] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-19T17:32:40.978396] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:41.443282] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-19T17:32:41.638913] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T17:32:41.743373] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T17:32:42.243281] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-19T17:32:42.779949] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:32:43.043294] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-19T17:32:43.762202] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:32:43.843301] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-19T17:32:44.093191] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T17:32:44.643308] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-19T17:32:45.443298] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-19T17:32:45.630757] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T17:32:46.109254] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-19T17:32:46.243305] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-19T17:32:46.401750] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:32:46.753703] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T17:32:47.043274] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-19T17:32:47.843264] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-19T17:32:48.384953] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T17:32:48.643347] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-19T17:32:49.443267] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-19T17:32:49.526926] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T17:32:49.608339] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T17:32:50.116122] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T17:32:50.243258] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-19T17:32:51.043280] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-19T17:32:51.358446] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T17:32:51.843288] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-19T17:32:52.541121] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T17:32:52.643269] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-19T17:32:53.076445] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T17:32:53.443278] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-19T17:32:53.451629] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T17:32:54.243272] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-19T17:32:54.963859] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T17:32:55.043261] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-19T17:32:55.759005] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T17:32:55.843235] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-19T17:32:56.643268] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-19T17:32:56.803105] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T17:32:57.029758] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-19T17:32:57.443264] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-19T17:32:57.535019] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T17:32:58.243299] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-19T17:32:58.445721] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T17:32:59.043276] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-19T17:32:59.753410] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T17:32:59.843292] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-19T17:32:59.971857] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T17:33:00.643303] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-19T17:33:00.838216] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T17:33:01.443677] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T17:33:01.443508] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-19T17:33:01.445969] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4557 records). [2025-09-19T17:33:01.446062] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-19T17:33:01.858704] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-19T17:33:01.858800] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-19T17:33:01.858941] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-19T17:33:01.858979] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-19T17:33:01.859368] [DEBUG] [LOCAL ] BEPJ: Trimmed 4557 records to 3320 (keeping 200 days of data) [2025-09-19T17:33:01.883324] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3320 records). [2025-09-19T17:33:01.883463] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-19T17:33:01.883577] [INFO ] [MAIN ] Update Progress: 252/2372 symbols completed. BEPJ took 31.3s. Estimated remaining: 4h 37m 17s. Rate: 7.6 symbols/min [2025-09-19T17:33:02.059167] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:02.120521] [DEBUG] [LOCAL ] BFLY: Loaded 52218 existing records from primary storage. [2025-09-19T17:33:02.120724] [INFO ] [MAIN ] BFLY: Loaded 52218 existing records. [2025-09-19T17:33:02.248375] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-19T17:33:02.307487] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:02.307818] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-19T17:33:02.307869] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-19T17:33:02.309291] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-19T17:33:02.309355] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-19T17:33:02.711519] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:03.043262] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-19T17:33:03.843266] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-19T17:33:04.459337] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-19T17:33:04.643288] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-19T17:33:04.966831] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-19T17:33:05.183104] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:33:05.443261] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-19T17:33:05.657535] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T17:33:06.243257] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-19T17:33:06.803415] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (3.76 seconds). [2025-09-19T17:33:07.049904] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-19T17:33:07.051811] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T17:33:07.056488] [INFO ] [REMOTE ] BFK: Full fetch complete (19368 records). [2025-09-19T17:33:07.056639] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-19T17:33:07.424406] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:33:07.463483] [INFO ] [REMOTE ] BFAM: Full fetch complete (47023 records). [2025-09-19T17:33:07.463610] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-19T17:33:07.463736] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-19T17:33:07.464190] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-19T17:33:07.463839] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-19T17:33:07.464399] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-19T17:33:07.538982] [DEBUG] [LOCAL ] BFK: Trimmed 19368 records to 14286 (keeping 200 days of data) [2025-09-19T17:33:07.847940] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-19T17:33:07.938879] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-19T17:33:07.939575] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-19T17:33:07.941011] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-19T17:33:07.941385] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-19T17:33:07.945736] [DEBUG] [LOCAL ] BFAM: Trimmed 47023 records to 33457 (keeping 200 days of data) [2025-09-19T17:33:07.951207] [DEBUG] [LOCAL ] BFK: Primary data saved (14286 records). [2025-09-19T17:33:07.951321] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-19T17:33:07.951424] [INFO ] [MAIN ] Update Progress: 253/2372 symbols completed. BFK took 27.8s. Estimated remaining: 4h 36m 54s. Rate: 7.7 symbols/min [2025-09-19T17:33:08.222612] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:08.241937] [DEBUG] [LOCAL ] BFS: Loaded 9113 existing records from primary storage. [2025-09-19T17:33:08.245820] [INFO ] [MAIN ] BFS: Loaded 9113 existing records. [2025-09-19T17:33:08.545236] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:08.546737] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:33:08.547342] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-19T17:33:08.552806] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-19T17:33:08.557800] [INFO ] [REMOTE ] BFH: Full fetch complete (59578 records). [2025-09-19T17:33:08.567511] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-19T17:33:08.568386] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-19T17:33:08.569208] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-19T17:33:08.583101] [DEBUG] [LOCAL ] BFAM: Primary data saved (33457 records). [2025-09-19T17:33:08.629109] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-19T17:33:08.657018] [INFO ] [MAIN ] Update Progress: 254/2372 symbols completed. BFAM took 37.1s. Estimated remaining: 4h 35m 47s. Rate: 7.7 symbols/min [2025-09-19T17:33:09.170487] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:09.426927] [DEBUG] [LOCAL ] BFZ: Loaded 11514 existing records from primary storage. [2025-09-19T17:33:09.471711] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:09.488558] [INFO ] [MAIN ] BFZ: Loaded 11514 existing records. [2025-09-19T17:33:09.483272] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-19T17:33:09.671165] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-19T17:33:09.682178] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-19T17:33:09.682935] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-19T17:33:09.683061] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-19T17:33:09.770838] [DEBUG] [LOCAL ] BFH: Trimmed 59578 records to 42563 (keeping 200 days of data) [2025-09-19T17:33:09.770532] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:09.771731] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-19T17:33:09.772123] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-19T17:33:09.772792] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-19T17:33:09.772854] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-19T17:33:10.263731] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:10.323508] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-19T17:33:10.404058] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T17:33:10.410784] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-19T17:33:10.414635] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-19T17:33:10.472683] [DEBUG] [LOCAL ] BFH: Primary data saved (42563 records). [2025-09-19T17:33:10.472848] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-19T17:33:10.472939] [INFO ] [MAIN ] Update Progress: 255/2372 symbols completed. BFH took 34.6s. Estimated remaining: 4h 34m 50s. Rate: 7.7 symbols/min [2025-09-19T17:33:10.642383] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:10.692386] [DEBUG] [LOCAL ] BG: Loaded 50741 existing records from primary storage. [2025-09-19T17:33:10.692538] [INFO ] [MAIN ] BG: Loaded 50741 existing records. [2025-09-19T17:33:10.869508] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:10.869781] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-19T17:33:10.869833] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-19T17:33:10.871191] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-19T17:33:10.871252] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-19T17:33:11.049296] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-19T17:33:11.232548] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:11.271370] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T17:33:11.362787] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T17:33:11.843335] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-19T17:33:12.643261] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-19T17:33:12.825883] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T17:33:13.328153] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T17:33:13.443219] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-19T17:33:14.243280] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-19T17:33:14.361481] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T17:33:15.043330] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-19T17:33:15.791785] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T17:33:15.843357] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-19T17:33:16.017721] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T17:33:16.050743] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-19T17:33:16.643290] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-19T17:33:16.676192] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-19T17:33:17.443337] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-19T17:33:18.132355] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T17:33:18.243292] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-19T17:33:18.282970] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T17:33:19.043283] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-19T17:33:19.843280] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-19T17:33:19.963765] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T17:33:20.014865] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T17:33:20.643379] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-19T17:33:21.443341] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-19T17:33:21.531960] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T17:33:22.243324] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-19T17:33:22.475394] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T17:33:22.948418] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-19T17:33:23.043291] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-19T17:33:23.532056] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T17:33:23.843289] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-19T17:33:24.556936] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T17:33:24.643273] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-19T17:33:24.917413] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-19T17:33:25.443298] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-19T17:33:26.044898] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T17:33:26.243264] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-19T17:33:26.292110] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T17:33:27.043300] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-19T17:33:27.300851] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T17:33:27.843258] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-19T17:33:28.643256] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-19T17:33:28.794263] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T17:33:29.098985] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:33:29.443346] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-19T17:33:30.122362] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T17:33:30.124564] [INFO ] [REMOTE ] BFS: Full fetch complete (12384 records). [2025-09-19T17:33:30.124673] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-19T17:33:30.253240] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-19T17:33:30.527517] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-19T17:33:30.527635] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-19T17:33:30.528059] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-19T17:33:30.528201] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-19T17:33:30.528992] [DEBUG] [LOCAL ] BFS: Trimmed 12384 records to 9166 (keeping 200 days of data) [2025-09-19T17:33:30.597372] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:33:30.624496] [DEBUG] [LOCAL ] BFS: Primary data saved (9166 records). [2025-09-19T17:33:30.624624] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-19T17:33:30.624740] [INFO ] [MAIN ] Update Progress: 256/2372 symbols completed. BFS took 22.7s. Estimated remaining: 4h 36m 24s. Rate: 7.7 symbols/min [2025-09-19T17:33:30.804194] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:30.823973] [DEBUG] [LOCAL ] BGB: Loaded 17754 existing records from primary storage. [2025-09-19T17:33:30.824105] [INFO ] [MAIN ] BGB: Loaded 17754 existing records. [2025-09-19T17:33:31.017601] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:31.017900] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-19T17:33:31.017975] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-19T17:33:31.018639] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-19T17:33:31.018735] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-19T17:33:31.053031] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-19T17:33:31.385736] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:31.751879] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T17:33:31.843273] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-19T17:33:32.643241] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-19T17:33:33.018520] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T17:33:33.152956] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:33:33.443288] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-19T17:33:34.067957] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:33:34.180417] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T17:33:34.183145] [INFO ] [REMOTE ] BFZ: Full fetch complete (17865 records). [2025-09-19T17:33:34.183217] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-19T17:33:34.248460] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-19T17:33:34.589397] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-19T17:33:34.589524] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-19T17:33:34.589927] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-19T17:33:34.589991] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-19T17:33:34.590831] [DEBUG] [LOCAL ] BFZ: Trimmed 17865 records to 11653 (keeping 200 days of data) [2025-09-19T17:33:34.662961] [DEBUG] [LOCAL ] BFZ: Primary data saved (11653 records). [2025-09-19T17:33:34.663111] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-19T17:33:34.663198] [INFO ] [MAIN ] Update Progress: 257/2372 symbols completed. BFZ took 26.0s. Estimated remaining: 4h 35m 45s. Rate: 7.7 symbols/min [2025-09-19T17:33:34.841690] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:34.860093] [DEBUG] [LOCAL ] BGH: Loaded 16601 existing records from primary storage. [2025-09-19T17:33:34.860222] [INFO ] [MAIN ] BGH: Loaded 16601 existing records. [2025-09-19T17:33:35.048952] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-19T17:33:35.048824] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:35.050425] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-19T17:33:35.050544] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-19T17:33:35.051273] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-19T17:33:35.051335] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-19T17:33:35.424217] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:35.618948] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T17:33:35.843271] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-19T17:33:36.643279] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-19T17:33:36.968984] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T17:33:37.442997] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T17:33:37.446036] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-19T17:33:38.243265] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-19T17:33:38.822986] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-19T17:33:39.043312] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-19T17:33:39.555978] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T17:33:39.576052] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:33:39.741309] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-19T17:33:39.843282] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-19T17:33:40.643299] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-19T17:33:40.871566] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T17:33:41.443289] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-19T17:33:42.243276] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-19T17:33:42.669159] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T17:33:43.043284] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-19T17:33:43.479959] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T17:33:43.488462] [INFO ] [REMOTE ] BG: Full fetch complete (72750 records). [2025-09-19T17:33:43.499060] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-19T17:33:43.500946] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T17:33:43.847229] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-19T17:33:43.905706] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-19T17:33:43.905826] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-19T17:33:43.906726] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-19T17:33:43.906794] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-19T17:33:43.908446] [DEBUG] [LOCAL ] BG: Trimmed 72750 records to 51108 (keeping 200 days of data) [2025-09-19T17:33:44.233087] [DEBUG] [LOCAL ] BG: Primary data saved (51108 records). [2025-09-19T17:33:44.233274] [INFO ] [MAIN ] BG: Full history saved. [2025-09-19T17:33:44.233379] [INFO ] [MAIN ] Update Progress: 258/2372 symbols completed. BG took 33.8s. Estimated remaining: 4h 35m 51s. Rate: 7.7 symbols/min [2025-09-19T17:33:44.402159] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:44.416565] [DEBUG] [LOCAL ] BGR: Loaded 13714 existing records from primary storage. [2025-09-19T17:33:44.416734] [INFO ] [MAIN ] BGR: Loaded 13714 existing records. [2025-09-19T17:33:44.607526] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:44.609102] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-19T17:33:44.608833] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:33:44.613279] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-19T17:33:44.614220] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-19T17:33:44.614297] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-19T17:33:44.648364] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-19T17:33:44.895295] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T17:33:45.024556] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:45.443273] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-19T17:33:46.088379] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T17:33:46.243284] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-19T17:33:46.296193] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T17:33:47.043284] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-19T17:33:47.843283] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-19T17:33:48.224781] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T17:33:48.516609] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:33:48.643252] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-19T17:33:48.988975] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T17:33:49.443330] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-19T17:33:50.243238] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-19T17:33:50.402884] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T17:33:50.410139] [INFO ] [REMOTE ] BFLY: Full fetch complete (75196 records). [2025-09-19T17:33:50.410260] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-19T17:33:50.804694] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-19T17:33:50.804816] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-19T17:33:50.806721] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-19T17:33:50.806786] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-19T17:33:50.808273] [DEBUG] [LOCAL ] BFLY: Trimmed 75196 records to 52606 (keeping 200 days of data) [2025-09-19T17:33:51.026495] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:33:51.044839] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-19T17:33:51.046791] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T17:33:51.140476] [DEBUG] [LOCAL ] BFLY: Primary data saved (52606 records). [2025-09-19T17:33:51.140611] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-19T17:33:51.140724] [INFO ] [MAIN ] Update Progress: 259/2372 symbols completed. BFLY took 49.3s. Estimated remaining: 4h 35m 36s. Rate: 7.7 symbols/min [2025-09-19T17:33:51.307933] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:51.356549] [DEBUG] [LOCAL ] BGS: Loaded 50790 existing records from primary storage. [2025-09-19T17:33:51.356713] [INFO ] [MAIN ] BGS: Loaded 50790 existing records. [2025-09-19T17:33:51.537543] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:51.537855] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-19T17:33:51.537913] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-19T17:33:51.539310] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-19T17:33:51.539372] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-19T17:33:51.852338] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-19T17:33:51.892705] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:52.136934] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T17:33:52.643239] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-19T17:33:52.862192] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T17:33:53.443285] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-19T17:33:53.822220] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T17:33:54.243242] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-19T17:33:54.319480] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T17:33:55.043285] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-19T17:33:55.843283] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-19T17:33:56.481711] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T17:33:56.502442] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T17:33:56.643234] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-19T17:33:57.096775] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-19T17:33:57.443269] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-19T17:33:57.752811] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T17:33:57.755477] [INFO ] [REMOTE ] BGB: Full fetch complete (26945 records). [2025-09-19T17:33:57.755560] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-19T17:33:58.138416] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-19T17:33:58.138498] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-19T17:33:58.138902] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-19T17:33:58.138965] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-19T17:33:58.139612] [DEBUG] [LOCAL ] BGB: Trimmed 26945 records to 17835 (keeping 200 days of data) [2025-09-19T17:33:58.249441] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-19T17:33:58.249351] [DEBUG] [LOCAL ] BGB: Primary data saved (17835 records). [2025-09-19T17:33:58.249747] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-19T17:33:58.250618] [INFO ] [MAIN ] Update Progress: 260/2372 symbols completed. BGB took 27.6s. Estimated remaining: 4h 35m 22s. Rate: 7.7 symbols/min [2025-09-19T17:33:58.430713] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:58.438700] [DEBUG] [LOCAL ] BGSF: Loaded 6142 existing records from primary storage. [2025-09-19T17:33:58.438820] [INFO ] [MAIN ] BGSF: Loaded 6142 existing records. [2025-09-19T17:33:58.618917] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:58.619260] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-19T17:33:58.619330] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-19T17:33:58.619740] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-19T17:33:58.619803] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-19T17:33:58.980776] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T17:33:59.013258] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:59.043258] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-19T17:33:59.693448] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:33:59.843272] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-19T17:34:00.643277] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-19T17:34:00.827058] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T17:34:00.864092] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T17:34:01.435872] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T17:34:01.443212] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-19T17:34:02.110874] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-19T17:34:02.243262] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-19T17:34:03.043271] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-19T17:34:03.305825] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T17:34:03.698848] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T17:34:03.843277] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-19T17:34:04.643285] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-19T17:34:04.972074] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T17:34:04.975107] [INFO ] [REMOTE ] BGH: Full fetch complete (21752 records). [2025-09-19T17:34:04.975213] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-19T17:34:05.365237] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-19T17:34:05.365317] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-19T17:34:05.365684] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-19T17:34:05.365745] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-19T17:34:05.366388] [DEBUG] [LOCAL ] BGH: Trimmed 21752 records to 16671 (keeping 200 days of data) [2025-09-19T17:34:05.443627] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-19T17:34:05.467246] [DEBUG] [LOCAL ] BGH: Primary data saved (16671 records). [2025-09-19T17:34:05.467393] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-19T17:34:05.467501] [INFO ] [MAIN ] Update Progress: 261/2372 symbols completed. BGH took 30.8s. Estimated remaining: 4h 35m 10s. Rate: 7.7 symbols/min [2025-09-19T17:34:05.652016] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:05.676860] [DEBUG] [LOCAL ] BGT: Loaded 16821 existing records from primary storage. [2025-09-19T17:34:05.677009] [INFO ] [MAIN ] BGT: Loaded 16821 existing records. [2025-09-19T17:34:05.855606] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:05.855900] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-19T17:34:05.855957] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-19T17:34:05.856607] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-19T17:34:05.856698] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-19T17:34:05.999259] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T17:34:06.233070] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:06.243270] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-19T17:34:06.452328] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:34:06.945512] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T17:34:07.043312] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-19T17:34:07.843289] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-19T17:34:08.407080] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T17:34:08.643293] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-19T17:34:09.068274] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T17:34:09.443319] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-19T17:34:09.829033] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-19T17:34:10.243323] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-19T17:34:10.736373] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T17:34:11.004552] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T17:34:11.043279] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-19T17:34:11.843292] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-19T17:34:12.029090] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T17:34:12.643320] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-19T17:34:13.443454] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-19T17:34:13.589514] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:34:13.898995] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:34:14.243271] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-19T17:34:14.988109] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T17:34:15.043300] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-19T17:34:15.166352] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T17:34:15.843273] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-19T17:34:16.144204] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T17:34:16.146728] [INFO ] [REMOTE ] BGR: Full fetch complete (20352 records). [2025-09-19T17:34:16.146831] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-19T17:34:16.526366] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-19T17:34:16.526480] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-19T17:34:16.526853] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-19T17:34:16.526914] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-19T17:34:16.527530] [DEBUG] [LOCAL ] BGR: Trimmed 20352 records to 13798 (keeping 200 days of data) [2025-09-19T17:34:16.610691] [DEBUG] [LOCAL ] BGR: Primary data saved (13798 records). [2025-09-19T17:34:16.610836] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-19T17:34:16.610940] [INFO ] [MAIN ] Update Progress: 262/2372 symbols completed. BGR took 32.4s. Estimated remaining: 4h 35m 29s. Rate: 7.7 symbols/min [2025-09-19T17:34:16.648444] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-19T17:34:16.782214] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:16.794629] [DEBUG] [LOCAL ] BGX: Loaded 10952 existing records from primary storage. [2025-09-19T17:34:16.794776] [INFO ] [MAIN ] BGX: Loaded 10952 existing records. [2025-09-19T17:34:16.974813] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:16.975120] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-19T17:34:16.975179] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-19T17:34:16.975814] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-19T17:34:16.975874] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-19T17:34:17.332060] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:17.443315] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-19T17:34:17.932318] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T17:34:18.005150] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T17:34:18.243274] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-19T17:34:18.766037] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T17:34:18.768791] [INFO ] [REMOTE ] BGSF: Full fetch complete (7707 records). [2025-09-19T17:34:18.768863] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-19T17:34:19.051407] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-19T17:34:19.141178] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-19T17:34:19.141271] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-19T17:34:19.141485] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-19T17:34:19.141526] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-19T17:34:19.142073] [DEBUG] [LOCAL ] BGSF: Trimmed 7707 records to 6327 (keeping 200 days of data) [2025-09-19T17:34:19.177495] [DEBUG] [LOCAL ] BGSF: Primary data saved (6327 records). [2025-09-19T17:34:19.177628] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-19T17:34:19.177748] [INFO ] [MAIN ] Update Progress: 263/2372 symbols completed. BGSF took 20.9s. Estimated remaining: 4h 34m 38s. Rate: 7.7 symbols/min [2025-09-19T17:34:19.346736] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:19.369510] [DEBUG] [LOCAL ] BGY: Loaded 23265 existing records from primary storage. [2025-09-19T17:34:19.369630] [INFO ] [MAIN ] BGY: Loaded 23265 existing records. [2025-09-19T17:34:19.552034] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:19.552368] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-19T17:34:19.552442] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-19T17:34:19.562435] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-19T17:34:19.563161] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-19T17:34:19.563529] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T17:34:19.848400] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-19T17:34:19.956732] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:20.643297] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-19T17:34:21.134460] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:34:21.307381] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T17:34:21.364462] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-19T17:34:21.443295] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-19T17:34:22.234011] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T17:34:22.243215] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-19T17:34:23.043267] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-19T17:34:23.547752] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T17:34:23.843288] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-19T17:34:23.993741] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T17:34:24.643274] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-19T17:34:25.319704] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T17:34:25.443247] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-19T17:34:25.788723] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T17:34:26.243265] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-19T17:34:27.043275] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-19T17:34:27.456796] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T17:34:27.541777] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:34:27.801448] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:34:27.843257] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-19T17:34:28.643268] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-19T17:34:28.816637] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T17:34:29.443263] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-19T17:34:29.643370] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T17:34:30.243285] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-19T17:34:30.685744] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T17:34:31.043234] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-19T17:34:31.066703] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T17:34:31.843334] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-19T17:34:32.643347] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-19T17:34:33.022410] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:34:33.030046] [INFO ] [REMOTE ] BGS: Full fetch complete (72438 records). [2025-09-19T17:34:33.030177] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-19T17:34:33.355412] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T17:34:33.447923] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-19T17:34:33.473494] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-19T17:34:33.473380] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T17:34:33.473657] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-19T17:34:33.477705] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-19T17:34:33.477917] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-19T17:34:33.478013] [INFO ] [REMOTE ] BGT: Full fetch complete (24421 records). [2025-09-19T17:34:33.478215] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-19T17:34:33.585799] [DEBUG] [LOCAL ] BGS: Trimmed 72438 records to 51172 (keeping 200 days of data) [2025-09-19T17:34:33.979223] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-19T17:34:33.979846] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-19T17:34:33.980809] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-19T17:34:33.981164] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-19T17:34:33.983837] [DEBUG] [LOCAL ] BGT: Trimmed 24421 records to 16885 (keeping 200 days of data) [2025-09-19T17:34:34.095598] [DEBUG] [LOCAL ] BGT: Primary data saved (16885 records). [2025-09-19T17:34:34.099197] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-19T17:34:34.100011] [INFO ] [MAIN ] Update Progress: 264/2372 symbols completed. BGT took 28.6s. Estimated remaining: 4h 35m 27s. Rate: 7.7 symbols/min [2025-09-19T17:34:34.275026] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-19T17:34:34.394369] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:34:34.395592] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:34.422536] [DEBUG] [LOCAL ] BH: Loaded 15344 existing records from primary storage. [2025-09-19T17:34:34.423570] [INFO ] [MAIN ] BH: Loaded 15344 existing records. [2025-09-19T17:34:34.632828] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:34.633981] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-19T17:34:34.634334] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-19T17:34:34.636305] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-19T17:34:34.636388] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-19T17:34:35.043392] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-19T17:34:35.127011] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:35.133628] [DEBUG] [LOCAL ] BGS: Primary data saved (51172 records). [2025-09-19T17:34:35.133745] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-19T17:34:35.133823] [INFO ] [MAIN ] Update Progress: 265/2372 symbols completed. BGS took 44.0s. Estimated remaining: 4h 34m 25s. Rate: 7.7 symbols/min [2025-09-19T17:34:35.310926] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:35.355031] [DEBUG] [LOCAL ] BHC: Loaded 47122 existing records from primary storage. [2025-09-19T17:34:35.355198] [INFO ] [MAIN ] BHC: Loaded 47122 existing records. [2025-09-19T17:34:35.544743] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:35.545080] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-19T17:34:35.545166] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-19T17:34:35.551676] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-19T17:34:35.560202] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-19T17:34:35.593203] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T17:34:35.848354] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-19T17:34:35.932283] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:36.099270] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T17:34:36.643240] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-19T17:34:37.105835] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T17:34:37.284691] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T17:34:37.443277] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-19T17:34:38.243277] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-19T17:34:38.643858] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T17:34:39.043292] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-19T17:34:39.148410] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T17:34:39.843259] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-19T17:34:40.308832] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:34:40.568870] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T17:34:40.643279] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-19T17:34:41.443276] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-19T17:34:42.218303] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T17:34:42.245495] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-19T17:34:42.248918] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T17:34:43.043282] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-19T17:34:43.843325] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-19T17:34:44.023472] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T17:34:44.643224] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-19T17:34:44.734561] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T17:34:44.737062] [INFO ] [REMOTE ] BGX: Full fetch complete (15713 records). [2025-09-19T17:34:44.737134] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-19T17:34:45.119773] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-19T17:34:45.119878] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-19T17:34:45.120366] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-19T17:34:45.120492] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-19T17:34:45.121356] [DEBUG] [LOCAL ] BGX: Trimmed 15713 records to 10987 (keeping 200 days of data) [2025-09-19T17:34:45.195794] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T17:34:45.225057] [DEBUG] [LOCAL ] BGX: Primary data saved (10987 records). [2025-09-19T17:34:45.225219] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-19T17:34:45.225311] [INFO ] [MAIN ] Update Progress: 266/2372 symbols completed. BGX took 28.6s. Estimated remaining: 4h 34m 36s. Rate: 7.7 symbols/min [2025-09-19T17:34:45.403583] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:45.429971] [DEBUG] [LOCAL ] BHE: Loaded 25630 existing records from primary storage. [2025-09-19T17:34:45.430114] [INFO ] [MAIN ] BHE: Loaded 25630 existing records. [2025-09-19T17:34:45.450977] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-19T17:34:45.616381] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:45.622252] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-19T17:34:45.630565] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-19T17:34:45.631683] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T17:34:45.636511] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-19T17:34:45.637076] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-19T17:34:46.003076] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:46.243287] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-19T17:34:46.772807] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T17:34:47.043280] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-19T17:34:47.501563] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T17:34:47.843295] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-19T17:34:48.319513] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T17:34:48.643234] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-19T17:34:49.187847] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T17:34:49.443266] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-19T17:34:49.956092] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T17:34:50.243260] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-19T17:34:50.832350] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T17:34:51.043274] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-19T17:34:51.843285] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-19T17:34:52.031230] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T17:34:52.184547] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:34:52.643272] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-19T17:34:53.443279] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-19T17:34:53.595037] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:34:53.897921] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T17:34:54.212384] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T17:34:54.243331] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-19T17:34:55.043266] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-19T17:34:55.570503] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T17:34:55.843265] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-19T17:34:56.051487] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T17:34:56.643262] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-19T17:34:57.443266] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-19T17:34:57.638911] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T17:34:58.115926] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:34:58.243271] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-19T17:34:58.800307] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T17:34:58.803468] [INFO ] [REMOTE ] BH: Full fetch complete (19196 records). [2025-09-19T17:34:58.803546] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-19T17:34:59.050574] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-19T17:34:59.180063] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-19T17:34:59.180155] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-19T17:34:59.180581] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-19T17:34:59.180631] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-19T17:34:59.181473] [DEBUG] [LOCAL ] BH: Trimmed 19196 records to 15496 (keeping 200 days of data) [2025-09-19T17:34:59.279679] [DEBUG] [LOCAL ] BH: Primary data saved (15496 records). [2025-09-19T17:34:59.279844] [INFO ] [MAIN ] BH: Full history saved. [2025-09-19T17:34:59.279953] [INFO ] [MAIN ] Update Progress: 267/2372 symbols completed. BH took 25.2s. Estimated remaining: 4h 35m 17s. Rate: 7.6 symbols/min [2025-09-19T17:34:59.463333] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:59.489283] [DEBUG] [LOCAL ] BHK: Loaded 22566 existing records from primary storage. [2025-09-19T17:34:59.489433] [INFO ] [MAIN ] BHK: Loaded 22566 existing records. [2025-09-19T17:34:59.683358] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:34:59.701276] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:59.701616] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-19T17:34:59.701700] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-19T17:34:59.702571] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-19T17:34:59.702676] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-19T17:34:59.749193] [INFO ] [REMOTE ] BGY: Full fetch complete (33529 records). [2025-09-19T17:34:59.771713] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-19T17:34:59.868631] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-19T17:35:00.462800] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:00.539242] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-19T17:35:00.539403] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-19T17:35:00.540029] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-19T17:35:00.540152] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-19T17:35:00.559544] [DEBUG] [LOCAL ] BGY: Trimmed 33529 records to 23356 (keeping 200 days of data) [2025-09-19T17:35:00.560829] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T17:35:00.666112] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-19T17:35:00.719593] [DEBUG] [LOCAL ] BGY: Primary data saved (23356 records). [2025-09-19T17:35:00.719769] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-19T17:35:00.719866] [INFO ] [MAIN ] Update Progress: 268/2372 symbols completed. BGY took 41.5s. Estimated remaining: 4h 34m 19s. Rate: 7.7 symbols/min [2025-09-19T17:35:00.893767] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:00.958017] [DEBUG] [LOCAL ] BHP: Loaded 53780 existing records from primary storage. [2025-09-19T17:35:00.958209] [INFO ] [MAIN ] BHP: Loaded 53780 existing records. [2025-09-19T17:35:01.134486] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:01.134795] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-19T17:35:01.134857] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-19T17:35:01.136574] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-19T17:35:01.136663] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-19T17:35:01.451375] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-19T17:35:01.491905] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:01.529593] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:35:02.206153] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T17:35:02.243294] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-19T17:35:02.920505] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T17:35:03.043246] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-19T17:35:03.129090] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T17:35:03.843345] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-19T17:35:04.016090] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T17:35:04.643263] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-19T17:35:05.443277] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-19T17:35:05.942987] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T17:35:06.018991] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T17:35:06.023168] [INFO ] [REMOTE ] BHE: Full fetch complete (36571 records). [2025-09-19T17:35:06.023385] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-19T17:35:06.248362] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-19T17:35:06.417979] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-19T17:35:06.418074] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-19T17:35:06.418841] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-19T17:35:06.418927] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-19T17:35:06.420533] [DEBUG] [LOCAL ] BHE: Trimmed 36571 records to 25840 (keeping 200 days of data) [2025-09-19T17:35:06.582919] [DEBUG] [LOCAL ] BHE: Primary data saved (25840 records). [2025-09-19T17:35:06.583051] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-19T17:35:06.583212] [INFO ] [MAIN ] Update Progress: 269/2372 symbols completed. BHE took 21.4s. Estimated remaining: 4h 33m 56s. Rate: 7.7 symbols/min [2025-09-19T17:35:06.750984] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:06.774988] [DEBUG] [LOCAL ] BHR: Loaded 21610 existing records from primary storage. [2025-09-19T17:35:06.775122] [INFO ] [MAIN ] BHR: Loaded 21610 existing records. [2025-09-19T17:35:06.955914] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:06.965258] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-19T17:35:06.966565] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T17:35:06.966042] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-19T17:35:06.970590] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-19T17:35:06.970730] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-19T17:35:07.048328] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-19T17:35:07.343824] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:07.843232] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-19T17:35:08.430757] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T17:35:08.553430] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T17:35:08.643245] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-19T17:35:09.306215] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T17:35:09.443273] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-19T17:35:10.243258] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-19T17:35:10.336950] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T17:35:10.767221] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:35:11.043283] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-19T17:35:11.450719] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T17:35:11.843267] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-19T17:35:12.643253] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-19T17:35:12.683794] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:35:13.037693] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T17:35:13.443267] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-19T17:35:14.049622] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:35:14.243272] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-19T17:35:15.043297] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-19T17:35:15.620461] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T17:35:15.779753] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:35:15.843228] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-19T17:35:16.565601] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:35:16.604950] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T17:35:16.643224] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-19T17:35:17.443307] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-19T17:35:18.008739] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:35:18.243284] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-19T17:35:19.043295] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-19T17:35:19.651560] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T17:35:19.764789] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T17:35:19.843323] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-19T17:35:20.455538] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T17:35:20.643272] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-19T17:35:21.443266] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-19T17:35:22.101904] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T17:35:22.143191] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:35:22.156758] [INFO ] [REMOTE ] BHC: Full fetch complete (66688 records). [2025-09-19T17:35:22.156939] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-19T17:35:22.251144] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-19T17:35:22.582989] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-19T17:35:22.583092] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-19T17:35:22.583815] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-19T17:35:22.583883] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-19T17:35:22.585342] [DEBUG] [LOCAL ] BHC: Trimmed 66688 records to 47463 (keeping 200 days of data) [2025-09-19T17:35:22.877611] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T17:35:22.890616] [DEBUG] [LOCAL ] BHC: Primary data saved (47463 records). [2025-09-19T17:35:22.890742] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-19T17:35:22.890867] [INFO ] [MAIN ] Update Progress: 270/2372 symbols completed. BHC took 47.8s. Estimated remaining: 4h 34m 54s. Rate: 7.6 symbols/min [2025-09-19T17:35:23.060944] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:23.043235] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-19T17:35:23.061945] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-19T17:35:23.061997] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-19T17:35:23.062183] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-19T17:35:23.062236] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-19T17:35:23.062278] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-19T17:35:23.062309] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-19T17:35:23.438216] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:23.691424] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:35:23.843215] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-19T17:35:23.867841] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T17:35:24.383920] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T17:35:24.643268] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-19T17:35:25.443330] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-19T17:35:25.807027] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T17:35:25.865351] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-19T17:35:26.243336] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-19T17:35:27.043291] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-19T17:35:27.813698] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T17:35:27.843229] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-19T17:35:28.643309] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-19T17:35:29.213600] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T17:35:29.237878] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T17:35:29.242581] [INFO ] [REMOTE ] BHR: Full fetch complete (30488 records). [2025-09-19T17:35:29.242769] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-19T17:35:29.457488] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-19T17:35:29.675676] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-19T17:35:29.675788] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-19T17:35:29.676341] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-19T17:35:29.676419] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-19T17:35:29.695021] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T17:35:29.701144] [DEBUG] [LOCAL ] BHR: Trimmed 30488 records to 21774 (keeping 200 days of data) [2025-09-19T17:35:29.703742] [INFO ] [REMOTE ] BHK: Full fetch complete (29604 records). [2025-09-19T17:35:29.703910] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-19T17:35:30.194692] [DEBUG] [LOCAL ] BHR: Primary data saved (21774 records). [2025-09-19T17:35:30.223533] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-19T17:35:30.243243] [INFO ] [MAIN ] Update Progress: 271/2372 symbols completed. BHR took 23.7s. Estimated remaining: 4h 34m 42s. Rate: 7.6 symbols/min [2025-09-19T17:35:30.276994] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-19T17:35:30.276251] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-19T17:35:30.277541] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-19T17:35:30.279089] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-19T17:35:30.284357] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-19T17:35:30.376382] [DEBUG] [LOCAL ] BHK: Trimmed 29604 records to 22707 (keeping 200 days of data) [2025-09-19T17:35:30.523920] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:30.625239] [DEBUG] [LOCAL ] BHK: Primary data saved (22707 records). [2025-09-19T17:35:30.625393] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-19T17:35:30.625490] [INFO ] [MAIN ] Update Progress: 272/2372 symbols completed. BHK took 31.3s. Estimated remaining: 4h 33m 37s. Rate: 7.7 symbols/min [2025-09-19T17:35:30.743974] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-19T17:35:30.760231] [DEBUG] [LOCAL ] BHVN: Loaded 49937 existing records from primary storage. [2025-09-19T17:35:30.839722] [INFO ] [MAIN ] BHVN: Loaded 49937 existing records. [2025-09-19T17:35:30.987546] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:31.044012] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-19T17:35:31.106581] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:31.106871] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-19T17:35:31.106923] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-19T17:35:31.108471] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-19T17:35:31.108535] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-19T17:35:31.400718] [DEBUG] [LOCAL ] BILL: Loaded 52709 existing records from primary storage. [2025-09-19T17:35:31.412803] [INFO ] [MAIN ] BILL: Loaded 52709 existing records. [2025-09-19T17:35:31.556502] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T17:35:31.656843] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:31.729005] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:31.729406] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-19T17:35:31.729514] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-19T17:35:31.731543] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-19T17:35:31.731603] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-19T17:35:31.847687] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-19T17:35:32.153999] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-19T17:35:32.158728] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:32.643259] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-19T17:35:33.443307] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-19T17:35:33.841025] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T17:35:33.870837] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-19T17:35:34.253996] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-19T17:35:34.257163] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T17:35:34.643111] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T17:35:35.043305] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-19T17:35:35.337220] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-19T17:35:35.843308] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-19T17:35:36.643281] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-19T17:35:37.443298] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-19T17:35:37.648969] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:35:38.243313] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-19T17:35:38.289513] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T17:35:39.043286] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-19T17:35:39.442742] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:35:39.843302] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-19T17:35:40.643260] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-19T17:35:40.692780] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T17:35:40.888203] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-19T17:35:41.071629] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-19T17:35:41.443287] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-19T17:35:42.243273] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-19T17:35:42.289887] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-19T17:35:42.679691] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-19T17:35:43.043270] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-19T17:35:43.196997] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:35:43.843279] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-19T17:35:44.643287] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-19T17:35:44.819919] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T17:35:45.295519] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-19T17:35:45.296462] [INFO ] [REMOTE ] BHV: Full fetch complete (1394 records). [2025-09-19T17:35:45.296531] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-19T17:35:45.448419] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-19T17:35:45.488363] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-19T17:35:45.488730] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:35:45.488816] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:35:45.488930] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-19T17:35:45.489033] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-19T17:35:45.489090] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-19T17:35:45.489154] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-19T17:35:45.489254] [INFO ] [MAIN ] Update Progress: 273/2372 symbols completed. BHV took 22.6s. Estimated remaining: 4h 34m 23s. Rate: 7.6 symbols/min [2025-09-19T17:35:45.671097] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:45.701189] [DEBUG] [LOCAL ] BIO: Loaded 25946 existing records from primary storage. [2025-09-19T17:35:45.701338] [INFO ] [MAIN ] BIO: Loaded 25946 existing records. [2025-09-19T17:35:45.888418] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:45.888915] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-19T17:35:45.889017] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-19T17:35:45.889719] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-19T17:35:45.889781] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-19T17:35:46.259242] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T17:35:46.306131] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:46.264447] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-19T17:35:47.043264] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-19T17:35:47.562371] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T17:35:47.843283] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-19T17:35:48.458987] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:35:48.604279] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T17:35:48.614279] [INFO ] [REMOTE ] BHP: Full fetch complete (77242 records). [2025-09-19T17:35:48.614460] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-19T17:35:48.648527] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-19T17:35:49.016037] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-19T17:35:49.016123] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-19T17:35:49.017042] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-19T17:35:49.017119] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-19T17:35:49.018590] [DEBUG] [LOCAL ] BHP: Trimmed 77242 records to 54166 (keeping 200 days of data) [2025-09-19T17:35:49.371508] [DEBUG] [LOCAL ] BHP: Primary data saved (54166 records). [2025-09-19T17:35:49.371709] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-19T17:35:49.371810] [INFO ] [MAIN ] Update Progress: 274/2372 symbols completed. BHP took 48.7s. Estimated remaining: 4h 33m 45s. Rate: 7.7 symbols/min [2025-09-19T17:35:49.448422] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-19T17:35:49.545299] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:49.584140] [DEBUG] [LOCAL ] BIP: Loaded 40063 existing records from primary storage. [2025-09-19T17:35:49.584278] [INFO ] [MAIN ] BIP: Loaded 40063 existing records. [2025-09-19T17:35:49.763728] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:49.764050] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-19T17:35:49.764113] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-19T17:35:49.765141] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-19T17:35:49.765201] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-19T17:35:50.084540] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T17:35:50.169263] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:50.179340] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T17:35:50.243251] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-19T17:35:51.043270] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-19T17:35:51.231273] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T17:35:51.843284] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-19T17:35:52.052278] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:35:52.431243] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T17:35:52.643224] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-19T17:35:53.159957] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T17:35:53.443241] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-19T17:35:54.187607] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:35:54.243221] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-19T17:35:54.951452] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T17:35:55.043272] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-19T17:35:55.843261] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-19T17:35:55.871143] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:35:56.541739] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T17:35:56.643270] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-19T17:35:57.133304] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:35:57.443268] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-19T17:35:58.243281] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-19T17:35:58.576980] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T17:35:59.043270] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-19T17:35:59.673503] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T17:35:59.843269] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-19T17:36:00.181221] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T17:36:00.643278] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-19T17:36:01.128427] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T17:36:01.223054] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T17:36:01.443309] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-19T17:36:01.796779] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T17:36:02.243308] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-19T17:36:03.043278] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-19T17:36:03.843284] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-19T17:36:04.676099] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (3.23 seconds). [2025-09-19T17:36:04.687870] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-19T17:36:05.169681] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T17:36:05.342887] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (3.10 seconds). [2025-09-19T17:36:05.443276] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-19T17:36:06.243329] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-19T17:36:06.422913] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T17:36:06.555049] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (3.51 seconds). [2025-09-19T17:36:06.562610] [INFO ] [REMOTE ] BHVN: Full fetch complete (69169 records). [2025-09-19T17:36:06.562775] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-19T17:36:06.965599] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-19T17:36:06.966049] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-19T17:36:06.966873] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-19T17:36:06.966981] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-19T17:36:06.988361] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-19T17:36:06.987332] [DEBUG] [LOCAL ] BHVN: Trimmed 69169 records to 50308 (keeping 200 days of data) [2025-09-19T17:36:06.996420] [INFO ] [REMOTE ] BILL: Full fetch complete (75177 records). [2025-09-19T17:36:06.996897] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-19T17:36:06.998337] [FATAL] [VALIDATOR ] BILL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:36:06.998510] [FATAL] [MAIN ] BILL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:36:06.998612] [WARN ] [MAIN ] BILL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:36:06.998744] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-19T17:36:06.998872] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-09-19T17:36:06.998963] [INFO ] [LOCAL ] BILL: Starting deletion of derivative data. [2025-09-19T17:36:06.999623] [DEBUG] [LOCAL ] BILL: Deleted derivative data file. [2025-09-19T17:36:06.999814] [INFO ] [MAIN ] Update Progress: 275/2372 symbols completed. BILL took 36.4s. Estimated remaining: 4h 34m 52s. Rate: 7.6 symbols/min [2025-09-19T17:36:07.051714] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-19T17:36:07.282862] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:07.439017] [DEBUG] [LOCAL ] BIPC: Loaded 42113 existing records from primary storage. [2025-09-19T17:36:07.440189] [INFO ] [MAIN ] BIPC: Loaded 42113 existing records. [2025-09-19T17:36:07.688765] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:07.719314] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-19T17:36:07.719126] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T17:36:07.732475] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-19T17:36:07.744580] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-19T17:36:07.745027] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-19T17:36:07.860513] [DEBUG] [LOCAL ] BHVN: Primary data saved (50308 records). [2025-09-19T17:36:07.864058] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-19T17:36:07.860396] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-19T17:36:07.864279] [INFO ] [MAIN ] Update Progress: 276/2372 symbols completed. BHVN took 37.6s. Estimated remaining: 4h 33m 51s. Rate: 7.7 symbols/min [2025-09-19T17:36:08.302523] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:08.307745] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:08.312452] [DEBUG] [LOCAL ] BIPH: Loaded 2641 existing records from primary storage. [2025-09-19T17:36:08.312540] [INFO ] [MAIN ] BIPH: Loaded 2641 existing records. [2025-09-19T17:36:08.502928] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:08.503383] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-19T17:36:08.503479] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-19T17:36:08.503876] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-19T17:36:08.504010] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-19T17:36:08.670667] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-19T17:36:08.672234] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T17:36:08.891988] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:09.443316] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-19T17:36:09.775183] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:36:10.243317] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-19T17:36:10.275240] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T17:36:10.477591] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:36:11.043305] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-19T17:36:11.524891] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T17:36:11.843291] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-19T17:36:12.026907] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T17:36:12.643303] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-19T17:36:13.443287] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-19T17:36:14.134268] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T17:36:14.243262] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-19T17:36:14.368989] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T17:36:14.859688] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T17:36:14.866111] [INFO ] [REMOTE ] BIP: Full fetch complete (56260 records). [2025-09-19T17:36:14.866262] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-19T17:36:15.054326] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-19T17:36:15.270146] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-19T17:36:15.270263] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-19T17:36:15.271841] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-19T17:36:15.271908] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-19T17:36:15.273199] [DEBUG] [LOCAL ] BIP: Trimmed 56260 records to 40386 (keeping 200 days of data) [2025-09-19T17:36:15.520503] [DEBUG] [LOCAL ] BIP: Primary data saved (40386 records). [2025-09-19T17:36:15.520636] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-19T17:36:15.520775] [INFO ] [MAIN ] Update Progress: 277/2372 symbols completed. BIP took 26.1s. Estimated remaining: 4h 33m 42s. Rate: 7.7 symbols/min [2025-09-19T17:36:15.843252] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-19T17:36:15.906614] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T17:36:16.114216] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T17:36:16.117446] [INFO ] [REMOTE ] BIO: Full fetch complete (34177 records). [2025-09-19T17:36:16.117536] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-19T17:36:16.503566] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-19T17:36:16.503678] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-19T17:36:16.504221] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-19T17:36:16.504282] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-19T17:36:16.505227] [DEBUG] [LOCAL ] BIO: Trimmed 34177 records to 26070 (keeping 200 days of data) [2025-09-19T17:36:16.654463] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-19T17:36:16.654629] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T17:36:16.669814] [DEBUG] [LOCAL ] BIO: Primary data saved (26070 records). [2025-09-19T17:36:16.670002] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-19T17:36:16.670115] [INFO ] [MAIN ] Update Progress: 278/2372 symbols completed. BIO took 31.2s. Estimated remaining: 4h 32m 43s. Rate: 7.7 symbols/min [2025-09-19T17:36:17.443393] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-19T17:36:18.157386] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-19T17:36:18.243264] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-19T17:36:18.567276] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T17:36:18.856873] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-19T17:36:19.043300] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-19T17:36:19.705322] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T17:36:19.843249] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-19T17:36:20.381615] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T17:36:20.643275] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-19T17:36:21.443314] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-19T17:36:21.791691] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-19T17:36:22.243289] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-19T17:36:22.352552] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T17:36:23.043265] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-19T17:36:23.103260] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T17:36:23.104241] [INFO ] [REMOTE ] BIPH: Full fetch complete (4341 records). [2025-09-19T17:36:23.104312] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-19T17:36:23.467180] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-19T17:36:23.467259] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-19T17:36:23.467405] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-19T17:36:23.467445] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-19T17:36:23.467845] [DEBUG] [LOCAL ] BIPH: Trimmed 4341 records to 2654 (keeping 200 days of data) [2025-09-19T17:36:23.484237] [DEBUG] [LOCAL ] BIPH: Primary data saved (2654 records). [2025-09-19T17:36:23.484329] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-19T17:36:23.484408] [INFO ] [MAIN ] Update Progress: 279/2372 symbols completed. BIPH took 15.6s. Estimated remaining: 4h 32m 28s. Rate: 7.7 symbols/min [2025-09-19T17:36:24.927605] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T17:36:24.937265] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-19T17:36:26.574824] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:36:26.583379] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-19T17:36:27.951959] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:36:27.961325] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-19T17:36:29.728248] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T17:36:29.737535] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-19T17:36:31.945946] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T17:36:31.954255] [INFO ] [REMOTE ] BIPC: Full fetch complete (59409 records). [2025-09-19T17:36:31.954435] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-19T17:36:32.360703] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-19T17:36:32.360794] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-19T17:36:32.361435] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-19T17:36:32.361477] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-19T17:36:32.362767] [DEBUG] [LOCAL ] BIPC: Trimmed 59409 records to 42343 (keeping 200 days of data) [2025-09-19T17:36:32.618936] [DEBUG] [LOCAL ] BIPC: Primary data saved (42343 records). [2025-09-19T17:36:32.619069] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-19T17:36:32.619911] [INFO ] [MAIN ] Update Progress: 280/2372 symbols completed. BIPC took 25.6s. Estimated remaining: 4h 32m 30s. Rate: 7.7 symbols/min [2025-09-19T17:36:33.277608] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:33.346832] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:33.374681] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:33.379212] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:33.390470] [DEBUG] [LOCAL ] BIPI: Loaded 3452 existing records from primary storage. [2025-09-19T17:36:33.392517] [DEBUG] [LOCAL ] BIPJ: Loaded 2902 existing records from primary storage. [2025-09-19T17:36:33.392773] [INFO ] [MAIN ] BIPI: Loaded 3452 existing records. [2025-09-19T17:36:33.392690] [INFO ] [MAIN ] BIPJ: Loaded 2902 existing records. [2025-09-19T17:36:33.571038] [DEBUG] [LOCAL ] BIT: Loaded 22188 existing records from primary storage. [2025-09-19T17:36:33.592583] [INFO ] [MAIN ] BIT: Loaded 22188 existing records. [2025-09-19T17:36:33.822745] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:33.972868] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:33.949972] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-19T17:36:33.979237] [DEBUG] [LOCAL ] BIRK: Loaded 51180 existing records from primary storage. [2025-09-19T17:36:33.989912] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-19T17:36:34.006584] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-19T17:36:33.989813] [INFO ] [MAIN ] BIRK: Loaded 51180 existing records. [2025-09-19T17:36:34.021721] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-19T17:36:34.054042] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-19T17:36:34.077139] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-19T17:36:34.071965] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-19T17:36:34.110879] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:34.088330] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-19T17:36:34.221703] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-19T17:36:34.270182] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-19T17:36:34.297523] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-19T17:36:34.342081] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-19T17:36:34.528600] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:34.621769] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-19T17:36:34.637922] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-19T17:36:34.714526] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-19T17:36:34.714715] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-19T17:36:35.453102] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:35.527382] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:35.554384] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-19T17:36:35.563198] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-19T17:36:35.640742] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:35.653852] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-19T17:36:35.735257] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:35.735619] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-19T17:36:36.502828] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T17:36:36.504584] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-19T17:36:36.633522] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T17:36:36.637097] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-19T17:36:36.907371] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-19T17:36:36.909147] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-19T17:36:36.927962] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T17:36:36.933156] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-19T17:36:37.076865] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-19T17:36:37.078307] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-19T17:36:37.493810] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T17:36:37.496498] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-19T17:36:37.771371] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T17:36:37.773371] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-19T17:36:37.821490] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T17:36:37.836423] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-19T17:36:37.961366] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T17:36:37.967996] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-19T17:36:38.192823] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T17:36:38.195981] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-19T17:36:38.318266] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T17:36:38.320158] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-19T17:36:38.815173] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T17:36:38.925376] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T17:36:39.043253] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-19T17:36:39.234204] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T17:36:39.608747] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T17:36:39.843290] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-19T17:36:39.960311] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T17:36:40.615176] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T17:36:40.643231] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-19T17:36:41.443268] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-19T17:36:41.974416] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T17:36:42.243266] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-19T17:36:43.043269] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-19T17:36:43.266665] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:36:43.534350] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T17:36:43.579157] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:36:43.843266] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-19T17:36:44.643267] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-19T17:36:45.443292] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-19T17:36:45.482869] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-19T17:36:45.722436] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:36:45.825118] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T17:36:46.243273] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-19T17:36:47.043281] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-19T17:36:47.649772] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T17:36:47.843317] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-19T17:36:48.316505] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T17:36:48.643313] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-19T17:36:48.888672] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T17:36:49.443305] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-19T17:36:50.243305] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-19T17:36:50.672636] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:36:50.854323] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T17:36:51.043287] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-19T17:36:51.081615] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T17:36:51.522037] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T17:36:51.523275] [INFO ] [REMOTE ] BIPI: Full fetch complete (5300 records). [2025-09-19T17:36:51.523346] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-19T17:36:51.848362] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-19T17:36:51.893279] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-19T17:36:51.893370] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-19T17:36:51.893567] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-19T17:36:51.893605] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-19T17:36:51.894017] [DEBUG] [LOCAL ] BIPI: Trimmed 5300 records to 3466 (keeping 200 days of data) [2025-09-19T17:36:51.916262] [DEBUG] [LOCAL ] BIPI: Primary data saved (3466 records). [2025-09-19T17:36:51.916365] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-19T17:36:51.916456] [INFO ] [MAIN ] Update Progress: 281/2372 symbols completed. BIPI took 19.3s. Estimated remaining: 4h 33m 48s. Rate: 7.6 symbols/min [2025-09-19T17:36:52.086627] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:52.141203] [DEBUG] [LOCAL ] BJ: Loaded 51813 existing records from primary storage. [2025-09-19T17:36:52.141398] [INFO ] [MAIN ] BJ: Loaded 51813 existing records. [2025-09-19T17:36:52.322792] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:52.323044] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-19T17:36:52.323093] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-19T17:36:52.324549] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-19T17:36:52.324611] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-19T17:36:52.648401] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-19T17:36:52.689801] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:53.443273] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-19T17:36:53.547533] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T17:36:53.984160] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T17:36:54.243308] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-19T17:36:54.715698] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T17:36:55.043271] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-19T17:36:55.326706] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T17:36:55.332225] [INFO ] [REMOTE ] BIT: Full fetch complete (30965 records). [2025-09-19T17:36:55.332313] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-19T17:36:55.709738] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-19T17:36:55.709884] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-19T17:36:55.710346] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-19T17:36:55.710388] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-19T17:36:55.711159] [DEBUG] [LOCAL ] BIT: Trimmed 30965 records to 22461 (keeping 200 days of data) [2025-09-19T17:36:55.845014] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-19T17:36:55.850194] [DEBUG] [LOCAL ] BIT: Primary data saved (22461 records). [2025-09-19T17:36:55.850316] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-19T17:36:55.850407] [INFO ] [MAIN ] Update Progress: 282/2372 symbols completed. BIT took 23.2s. Estimated remaining: 4h 33m 11s. Rate: 7.7 symbols/min [2025-09-19T17:36:56.019988] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:56.079856] [DEBUG] [LOCAL ] BK: Loaded 53955 existing records from primary storage. [2025-09-19T17:36:56.080006] [INFO ] [MAIN ] BK: Loaded 53955 existing records. [2025-09-19T17:36:56.259014] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:56.259405] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-19T17:36:56.259470] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-19T17:36:56.261921] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-19T17:36:56.261984] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-19T17:36:56.355830] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T17:36:56.635150] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T17:36:56.651688] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-19T17:36:56.656826] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:57.014261] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-19T17:36:57.443275] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-19T17:36:58.117398] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T17:36:58.118789] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4263 records). [2025-09-19T17:36:58.118871] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-19T17:36:58.248359] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-19T17:36:58.495738] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-19T17:36:58.495830] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-19T17:36:58.496008] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-19T17:36:58.496047] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-19T17:36:58.496425] [DEBUG] [LOCAL ] BIPJ: Trimmed 4263 records to 2913 (keeping 200 days of data) [2025-09-19T17:36:58.514395] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2913 records). [2025-09-19T17:36:58.514471] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-19T17:36:58.514545] [INFO ] [MAIN ] Update Progress: 283/2372 symbols completed. BIPJ took 25.9s. Estimated remaining: 4h 32m 25s. Rate: 7.7 symbols/min [2025-09-19T17:36:58.683919] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:58.737364] [DEBUG] [LOCAL ] BKD: Loaded 50478 existing records from primary storage. [2025-09-19T17:36:58.737513] [INFO ] [MAIN ] BKD: Loaded 50478 existing records. [2025-09-19T17:36:58.920344] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:58.920593] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-19T17:36:58.920662] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-19T17:36:58.922175] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-19T17:36:58.922237] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-19T17:36:59.048521] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-19T17:36:59.304896] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:59.843262] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-19T17:37:00.643301] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-19T17:37:00.758109] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-19T17:37:01.443285] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-19T17:37:01.624289] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T17:37:01.834846] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T17:37:02.243249] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-19T17:37:02.649619] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:37:02.992400] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T17:37:03.043228] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-19T17:37:03.843312] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-19T17:37:04.413125] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:37:04.643291] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-19T17:37:05.027963] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:37:05.443271] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-19T17:37:05.834080] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T17:37:06.243274] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-19T17:37:06.400604] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:37:06.962209] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:37:07.043260] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-19T17:37:07.843269] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-19T17:37:08.415753] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T17:37:08.507457] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:37:08.516103] [INFO ] [REMOTE ] BIRK: Full fetch complete (72674 records). [2025-09-19T17:37:08.516259] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-19T17:37:08.648398] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-19T17:37:08.928174] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-19T17:37:08.928260] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-19T17:37:08.929151] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-19T17:37:08.929236] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-19T17:37:08.930943] [DEBUG] [LOCAL ] BIRK: Trimmed 72674 records to 51561 (keeping 200 days of data) [2025-09-19T17:37:09.228253] [DEBUG] [LOCAL ] BIRK: Primary data saved (51561 records). [2025-09-19T17:37:09.228393] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-19T17:37:09.228495] [INFO ] [MAIN ] Update Progress: 284/2372 symbols completed. BIRK took 36.6s. Estimated remaining: 4h 32m 38s. Rate: 7.7 symbols/min [2025-09-19T17:37:09.402675] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:09.402874] [DEBUG] [LOCAL ] BKE: No existing data file found in primary storage. [2025-09-19T17:37:09.402928] [WARN ] [MAIN ] BKE: No existing data found, performing full refresh instead. [2025-09-19T17:37:09.403082] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-19T17:37:09.403132] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-19T17:37:09.403174] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-09-19T17:37:09.403216] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-19T17:37:09.466358] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-19T17:37:09.760231] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:09.971402] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T17:37:10.243292] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-19T17:37:10.722451] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T17:37:10.761367] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T17:37:11.043283] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-19T17:37:11.843267] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-19T17:37:12.511230] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T17:37:12.643282] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-19T17:37:13.078803] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:37:13.163554] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T17:37:13.443378] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-19T17:37:13.886613] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:37:14.243334] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-19T17:37:15.043289] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-19T17:37:15.549938] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T17:37:15.843272] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-19T17:37:16.316298] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T17:37:16.643267] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-19T17:37:17.014510] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T17:37:17.443286] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-19T17:37:18.240796] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T17:37:18.251830] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-19T17:37:18.760518] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T17:37:19.018265] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T17:37:19.043231] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-19T17:37:19.645683] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T17:37:19.843295] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-19T17:37:20.270520] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:37:20.643304] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-19T17:37:21.443282] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-19T17:37:22.055582] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T17:37:22.243287] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-19T17:37:22.433026] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:37:23.043228] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-19T17:37:23.544893] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:37:23.843265] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-19T17:37:23.906137] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T17:37:24.643261] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-19T17:37:24.889809] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T17:37:25.443350] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-19T17:37:25.724050] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T17:37:26.243284] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-19T17:37:26.516459] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T17:37:26.778575] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T17:37:26.786757] [INFO ] [REMOTE ] BK: Full fetch complete (77490 records). [2025-09-19T17:37:26.786931] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-19T17:37:27.048422] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-19T17:37:27.198002] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-19T17:37:27.198141] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-19T17:37:27.199043] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-19T17:37:27.199157] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-19T17:37:27.201224] [DEBUG] [LOCAL ] BK: Trimmed 77490 records to 54345 (keeping 200 days of data) [2025-09-19T17:37:27.557993] [DEBUG] [LOCAL ] BK: Primary data saved (54345 records). [2025-09-19T17:37:27.558146] [INFO ] [MAIN ] BK: Full history saved. [2025-09-19T17:37:27.559338] [INFO ] [MAIN ] Update Progress: 285/2372 symbols completed. BK took 31.7s. Estimated remaining: 4h 33m 47s. Rate: 7.6 symbols/min [2025-09-19T17:37:27.736214] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:27.774460] [DEBUG] [LOCAL ] BKH: Loaded 37008 existing records from primary storage. [2025-09-19T17:37:27.774597] [INFO ] [MAIN ] BKH: Loaded 37008 existing records. [2025-09-19T17:37:27.848445] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-19T17:37:27.960301] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:37:27.960882] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-19T17:37:27.960973] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-19T17:37:27.962289] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-19T17:37:27.962378] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-19T17:37:28.313619] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:28.434690] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T17:37:28.444123] [INFO ] [REMOTE ] BJ: Full fetch complete (73716 records). [2025-09-19T17:37:28.444307] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-19T17:37:28.664791] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-19T17:37:28.897222] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-19T17:37:28.897419] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-19T17:37:28.898337] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-19T17:37:28.898445] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-19T17:37:28.926706] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T17:37:28.930115] [DEBUG] [LOCAL ] BJ: Trimmed 73716 records to 52202 (keeping 200 days of data) [2025-09-19T17:37:29.251270] [DEBUG] [LOCAL ] BJ: Primary data saved (52202 records). [2025-09-19T17:37:29.251407] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-19T17:37:29.251492] [INFO ] [MAIN ] Update Progress: 286/2372 symbols completed. BJ took 37.3s. Estimated remaining: 4h 32m 54s. Rate: 7.6 symbols/min [2025-09-19T17:37:29.423454] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:29.448137] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-19T17:37:29.465690] [DEBUG] [LOCAL ] BKKT: Loaded 34296 existing records from primary storage. [2025-09-19T17:37:29.465813] [INFO ] [MAIN ] BKKT: Loaded 34296 existing records. [2025-09-19T17:37:29.641586] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:37:29.641854] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-19T17:37:29.641908] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-19T17:37:29.642906] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-19T17:37:29.642967] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-19T17:37:29.999076] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:30.038369] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T17:37:30.162532] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:37:30.243212] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-19T17:37:31.043349] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-19T17:37:31.108449] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T17:37:31.843368] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-19T17:37:32.337000] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T17:37:32.344304] [INFO ] [REMOTE ] BKD: Full fetch complete (71361 records). [2025-09-19T17:37:32.344427] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-19T17:37:32.645289] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-19T17:37:32.741917] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-19T17:37:32.742152] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-19T17:37:32.743108] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-19T17:37:32.743177] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-19T17:37:32.744824] [DEBUG] [LOCAL ] BKD: Trimmed 71361 records to 50838 (keeping 200 days of data) [2025-09-19T17:37:33.059122] [DEBUG] [LOCAL ] BKD: Primary data saved (50838 records). [2025-09-19T17:37:33.059492] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-19T17:37:33.059681] [INFO ] [MAIN ] Update Progress: 287/2372 symbols completed. BKD took 34.5s. Estimated remaining: 4h 32m 17s. Rate: 7.7 symbols/min [2025-09-19T17:37:33.150807] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T17:37:33.183273] [INFO ] [REMOTE ] BKE: Full fetch complete (50318 records). [2025-09-19T17:37:33.209252] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-19T17:37:33.253904] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:33.445889] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-19T17:37:33.428075] [DEBUG] [LOCAL ] BKN: Loaded 7722 existing records from primary storage. [2025-09-19T17:37:33.446432] [INFO ] [MAIN ] BKN: Loaded 7722 existing records. [2025-09-19T17:37:33.512380] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-19T17:37:33.829533] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:37:33.886396] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-19T17:37:33.886228] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-19T17:37:33.886549] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-19T17:37:33.887414] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-19T17:37:33.887693] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-19T17:37:33.887505] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-19T17:37:33.889558] [DEBUG] [LOCAL ] BKE: Trimmed 50318 records to 35441 (keeping 200 days of data) [2025-09-19T17:37:33.890201] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-19T17:37:33.890612] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-19T17:37:34.143540] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T17:37:34.253263] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-19T17:37:34.472473] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:34.520337] [DEBUG] [LOCAL ] BKE: Primary data saved (35441 records). [2025-09-19T17:37:34.520455] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-19T17:37:34.520530] [INFO ] [MAIN ] Update Progress: 288/2372 symbols completed. BKE took 25.3s. Estimated remaining: 4h 31m 23s. Rate: 7.7 symbols/min [2025-09-19T17:37:34.692068] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:34.747692] [DEBUG] [LOCAL ] BKSY: Loaded 48677 existing records from primary storage. [2025-09-19T17:37:34.747848] [INFO ] [MAIN ] BKSY: Loaded 48677 existing records. [2025-09-19T17:37:34.928029] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:37:34.928263] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-19T17:37:34.928318] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-19T17:37:34.929762] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-19T17:37:34.929822] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-19T17:37:35.048341] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-19T17:37:35.306755] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:35.631639] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T17:37:35.843313] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-19T17:37:36.005008] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T17:37:36.299313] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T17:37:36.643280] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-19T17:37:37.047563] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T17:37:37.443320] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-19T17:37:38.243276] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-19T17:37:38.386856] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T17:37:38.445573] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T17:37:39.043311] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-19T17:37:39.607029] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T17:37:39.843285] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-19T17:37:40.643304] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-19T17:37:40.872937] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T17:37:40.902150] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T17:37:41.374599] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T17:37:41.443350] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-19T17:37:42.243302] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-19T17:37:43.030343] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T17:37:43.043207] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-19T17:37:43.843264] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-19T17:37:44.324139] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T17:37:44.426512] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:37:44.643271] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-19T17:37:45.066225] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T17:37:45.443292] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-19T17:37:46.243279] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-19T17:37:46.398713] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:37:46.471294] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T17:37:47.043339] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-19T17:37:47.800748] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:37:47.843229] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-19T17:37:48.643299] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-19T17:37:49.155006] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T17:37:49.291962] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T17:37:49.443222] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-19T17:37:49.574901] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T17:37:50.243264] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-19T17:37:51.043282] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-19T17:37:51.696082] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-19T17:37:51.731195] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T17:37:51.739985] [INFO ] [REMOTE ] BKH: Full fetch complete (52009 records). [2025-09-19T17:37:51.740166] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-19T17:37:51.849462] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-19T17:37:52.135274] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-19T17:37:52.135371] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-19T17:37:52.136084] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-19T17:37:52.136152] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-19T17:37:52.137302] [DEBUG] [LOCAL ] BKH: Trimmed 52009 records to 37246 (keeping 200 days of data) [2025-09-19T17:37:52.364004] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:37:52.398084] [DEBUG] [LOCAL ] BKH: Primary data saved (37246 records). [2025-09-19T17:37:52.398230] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-19T17:37:52.398735] [INFO ] [MAIN ] Update Progress: 289/2372 symbols completed. BKH took 24.8s. Estimated remaining: 4h 32m 28s. Rate: 7.6 symbols/min [2025-09-19T17:37:52.568465] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:52.568848] [DEBUG] [LOCAL ] BKT: No existing data file found in primary storage. [2025-09-19T17:37:52.568914] [WARN ] [MAIN ] BKT: No existing data found, performing full refresh instead. [2025-09-19T17:37:52.569147] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-19T17:37:52.569224] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-19T17:37:52.569315] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-09-19T17:37:52.569388] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-19T17:37:52.648337] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-19T17:37:52.943274] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:53.443297] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-19T17:37:53.851234] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T17:37:53.896561] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T17:37:54.243260] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-19T17:37:54.811790] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T17:37:55.043257] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-19T17:37:55.760315] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T17:37:55.843222] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-19T17:37:55.907638] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T17:37:56.643255] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-19T17:37:57.443240] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-19T17:37:57.520034] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T17:37:57.723374] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T17:37:58.243276] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-19T17:37:59.043280] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-19T17:37:59.180171] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T17:37:59.446683] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T17:37:59.843337] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-19T17:37:59.974623] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T17:38:00.618399] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T17:38:00.620182] [INFO ] [REMOTE ] BKN: Full fetch complete (12025 records). [2025-09-19T17:38:00.620253] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-19T17:38:00.649791] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-19T17:38:00.991099] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-19T17:38:00.991189] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-19T17:38:00.991564] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-19T17:38:00.991625] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-19T17:38:00.992269] [DEBUG] [LOCAL ] BKN: Trimmed 12025 records to 7752 (keeping 200 days of data) [2025-09-19T17:38:01.041610] [DEBUG] [LOCAL ] BKN: Primary data saved (7752 records). [2025-09-19T17:38:01.041804] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-19T17:38:01.041912] [INFO ] [MAIN ] Update Progress: 290/2372 symbols completed. BKN took 28.0s. Estimated remaining: 4h 32m 26s. Rate: 7.6 symbols/min [2025-09-19T17:38:01.225903] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:01.270196] [DEBUG] [LOCAL ] BKU: Loaded 42458 existing records from primary storage. [2025-09-19T17:38:01.270347] [INFO ] [MAIN ] BKU: Loaded 42458 existing records. [2025-09-19T17:38:01.447716] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-19T17:38:01.447936] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:01.449287] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-19T17:38:01.449350] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-19T17:38:01.450579] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-19T17:38:01.450670] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-19T17:38:01.815209] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:02.243262] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-19T17:38:02.899502] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T17:38:02.906159] [INFO ] [REMOTE ] BKKT: Full fetch complete (49434 records). [2025-09-19T17:38:02.906270] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-19T17:38:03.048791] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-19T17:38:03.306150] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-19T17:38:03.306267] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-19T17:38:03.306926] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-19T17:38:03.307000] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-19T17:38:03.308099] [DEBUG] [LOCAL ] BKKT: Trimmed 49434 records to 34629 (keeping 200 days of data) [2025-09-19T17:38:03.495676] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T17:38:03.521134] [DEBUG] [LOCAL ] BKKT: Primary data saved (34629 records). [2025-09-19T17:38:03.521290] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-19T17:38:03.521929] [INFO ] [MAIN ] Update Progress: 291/2372 symbols completed. BKKT took 34.3s. Estimated remaining: 4h 31m 40s. Rate: 7.7 symbols/min [2025-09-19T17:38:03.699400] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:03.731493] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-19T17:38:03.762498] [DEBUG] [LOCAL ] BKV: Loaded 30424 existing records from primary storage. [2025-09-19T17:38:03.762670] [INFO ] [MAIN ] BKV: Loaded 30424 existing records. [2025-09-19T17:38:03.851174] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-19T17:38:03.945944] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:03.946257] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-19T17:38:03.946339] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-19T17:38:03.947161] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-19T17:38:03.947258] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-19T17:38:04.320115] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:04.390506] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:38:04.643267] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-19T17:38:05.443307] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-19T17:38:05.556191] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T17:38:05.759223] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:38:06.243283] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-19T17:38:07.043478] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-19T17:38:07.506939] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:38:07.843279] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-19T17:38:07.982961] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T17:38:08.643241] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-19T17:38:08.687239] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T17:38:09.443240] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-19T17:38:09.540291] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T17:38:09.851701] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T17:38:10.243271] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-19T17:38:11.043271] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-19T17:38:11.249623] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T17:38:11.843262] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-19T17:38:12.353586] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T17:38:12.643260] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-19T17:38:12.761699] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T17:38:12.924730] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-19T17:38:12.932076] [INFO ] [REMOTE ] BKSY: Full fetch complete (69255 records). [2025-09-19T17:38:12.932227] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-19T17:38:13.319598] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-19T17:38:13.319725] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-19T17:38:13.320460] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-19T17:38:13.320504] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-19T17:38:13.322026] [DEBUG] [LOCAL ] BKSY: Trimmed 69255 records to 49065 (keeping 200 days of data) [2025-09-19T17:38:13.486635] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-19T17:38:13.609354] [DEBUG] [LOCAL ] BKSY: Primary data saved (49065 records). [2025-09-19T17:38:13.609493] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-19T17:38:13.609576] [INFO ] [MAIN ] Update Progress: 292/2372 symbols completed. BKSY took 39.1s. Estimated remaining: 4h 31m 48s. Rate: 7.7 symbols/min [2025-09-19T17:38:13.776338] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:13.812243] [DEBUG] [LOCAL ] BLCO: Loaded 36511 existing records from primary storage. [2025-09-19T17:38:13.812832] [INFO ] [MAIN ] BLCO: Loaded 36511 existing records. [2025-09-19T17:38:13.988555] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:13.988867] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-19T17:38:13.988921] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-19T17:38:13.989883] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-19T17:38:13.989943] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-19T17:38:14.248383] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-19T17:38:14.349440] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:14.463849] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T17:38:14.513802] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T17:38:15.043259] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-19T17:38:15.843269] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-19T17:38:16.066264] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:38:16.347518] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T17:38:16.643234] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-19T17:38:17.062280] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T17:38:17.443321] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-19T17:38:18.243274] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-19T17:38:18.650539] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:38:18.917616] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T17:38:19.043254] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-19T17:38:19.218170] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T17:38:19.693624] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T17:38:19.843236] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-19T17:38:20.627906] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T17:38:20.631328] [INFO ] [REMOTE ] BKT: Full fetch complete (14672 records). [2025-09-19T17:38:20.631435] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-19T17:38:20.631952] [FATAL] [VALIDATOR ] BKT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:38:20.632058] [FATAL] [MAIN ] BKT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:38:20.632155] [WARN ] [MAIN ] BKT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:38:20.632239] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-19T17:38:20.632307] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-09-19T17:38:20.632343] [INFO ] [LOCAL ] BKT: Starting deletion of derivative data. [2025-09-19T17:38:20.632399] [DEBUG] [LOCAL ] BKT: No derivative data file found to delete. [2025-09-19T17:38:20.632480] [INFO ] [MAIN ] Update Progress: 293/2372 symbols completed. BKT took 28.2s. Estimated remaining: 4h 31m 34s. Rate: 7.7 symbols/min [2025-09-19T17:38:20.653110] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-19T17:38:20.817980] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:20.856167] [DEBUG] [LOCAL ] BLD: Loaded 28388 existing records from primary storage. [2025-09-19T17:38:20.856332] [INFO ] [MAIN ] BLD: Loaded 28388 existing records. [2025-09-19T17:38:21.045302] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:21.045713] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-19T17:38:21.045773] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-19T17:38:21.046842] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-19T17:38:21.046905] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-19T17:38:21.448444] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-19T17:38:21.454741] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:22.243283] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-19T17:38:22.300766] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T17:38:22.793578] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T17:38:23.043262] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-19T17:38:23.843350] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-19T17:38:24.061327] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:38:24.177973] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T17:38:24.643279] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-19T17:38:25.443263] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-19T17:38:25.636209] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:38:26.243264] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-19T17:38:26.368557] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T17:38:26.780676] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:38:27.043288] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-19T17:38:27.843271] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-19T17:38:27.878632] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T17:38:28.108458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T17:38:28.643269] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-19T17:38:29.443276] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-19T17:38:29.860977] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:38:29.867470] [INFO ] [REMOTE ] BKU: Full fetch complete (59736 records). [2025-09-19T17:38:29.867633] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-19T17:38:30.249605] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-19T17:38:30.252675] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-19T17:38:30.253537] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-19T17:38:30.254264] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-19T17:38:30.254330] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-19T17:38:30.255729] [DEBUG] [LOCAL ] BKU: Trimmed 59736 records to 42752 (keeping 200 days of data) [2025-09-19T17:38:30.516806] [DEBUG] [LOCAL ] BKU: Primary data saved (42752 records). [2025-09-19T17:38:30.516940] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-19T17:38:30.517026] [INFO ] [MAIN ] Update Progress: 294/2372 symbols completed. BKU took 29.5s. Estimated remaining: 4h 31m 41s. Rate: 7.6 symbols/min [2025-09-19T17:38:30.729036] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:30.730389] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T17:38:30.760307] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:38:30.815001] [DEBUG] [LOCAL ] BLDR: Loaded 52011 existing records from primary storage. [2025-09-19T17:38:30.815172] [INFO ] [MAIN ] BLDR: Loaded 52011 existing records. [2025-09-19T17:38:31.008163] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:31.008489] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-19T17:38:31.008557] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-19T17:38:31.009895] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-19T17:38:31.009956] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-19T17:38:31.048354] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-19T17:38:31.395989] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:31.414779] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T17:38:31.843261] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-19T17:38:32.512617] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T17:38:32.643264] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-19T17:38:33.443283] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-19T17:38:33.599329] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T17:38:34.128670] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T17:38:34.243267] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-19T17:38:35.020004] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T17:38:35.043241] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-19T17:38:35.843277] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-19T17:38:36.305446] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:38:36.420922] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T17:38:36.643302] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-19T17:38:37.443332] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-19T17:38:37.598801] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:38:37.760230] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T17:38:38.243317] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-19T17:38:39.043277] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-19T17:38:39.170274] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:38:39.681696] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T17:38:39.843322] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-19T17:38:40.408330] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T17:38:40.643266] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-19T17:38:41.070398] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T17:38:41.075232] [INFO ] [REMOTE ] BLCO: Full fetch complete (52583 records). [2025-09-19T17:38:41.075391] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-19T17:38:41.445466] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-19T17:38:41.464553] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-19T17:38:41.464633] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-19T17:38:41.465341] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-19T17:38:41.465419] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-19T17:38:41.466726] [DEBUG] [LOCAL ] BLCO: Trimmed 52583 records to 36678 (keeping 200 days of data) [2025-09-19T17:38:41.675549] [DEBUG] [LOCAL ] BLCO: Primary data saved (36678 records). [2025-09-19T17:38:41.675723] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-19T17:38:41.675820] [INFO ] [MAIN ] Update Progress: 295/2372 symbols completed. BLCO took 28.1s. Estimated remaining: 4h 31m 56s. Rate: 7.6 symbols/min [2025-09-19T17:38:41.850247] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:41.866191] [DEBUG] [LOCAL ] BLE: Loaded 14919 existing records from primary storage. [2025-09-19T17:38:41.866313] [INFO ] [MAIN ] BLE: Loaded 14919 existing records. [2025-09-19T17:38:42.043662] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:42.043969] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-19T17:38:42.044028] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-19T17:38:42.044602] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-19T17:38:42.044703] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-19T17:38:42.251633] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-19T17:38:42.401542] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:42.793726] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T17:38:43.015458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T17:38:43.043221] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-19T17:38:43.681853] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T17:38:43.843278] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-19T17:38:44.643306] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-19T17:38:44.918819] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T17:38:45.443299] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-19T17:38:45.638271] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T17:38:45.928089] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T17:38:45.932714] [INFO ] [REMOTE ] BKV: Full fetch complete (44975 records). [2025-09-19T17:38:45.932898] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-19T17:38:46.243815] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-19T17:38:46.335314] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-19T17:38:46.335398] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-19T17:38:46.336071] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-19T17:38:46.336136] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-19T17:38:46.337168] [DEBUG] [LOCAL ] BKV: Trimmed 44975 records to 30602 (keeping 200 days of data) [2025-09-19T17:38:46.512220] [DEBUG] [LOCAL ] BKV: Primary data saved (30602 records). [2025-09-19T17:38:46.512386] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-19T17:38:46.512497] [INFO ] [MAIN ] Update Progress: 296/2372 symbols completed. BKV took 43.0s. Estimated remaining: 4h 31m 27s. Rate: 7.6 symbols/min [2025-09-19T17:38:46.682620] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:46.724974] [DEBUG] [LOCAL ] BLK: Loaded 35664 existing records from primary storage. [2025-09-19T17:38:46.725116] [INFO ] [MAIN ] BLK: Loaded 35664 existing records. [2025-09-19T17:38:46.911931] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:46.912300] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-19T17:38:46.912361] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-19T17:38:46.913227] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-19T17:38:46.913287] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-19T17:38:47.045781] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-19T17:38:47.294109] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:47.312001] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:38:47.717185] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T17:38:47.843262] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-19T17:38:48.379328] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T17:38:48.643265] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-19T17:38:49.309868] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:38:49.443255] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-19T17:38:50.243279] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-19T17:38:50.687124] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T17:38:51.043257] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-19T17:38:51.534716] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T17:38:51.843262] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-19T17:38:51.943599] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T17:38:51.947914] [INFO ] [REMOTE ] BLD: Full fetch complete (40405 records). [2025-09-19T17:38:51.948015] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-19T17:38:52.327555] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-19T17:38:52.327697] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-19T17:38:52.328267] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-19T17:38:52.328338] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-19T17:38:52.329865] [DEBUG] [LOCAL ] BLD: Trimmed 40405 records to 28606 (keeping 200 days of data) [2025-09-19T17:38:52.507525] [DEBUG] [LOCAL ] BLD: Primary data saved (28606 records). [2025-09-19T17:38:52.507696] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-19T17:38:52.507819] [INFO ] [MAIN ] Update Progress: 297/2372 symbols completed. BLD took 31.9s. Estimated remaining: 4h 31m 6s. Rate: 7.7 symbols/min [2025-09-19T17:38:52.648343] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-19T17:38:52.680256] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:52.730582] [DEBUG] [LOCAL ] BLND: Loaded 49897 existing records from primary storage. [2025-09-19T17:38:52.730776] [INFO ] [MAIN ] BLND: Loaded 49897 existing records. [2025-09-19T17:38:52.908058] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:52.908454] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-19T17:38:52.908719] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-19T17:38:52.909960] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-19T17:38:52.910024] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-19T17:38:53.277178] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:53.306675] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T17:38:53.403260] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T17:38:53.443235] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-19T17:38:53.736735] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T17:38:54.243263] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-19T17:38:54.829871] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T17:38:55.043304] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-19T17:38:55.604925] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T17:38:55.843285] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-19T17:38:56.389859] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T17:38:56.643281] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-19T17:38:57.076755] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T17:38:57.443310] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-19T17:38:58.243249] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-19T17:38:58.476883] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T17:38:58.934042] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T17:38:59.043270] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-19T17:38:59.664455] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T17:38:59.843295] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-19T17:39:00.362228] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:39:00.643321] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-19T17:39:01.281828] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:39:01.443305] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-19T17:39:02.192274] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:39:02.243221] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-19T17:39:03.043306] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-19T17:39:03.843287] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-19T17:39:04.906403] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (3.46 seconds). [2025-09-19T17:39:04.921271] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-19T17:39:04.924327] [INFO ] [REMOTE ] BLDR: Full fetch complete (74130 records). [2025-09-19T17:39:04.924940] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-19T17:39:04.925265] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-19T17:39:05.333724] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-19T17:39:05.333840] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-19T17:39:05.334728] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-19T17:39:05.334795] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-19T17:39:05.336365] [DEBUG] [LOCAL ] BLDR: Trimmed 74130 records to 52400 (keeping 200 days of data) [2025-09-19T17:39:05.655621] [DEBUG] [LOCAL ] BLDR: Primary data saved (52400 records). [2025-09-19T17:39:05.655795] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-19T17:39:05.655898] [INFO ] [MAIN ] Update Progress: 298/2372 symbols completed. BLDR took 35.1s. Estimated remaining: 4h 31m 36s. Rate: 7.6 symbols/min [2025-09-19T17:39:05.830548] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:05.830759] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-19T17:39:05.830808] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-19T17:39:05.830951] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-19T17:39:05.830993] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-19T17:39:05.831033] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-19T17:39:05.831065] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-19T17:39:06.214070] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T17:39:06.212963] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:06.218037] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-19T17:39:06.219114] [INFO ] [REMOTE ] BLE: Full fetch complete (20610 records). [2025-09-19T17:39:06.219250] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-19T17:39:06.539415] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-19T17:39:06.536223] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:06.562121] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (3.52 seconds). [2025-09-19T17:39:06.590168] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-19T17:39:06.575930] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-19T17:39:06.676078] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-19T17:39:06.676158] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-19T17:39:06.676561] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-19T17:39:06.676602] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-19T17:39:06.677190] [DEBUG] [LOCAL ] BLE: Trimmed 20610 records to 14973 (keeping 200 days of data) [2025-09-19T17:39:06.765389] [DEBUG] [LOCAL ] BLE: Primary data saved (14973 records). [2025-09-19T17:39:06.765530] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-19T17:39:06.765629] [INFO ] [MAIN ] Update Progress: 299/2372 symbols completed. BLE took 25.1s. Estimated remaining: 4h 30m 41s. Rate: 7.7 symbols/min [2025-09-19T17:39:06.959163] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:06.975951] [DEBUG] [LOCAL ] BLW: Loaded 13018 existing records from primary storage. [2025-09-19T17:39:06.976080] [INFO ] [MAIN ] BLW: Loaded 13018 existing records. [2025-09-19T17:39:07.049399] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-19T17:39:07.156574] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:07.156880] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-19T17:39:07.156932] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-19T17:39:07.157497] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-19T17:39:07.157557] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-19T17:39:07.506700] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:07.843280] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-19T17:39:08.643297] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-19T17:39:08.820378] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T17:39:08.872181] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:08.872625] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-19T17:39:08.891959] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:39:09.064480] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:39:09.443301] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-19T17:39:10.243279] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-19T17:39:10.459743] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:10.460153] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-19T17:39:10.859047] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T17:39:11.043356] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-19T17:39:11.263929] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:11.264293] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-19T17:39:11.843307] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-19T17:39:12.554555] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:12.555121] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-19T17:39:12.643250] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-19T17:39:13.443275] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-19T17:39:14.176022] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:14.176367] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-19T17:39:14.243234] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-19T17:39:14.497179] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:14.497477] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-19T17:39:15.043283] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-19T17:39:15.082370] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-19T17:39:15.843279] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-19T17:39:16.077321] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T17:39:16.369606] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:16.370048] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-19T17:39:16.643335] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-19T17:39:17.443283] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-19T17:39:18.224459] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:39:18.243253] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-19T17:39:19.043306] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-19T17:39:19.304244] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T17:39:19.843350] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-19T17:39:20.040028] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T17:39:20.069016] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T17:39:20.643302] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-19T17:39:21.443251] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-19T17:39:21.819805] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T17:39:21.935264] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T17:39:22.243267] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-19T17:39:22.989639] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:39:23.043224] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-19T17:39:23.513572] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T17:39:23.843330] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-19T17:39:24.643292] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-19T17:39:24.932246] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:39:25.443297] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-19T17:39:25.640998] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T17:39:26.017188] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T17:39:26.243279] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-19T17:39:27.043292] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-19T17:39:27.256354] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-19T17:39:27.263583] [INFO ] [REMOTE ] BLSH: Full fetch complete (9882 records). [2025-09-19T17:39:27.263792] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-19T17:39:27.264291] [FATAL] [VALIDATOR ] BLSH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:39:27.264377] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:39:27.264423] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:39:27.264502] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-19T17:39:27.264590] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-19T17:39:27.264692] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-19T17:39:27.264791] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-19T17:39:27.264898] [INFO ] [MAIN ] Update Progress: 300/2372 symbols completed. BLSH took 21.6s. Estimated remaining: 4h 32m 1s. Rate: 7.6 symbols/min [2025-09-19T17:39:27.435383] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:27.452725] [DEBUG] [LOCAL ] BLX: Loaded 16165 existing records from primary storage. [2025-09-19T17:39:27.452853] [INFO ] [MAIN ] BLX: Loaded 16165 existing records. [2025-09-19T17:39:27.657790] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:27.658085] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-19T17:39:27.658156] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-19T17:39:27.658764] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-19T17:39:27.658856] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-19T17:39:27.872565] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-19T17:39:28.022190] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:28.275868] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T17:39:28.283330] [INFO ] [REMOTE ] BLND: Full fetch complete (71952 records). [2025-09-19T17:39:28.283507] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-19T17:39:28.284443] [FATAL] [VALIDATOR ] BLND: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:39:28.284545] [FATAL] [MAIN ] BLND: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:39:28.284604] [WARN ] [MAIN ] BLND: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:39:28.284717] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-19T17:39:28.284789] [DEBUG] [LOCAL ] BLND: No primary data file found to delete. [2025-09-19T17:39:28.284825] [INFO ] [LOCAL ] BLND: Starting deletion of derivative data. [2025-09-19T17:39:28.285349] [DEBUG] [LOCAL ] BLND: Deleted derivative data file. [2025-09-19T17:39:28.289423] [INFO ] [MAIN ] Update Progress: 301/2372 symbols completed. BLND took 35.8s. Estimated remaining: 4h 31m 6s. Rate: 7.6 symbols/min [2025-09-19T17:39:28.428004] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:39:28.481212] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:28.522056] [DEBUG] [LOCAL ] BMA: Loaded 34794 existing records from primary storage. [2025-09-19T17:39:28.522239] [INFO ] [MAIN ] BMA: Loaded 34794 existing records. [2025-09-19T17:39:28.648478] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-19T17:39:28.701530] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:28.701754] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-19T17:39:28.701814] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-19T17:39:28.702723] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-19T17:39:28.702783] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-19T17:39:29.052996] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:29.443289] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-19T17:39:29.693882] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:39:30.023588] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T17:39:30.028688] [INFO ] [REMOTE ] BLK: Full fetch complete (53304 records). [2025-09-19T17:39:30.028802] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-19T17:39:30.248517] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-19T17:39:30.409863] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-19T17:39:30.409953] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-19T17:39:30.410563] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-19T17:39:30.410603] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-19T17:39:30.411949] [DEBUG] [LOCAL ] BLK: Trimmed 53304 records to 35876 (keeping 200 days of data) [2025-09-19T17:39:30.624729] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T17:39:30.657586] [DEBUG] [LOCAL ] BLK: Primary data saved (35876 records). [2025-09-19T17:39:30.657763] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-19T17:39:30.657859] [INFO ] [MAIN ] Update Progress: 302/2372 symbols completed. BLK took 44.1s. Estimated remaining: 4h 30m 20s. Rate: 7.7 symbols/min [2025-09-19T17:39:30.824619] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:30.835935] [DEBUG] [LOCAL ] BME: Loaded 10989 existing records from primary storage. [2025-09-19T17:39:30.836070] [INFO ] [MAIN ] BME: Loaded 10989 existing records. [2025-09-19T17:39:31.018099] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:31.018341] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-19T17:39:31.018389] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-19T17:39:31.018960] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-19T17:39:31.019019] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-19T17:39:31.049237] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-19T17:39:31.388044] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:31.843269] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-19T17:39:32.133378] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T17:39:32.168216] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T17:39:32.643311] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-19T17:39:33.091218] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T17:39:33.443241] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-19T17:39:33.777851] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T17:39:33.780835] [INFO ] [REMOTE ] BLW: Full fetch complete (18879 records). [2025-09-19T17:39:33.780942] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-19T17:39:34.147897] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-19T17:39:34.147976] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-19T17:39:34.148325] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-19T17:39:34.148365] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-19T17:39:34.148969] [DEBUG] [LOCAL ] BLW: Trimmed 18879 records to 13093 (keeping 200 days of data) [2025-09-19T17:39:34.236273] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T17:39:34.243331] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-19T17:39:34.246944] [DEBUG] [LOCAL ] BLW: Primary data saved (13093 records). [2025-09-19T17:39:34.247065] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-19T17:39:34.247165] [INFO ] [MAIN ] Update Progress: 303/2372 symbols completed. BLW took 27.5s. Estimated remaining: 4h 29m 43s. Rate: 7.7 symbols/min [2025-09-19T17:39:34.423016] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:34.450612] [DEBUG] [LOCAL ] BMEZ: Loaded 26386 existing records from primary storage. [2025-09-19T17:39:34.450772] [INFO ] [MAIN ] BMEZ: Loaded 26386 existing records. [2025-09-19T17:39:34.626168] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:34.626469] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-19T17:39:34.626526] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-19T17:39:34.627541] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-19T17:39:34.627613] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-19T17:39:34.983614] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:35.043223] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-19T17:39:35.300169] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T17:39:35.843257] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-19T17:39:36.192492] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T17:39:36.643260] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-19T17:39:36.729607] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T17:39:37.443317] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-19T17:39:37.695414] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T17:39:38.243286] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-19T17:39:39.043298] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-19T17:39:39.349422] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:39:39.373237] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T17:39:39.843231] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-19T17:39:40.061096] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T17:39:40.643271] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-19T17:39:41.443249] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-19T17:39:41.551899] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:39:41.624624] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T17:39:42.243307] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-19T17:39:42.347903] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:39:42.792770] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T17:39:43.043281] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-19T17:39:43.843260] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-19T17:39:44.137306] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:39:44.643237] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-19T17:39:45.072638] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T17:39:45.443266] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-19T17:39:45.627256] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T17:39:46.243296] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-19T17:39:46.544032] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T17:39:46.958699] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T17:39:47.043447] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-19T17:39:47.676686] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-19T17:39:47.843296] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-19T17:39:48.600872] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T17:39:48.643274] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-19T17:39:49.443300] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-19T17:39:50.166843] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T17:39:50.169091] [INFO ] [REMOTE ] BME: Full fetch complete (16166 records). [2025-09-19T17:39:50.169201] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-19T17:39:50.247744] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-19T17:39:50.547587] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T17:39:50.588555] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-19T17:39:50.588666] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-19T17:39:50.589046] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-19T17:39:50.589130] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-19T17:39:50.591582] [DEBUG] [LOCAL ] BME: Trimmed 16166 records to 11052 (keeping 200 days of data) [2025-09-19T17:39:50.664972] [DEBUG] [LOCAL ] BME: Primary data saved (11052 records). [2025-09-19T17:39:50.665104] [INFO ] [MAIN ] BME: Full history saved. [2025-09-19T17:39:50.665260] [INFO ] [MAIN ] Update Progress: 304/2372 symbols completed. BME took 20.0s. Estimated remaining: 4h 30m 34s. Rate: 7.6 symbols/min [2025-09-19T17:39:50.853208] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:50.881561] [DEBUG] [LOCAL ] BMI: Loaded 24204 existing records from primary storage. [2025-09-19T17:39:50.881717] [INFO ] [MAIN ] BMI: Loaded 24204 existing records. [2025-09-19T17:39:51.059976] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-19T17:39:51.065923] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:51.067728] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-19T17:39:51.067786] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-19T17:39:51.068576] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-19T17:39:51.068683] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-19T17:39:51.430605] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:51.674939] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:39:51.843260] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-19T17:39:52.643295] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-19T17:39:53.182088] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T17:39:53.443289] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-19T17:39:53.555258] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T17:39:54.076866] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T17:39:54.208692] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T17:39:54.243254] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-19T17:39:55.043289] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-19T17:39:55.843263] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-19T17:39:55.908932] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:39:56.586774] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T17:39:56.604388] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T17:39:56.608368] [INFO ] [REMOTE ] BLX: Full fetch complete (22769 records). [2025-09-19T17:39:56.608457] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-19T17:39:56.648374] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-19T17:39:56.986514] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-19T17:39:56.986591] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-19T17:39:56.986983] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-19T17:39:56.987044] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-19T17:39:56.987670] [DEBUG] [LOCAL ] BLX: Trimmed 22769 records to 16264 (keeping 200 days of data) [2025-09-19T17:39:57.101063] [DEBUG] [LOCAL ] BLX: Primary data saved (16264 records). [2025-09-19T17:39:57.101215] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-19T17:39:57.101303] [INFO ] [MAIN ] Update Progress: 305/2372 symbols completed. BLX took 29.8s. Estimated remaining: 4h 30m 16s. Rate: 7.6 symbols/min [2025-09-19T17:39:57.274457] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:57.279139] [DEBUG] [LOCAL ] BMN: Loaded 2590 existing records from primary storage. [2025-09-19T17:39:57.279221] [INFO ] [MAIN ] BMN: Loaded 2590 existing records. [2025-09-19T17:39:57.452033] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-19T17:39:57.458006] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:57.459204] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-19T17:39:57.459257] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-19T17:39:57.459619] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-19T17:39:57.459726] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-19T17:39:57.827987] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:57.872849] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T17:39:58.243288] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-19T17:39:58.845723] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T17:39:59.043260] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-19T17:39:59.529315] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T17:39:59.594829] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:39:59.843288] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-19T17:40:00.643286] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-19T17:40:01.025186] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T17:40:01.150234] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T17:40:01.443301] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-19T17:40:02.243313] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-19T17:40:02.280215] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T17:40:03.043272] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-19T17:40:03.603849] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T17:40:03.843268] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-19T17:40:04.646735] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-19T17:40:04.648872] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T17:40:05.194935] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T17:40:05.219566] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:40:05.443307] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-19T17:40:06.243313] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-19T17:40:06.994338] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:40:07.043221] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-19T17:40:07.843282] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-19T17:40:08.052876] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T17:40:08.559883] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T17:40:08.643235] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-19T17:40:09.375348] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-19T17:40:09.382060] [INFO ] [REMOTE ] BMA: Full fetch complete (50838 records). [2025-09-19T17:40:09.382235] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-19T17:40:09.448329] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-19T17:40:09.785046] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-19T17:40:09.785252] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-19T17:40:09.785981] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-19T17:40:09.791912] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-19T17:40:09.803813] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T17:40:09.811019] [DEBUG] [LOCAL ] BMA: Trimmed 50838 records to 35145 (keeping 200 days of data) [2025-09-19T17:40:10.046227] [DEBUG] [LOCAL ] BMA: Primary data saved (35145 records). [2025-09-19T17:40:10.046383] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-19T17:40:10.046486] [INFO ] [MAIN ] Update Progress: 306/2372 symbols completed. BMA took 41.8s. Estimated remaining: 4h 30m 43s. Rate: 7.6 symbols/min [2025-09-19T17:40:10.215283] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:10.249953] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-19T17:40:10.268633] [DEBUG] [LOCAL ] BMO: Loaded 41787 existing records from primary storage. [2025-09-19T17:40:10.268814] [INFO ] [MAIN ] BMO: Loaded 41787 existing records. [2025-09-19T17:40:10.449500] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:10.449814] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-19T17:40:10.449864] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-19T17:40:10.451258] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-19T17:40:10.451319] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-19T17:40:10.809420] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:11.043241] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-19T17:40:11.073844] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T17:40:11.199273] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:40:11.843264] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-19T17:40:12.333275] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T17:40:12.643261] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-19T17:40:13.214690] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:40:13.443305] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-19T17:40:14.243312] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-19T17:40:14.490070] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T17:40:14.494168] [INFO ] [REMOTE ] BMEZ: Full fetch complete (41019 records). [2025-09-19T17:40:14.494292] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-19T17:40:14.814228] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T17:40:14.951467] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-19T17:40:14.951681] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-19T17:40:14.952268] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-19T17:40:14.952346] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-19T17:40:14.953994] [DEBUG] [LOCAL ] BMEZ: Trimmed 41019 records to 26566 (keeping 200 days of data) [2025-09-19T17:40:15.045869] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-19T17:40:15.111549] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-19T17:40:15.190487] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26566 records). [2025-09-19T17:40:15.190664] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-19T17:40:15.190795] [INFO ] [MAIN ] Update Progress: 307/2372 symbols completed. BMEZ took 40.9s. Estimated remaining: 4h 30m 17s. Rate: 7.6 symbols/min [2025-09-19T17:40:15.380741] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:15.441963] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-09-19T17:40:15.442145] [INFO ] [MAIN ] BMY: Loaded 54147 existing records. [2025-09-19T17:40:15.639141] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:15.643084] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T17:40:15.643350] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-19T17:40:15.645223] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-19T17:40:15.646972] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-19T17:40:15.647037] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-19T17:40:15.853314] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-19T17:40:16.012332] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:16.643275] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-19T17:40:17.443298] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-19T17:40:17.646522] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:40:17.684667] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T17:40:18.243268] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-19T17:40:18.786556] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-19T17:40:18.787624] [INFO ] [REMOTE ] BMN: Full fetch complete (3720 records). [2025-09-19T17:40:18.787726] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-19T17:40:19.043567] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-19T17:40:19.175554] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-19T17:40:19.175699] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-19T17:40:19.175855] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-19T17:40:19.175946] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-19T17:40:19.176565] [DEBUG] [LOCAL ] BMN: Trimmed 3720 records to 2604 (keeping 200 days of data) [2025-09-19T17:40:19.218833] [DEBUG] [LOCAL ] BMN: Primary data saved (2604 records). [2025-09-19T17:40:19.222400] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-19T17:40:19.222595] [INFO ] [MAIN ] Update Progress: 308/2372 symbols completed. BMN took 22.1s. Estimated remaining: 4h 29m 43s. Rate: 7.7 symbols/min [2025-09-19T17:40:19.298723] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:40:19.426399] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:19.488726] [DEBUG] [LOCAL ] BN: Loaded 53396 existing records from primary storage. [2025-09-19T17:40:19.488894] [INFO ] [MAIN ] BN: Loaded 53396 existing records. [2025-09-19T17:40:19.690258] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:19.690547] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-19T17:40:19.690598] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-19T17:40:19.692054] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-19T17:40:19.692136] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-19T17:40:19.847108] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-19T17:40:20.050733] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:20.643290] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-19T17:40:21.073375] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:40:21.405257] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T17:40:21.443309] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-19T17:40:21.589987] [DEBUG] [REMOTE ] BMI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-19T17:40:21.590318] [WARN ] [REMOTE ] BMI: No data returned for month 2025-09 [2025-09-19T17:40:21.590420] [INFO ] [REMOTE ] BMI: Full fetch complete (29457 records). [2025-09-19T17:40:21.590497] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-19T17:40:21.591334] [FATAL] [VALIDATOR ] BMI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:40:21.591414] [FATAL] [MAIN ] BMI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:40:21.591479] [WARN ] [MAIN ] BMI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:40:21.591547] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-19T17:40:21.591612] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-19T17:40:21.591686] [INFO ] [LOCAL ] BMI: Starting deletion of derivative data. [2025-09-19T17:40:21.592166] [DEBUG] [LOCAL ] BMI: Deleted derivative data file. [2025-09-19T17:40:21.592275] [INFO ] [MAIN ] Update Progress: 309/2372 symbols completed. BMI took 30.9s. Estimated remaining: 4h 28m 59s. Rate: 7.7 symbols/min [2025-09-19T17:40:21.773247] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:21.804733] [DEBUG] [LOCAL ] BNED: Loaded 30247 existing records from primary storage. [2025-09-19T17:40:21.804894] [INFO ] [MAIN ] BNED: Loaded 30247 existing records. [2025-09-19T17:40:21.986452] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:21.986812] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-19T17:40:21.986896] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-19T17:40:21.987627] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-19T17:40:21.987715] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-19T17:40:22.246420] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-19T17:40:22.361772] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:22.453988] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:40:23.043277] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-19T17:40:23.715386] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T17:40:23.843255] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-19T17:40:24.643305] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-19T17:40:25.459997] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-19T17:40:25.464046] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T17:40:25.795977] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:40:26.243292] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-19T17:40:26.686391] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T17:40:26.802998] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:40:27.043305] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-19T17:40:27.843294] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-19T17:40:28.389914] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T17:40:28.483461] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:40:28.643284] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-19T17:40:29.443340] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-19T17:40:29.804211] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-19T17:40:30.015669] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T17:40:30.243283] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-19T17:40:30.360853] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T17:40:31.043261] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-19T17:40:31.314374] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T17:40:31.843279] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-19T17:40:32.643310] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-19T17:40:33.115256] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T17:40:33.191910] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T17:40:33.443263] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-19T17:40:33.876006] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:40:34.243288] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-19T17:40:34.779364] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:40:35.043266] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-19T17:40:35.809245] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T17:40:35.843230] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-19T17:40:36.643270] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-19T17:40:36.920578] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:40:37.443332] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-19T17:40:37.546568] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T17:40:38.153448] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:40:38.160194] [INFO ] [REMOTE ] BMO: Full fetch complete (60008 records). [2025-09-19T17:40:38.160316] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-19T17:40:38.253052] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-19T17:40:38.572362] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-19T17:40:38.572502] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-19T17:40:38.573357] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-19T17:40:38.573429] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-19T17:40:38.575622] [DEBUG] [LOCAL ] BMO: Trimmed 60008 records to 42068 (keeping 200 days of data) [2025-09-19T17:40:38.842297] [DEBUG] [LOCAL ] BMO: Primary data saved (42068 records). [2025-09-19T17:40:38.842420] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-19T17:40:38.843054] [INFO ] [MAIN ] Update Progress: 310/2372 symbols completed. BMO took 28.8s. Estimated remaining: 4h 29m 54s. Rate: 7.6 symbols/min [2025-09-19T17:40:39.024110] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:39.035723] [DEBUG] [LOCAL ] BNH: Loaded 4853 existing records from primary storage. [2025-09-19T17:40:39.035901] [INFO ] [MAIN ] BNH: Loaded 4853 existing records. [2025-09-19T17:40:39.049770] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-19T17:40:39.240699] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:39.252207] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-19T17:40:39.257430] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-19T17:40:39.267373] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-19T17:40:39.270356] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-19T17:40:39.277239] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T17:40:39.653515] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:39.843268] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-19T17:40:40.599849] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T17:40:40.643222] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-19T17:40:40.705219] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T17:40:40.756611] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-19T17:40:41.443266] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-19T17:40:41.768579] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T17:40:42.243267] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-19T17:40:43.043241] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-19T17:40:43.239353] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:40:43.843272] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-19T17:40:44.331030] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T17:40:44.519960] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T17:40:44.643262] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-19T17:40:45.443265] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-19T17:40:46.161131] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T17:40:46.233529] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T17:40:46.244403] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-19T17:40:46.360214] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T17:40:46.725050] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T17:40:47.043275] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-19T17:40:47.843262] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-19T17:40:48.643264] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-19T17:40:49.359047] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T17:40:49.428961] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T17:40:49.433730] [INFO ] [REMOTE ] BNED: Full fetch complete (44385 records). [2025-09-19T17:40:49.433844] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-19T17:40:49.448360] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-19T17:40:49.830149] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-19T17:40:49.830269] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-19T17:40:49.830891] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-19T17:40:49.830962] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-19T17:40:49.833315] [DEBUG] [LOCAL ] BNED: Trimmed 44385 records to 30481 (keeping 200 days of data) [2025-09-19T17:40:50.013762] [DEBUG] [LOCAL ] BNED: Primary data saved (30481 records). [2025-09-19T17:40:50.013899] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-19T17:40:50.013983] [INFO ] [MAIN ] Update Progress: 311/2372 symbols completed. BNED took 28.4s. Estimated remaining: 4h 30m 8s. Rate: 7.6 symbols/min [2025-09-19T17:40:50.186094] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:50.190507] [DEBUG] [LOCAL ] BNJ: Loaded 2643 existing records from primary storage. [2025-09-19T17:40:50.190591] [INFO ] [MAIN ] BNJ: Loaded 2643 existing records. [2025-09-19T17:40:50.253016] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-19T17:40:50.310416] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T17:40:50.385369] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:50.385699] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-19T17:40:50.385856] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-19T17:40:50.386281] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-19T17:40:50.386357] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-19T17:40:50.751918] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:50.796960] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-19T17:40:51.043298] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-19T17:40:51.612788] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-19T17:40:51.843258] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-19T17:40:52.263792] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T17:40:52.643263] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-19T17:40:53.443282] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-19T17:40:53.867789] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-19T17:40:53.904111] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T17:40:54.243308] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-19T17:40:54.616070] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T17:40:54.623844] [INFO ] [REMOTE ] BN: Full fetch complete (76613 records). [2025-09-19T17:40:54.623971] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-19T17:40:55.032217] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-19T17:40:55.032316] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-19T17:40:55.033134] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-19T17:40:55.033205] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-19T17:40:55.034876] [DEBUG] [LOCAL ] BN: Trimmed 76613 records to 53777 (keeping 200 days of data) [2025-09-19T17:40:55.043339] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-19T17:40:55.393560] [DEBUG] [LOCAL ] BN: Primary data saved (53777 records). [2025-09-19T17:40:55.393753] [INFO ] [MAIN ] BN: Full history saved. [2025-09-19T17:40:55.393855] [INFO ] [MAIN ] Update Progress: 312/2372 symbols completed. BN took 36.2s. Estimated remaining: 4h 29m 44s. Rate: 7.6 symbols/min [2025-09-19T17:40:55.578706] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:55.626578] [DEBUG] [LOCAL ] BNL: Loaded 47287 existing records from primary storage. [2025-09-19T17:40:55.626768] [INFO ] [MAIN ] BNL: Loaded 47287 existing records. [2025-09-19T17:40:55.807848] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:55.808158] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-19T17:40:55.808207] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-19T17:40:55.809343] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-19T17:40:55.809403] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-19T17:40:55.853866] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-19T17:40:56.223636] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:56.232161] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:40:56.271158] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T17:40:56.306715] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-19T17:40:56.643269] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-19T17:40:57.377328] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T17:40:57.443322] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-19T17:40:57.854608] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-19T17:40:58.243283] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-19T17:40:59.043309] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-19T17:40:59.498043] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-19T17:40:59.539112] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T17:40:59.843280] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-19T17:41:00.643261] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-19T17:41:01.007015] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-19T17:41:01.443288] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-19T17:41:01.478271] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:41:01.487303] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-19T17:41:01.487491] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-19T17:41:01.890529] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-19T17:41:01.890663] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-19T17:41:01.891515] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-19T17:41:01.891671] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-19T17:41:01.897028] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-19T17:41:01.899675] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54537 (keeping 200 days of data) [2025-09-19T17:41:02.243416] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-19T17:41:02.262311] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-09-19T17:41:02.262538] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-19T17:41:02.262771] [INFO ] [MAIN ] Update Progress: 313/2372 symbols completed. BMY took 47.1s. Estimated remaining: 4h 29m 29s. Rate: 7.6 symbols/min [2025-09-19T17:41:02.457031] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:02.510129] [DEBUG] [LOCAL ] BNS: Loaded 51882 existing records from primary storage. [2025-09-19T17:41:02.510280] [INFO ] [MAIN ] BNS: Loaded 51882 existing records. [2025-09-19T17:41:02.696697] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:02.696945] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-19T17:41:02.696996] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-19T17:41:02.698148] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-19T17:41:02.698212] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-19T17:41:03.004776] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T17:41:03.043761] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-19T17:41:03.084105] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:03.843283] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-19T17:41:04.643264] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-19T17:41:05.160749] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T17:41:05.209162] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T17:41:05.443263] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-19T17:41:05.910447] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-19T17:41:06.243262] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-19T17:41:06.781489] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:41:06.806550] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:41:07.043269] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-19T17:41:07.637243] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:41:07.843297] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-19T17:41:08.643290] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-19T17:41:09.444515] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-19T17:41:09.449923] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T17:41:09.999469] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T17:41:10.243281] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-19T17:41:10.512430] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:41:11.043265] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-19T17:41:11.578456] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-19T17:41:11.579887] [INFO ] [REMOTE ] BNH: Full fetch complete (6794 records). [2025-09-19T17:41:11.579964] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-19T17:41:11.848346] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-19T17:41:11.910309] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:41:12.005963] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-19T17:41:12.006044] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-19T17:41:12.006244] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-19T17:41:12.006295] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-19T17:41:12.006730] [DEBUG] [LOCAL ] BNH: Trimmed 6794 records to 4881 (keeping 200 days of data) [2025-09-19T17:41:12.035566] [DEBUG] [LOCAL ] BNH: Primary data saved (4881 records). [2025-09-19T17:41:12.035706] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-19T17:41:12.035836] [INFO ] [MAIN ] Update Progress: 314/2372 symbols completed. BNH took 33.2s. Estimated remaining: 4h 29m 34s. Rate: 7.6 symbols/min [2025-09-19T17:41:12.208421] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:12.214460] [DEBUG] [LOCAL ] BNT: Loaded 3411 existing records from primary storage. [2025-09-19T17:41:12.214552] [INFO ] [MAIN ] BNT: Loaded 3411 existing records. [2025-09-19T17:41:12.390762] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:12.391021] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-19T17:41:12.391068] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-19T17:41:12.391307] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-19T17:41:12.391366] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-19T17:41:12.648375] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-19T17:41:12.773153] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:13.371622] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T17:41:13.372782] [INFO ] [REMOTE ] BNJ: Full fetch complete (4433 records). [2025-09-19T17:41:13.372860] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-19T17:41:13.450306] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-19T17:41:13.745830] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-19T17:41:13.746002] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-19T17:41:13.746182] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-19T17:41:13.746258] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-19T17:41:13.746939] [DEBUG] [LOCAL ] BNJ: Trimmed 4433 records to 2658 (keeping 200 days of data) [2025-09-19T17:41:13.764515] [DEBUG] [LOCAL ] BNJ: Primary data saved (2658 records). [2025-09-19T17:41:13.764734] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-19T17:41:13.764851] [INFO ] [MAIN ] Update Progress: 315/2372 symbols completed. BNJ took 23.8s. Estimated remaining: 4h 28m 46s. Rate: 7.7 symbols/min [2025-09-19T17:41:13.967706] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:13.966035] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T17:41:13.985335] [DEBUG] [LOCAL ] BNY: Loaded 7463 existing records from primary storage. [2025-09-19T17:41:13.985449] [INFO ] [MAIN ] BNY: Loaded 7463 existing records. [2025-09-19T17:41:14.163054] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:14.163332] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-19T17:41:14.163413] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-19T17:41:14.163833] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-19T17:41:14.163917] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-19T17:41:14.248393] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-19T17:41:14.539632] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:14.801008] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:41:15.043282] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-19T17:41:15.843265] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-19T17:41:16.117177] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T17:41:16.353521] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T17:41:16.643270] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-19T17:41:17.283946] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-19T17:41:17.443309] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-19T17:41:17.658731] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T17:41:18.243312] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-19T17:41:18.767992] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T17:41:19.043248] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-19T17:41:19.097423] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T17:41:19.843297] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-19T17:41:19.882771] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T17:41:20.643291] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-19T17:41:21.218366] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T17:41:21.443284] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-19T17:41:21.750867] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:41:21.935899] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T17:41:22.243331] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-19T17:41:22.643980] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-19T17:41:23.043327] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-19T17:41:23.843286] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-19T17:41:24.440427] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T17:41:24.643267] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-19T17:41:24.695777] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T17:41:25.443278] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-19T17:41:26.181906] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T17:41:26.233844] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T17:41:26.243987] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-19T17:41:26.997073] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T17:41:27.043255] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-19T17:41:27.843299] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-19T17:41:27.997624] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:41:28.527439] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T17:41:28.643260] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-19T17:41:29.202626] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-19T17:41:29.443330] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-19T17:41:30.243304] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-19T17:41:31.043270] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-19T17:41:31.353495] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T17:41:31.822422] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:41:31.829510] [INFO ] [REMOTE ] BNL: Full fetch complete (66586 records). [2025-09-19T17:41:31.829706] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-19T17:41:31.851550] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-19T17:41:31.958205] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T17:41:32.243585] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-19T17:41:32.243691] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-19T17:41:32.244472] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-19T17:41:32.244518] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-19T17:41:32.245882] [DEBUG] [LOCAL ] BNL: Trimmed 66586 records to 47607 (keeping 200 days of data) [2025-09-19T17:41:32.538902] [DEBUG] [LOCAL ] BNL: Primary data saved (47607 records). [2025-09-19T17:41:32.539091] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-19T17:41:32.539240] [INFO ] [MAIN ] Update Progress: 316/2372 symbols completed. BNL took 37.1s. Estimated remaining: 4h 29m 50s. Rate: 7.6 symbols/min [2025-09-19T17:41:32.649307] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-19T17:41:32.721077] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:32.745025] [DEBUG] [LOCAL ] BOC: Loaded 18551 existing records from primary storage. [2025-09-19T17:41:32.745172] [INFO ] [MAIN ] BOC: Loaded 18551 existing records. [2025-09-19T17:41:32.923213] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:32.923470] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-19T17:41:32.923524] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-19T17:41:32.924077] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-19T17:41:32.924139] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-19T17:41:33.296699] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:33.443273] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-19T17:41:33.624348] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T17:41:34.005832] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T17:41:34.243265] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-19T17:41:34.923687] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T17:41:35.043281] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-19T17:41:35.061061] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T17:41:35.843266] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-19T17:41:36.591119] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:41:36.643278] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-19T17:41:37.205120] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T17:41:37.233032] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T17:41:37.234692] [INFO ] [REMOTE ] BNY: Full fetch complete (10602 records). [2025-09-19T17:41:37.234765] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-19T17:41:37.448396] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-19T17:41:37.644581] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-19T17:41:37.644687] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-19T17:41:37.645006] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-19T17:41:37.645086] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-19T17:41:37.645560] [DEBUG] [LOCAL ] BNY: Trimmed 10602 records to 7500 (keeping 200 days of data) [2025-09-19T17:41:37.691961] [DEBUG] [LOCAL ] BNY: Primary data saved (7500 records). [2025-09-19T17:41:37.692135] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-19T17:41:37.692244] [INFO ] [MAIN ] Update Progress: 317/2372 symbols completed. BNY took 23.9s. Estimated remaining: 4h 29m 24s. Rate: 7.6 symbols/min [2025-09-19T17:41:38.243290] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-19T17:41:38.754702] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T17:41:39.043271] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-19T17:41:39.648606] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T17:41:39.672184] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T17:41:39.680378] [INFO ] [REMOTE ] BNS: Full fetch complete (74226 records). [2025-09-19T17:41:39.680568] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-19T17:41:39.844522] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-19T17:41:40.097830] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-19T17:41:40.097921] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-19T17:41:40.098767] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-19T17:41:40.098837] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-19T17:41:40.100509] [DEBUG] [LOCAL ] BNS: Trimmed 74226 records to 52257 (keeping 200 days of data) [2025-09-19T17:41:40.429904] [DEBUG] [LOCAL ] BNS: Primary data saved (52257 records). [2025-09-19T17:41:40.430064] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-19T17:41:40.430250] [INFO ] [MAIN ] Update Progress: 318/2372 symbols completed. BNS took 38.2s. Estimated remaining: 4h 28m 43s. Rate: 7.6 symbols/min [2025-09-19T17:41:40.643297] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-19T17:41:40.708989] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T17:41:40.710457] [INFO ] [REMOTE ] BNT: Full fetch complete (4416 records). [2025-09-19T17:41:40.710542] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-19T17:41:41.106017] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-19T17:41:41.106125] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-19T17:41:41.106307] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-19T17:41:41.106367] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-19T17:41:41.107034] [DEBUG] [LOCAL ] BNT: Trimmed 4416 records to 3487 (keeping 200 days of data) [2025-09-19T17:41:41.135966] [DEBUG] [LOCAL ] BNT: Primary data saved (3487 records). [2025-09-19T17:41:41.136115] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-19T17:41:41.136205] [INFO ] [MAIN ] Update Progress: 319/2372 symbols completed. BNT took 29.1s. Estimated remaining: 4h 27m 49s. Rate: 7.7 symbols/min [2025-09-19T17:41:41.417303] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T17:41:41.443267] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-19T17:41:42.719544] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:41:42.723732] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-19T17:41:44.336978] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T17:41:44.342380] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-19T17:41:45.575179] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T17:41:45.579116] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-19T17:41:46.703458] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T17:41:46.707432] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-19T17:41:47.485978] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T17:41:47.490575] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-19T17:41:48.847543] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T17:41:48.852756] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-19T17:41:50.087598] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T17:41:50.090763] [INFO ] [REMOTE ] BOC: Full fetch complete (25786 records). [2025-09-19T17:41:50.090859] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-19T17:41:50.465959] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-19T17:41:50.466059] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-19T17:41:50.466471] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-19T17:41:50.466539] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-19T17:41:50.467229] [DEBUG] [LOCAL ] BOC: Trimmed 25786 records to 18648 (keeping 200 days of data) [2025-09-19T17:41:50.574179] [DEBUG] [LOCAL ] BOC: Primary data saved (18648 records). [2025-09-19T17:41:50.574328] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-19T17:41:50.574439] [INFO ] [MAIN ] Update Progress: 320/2372 symbols completed. BOC took 18.0s. Estimated remaining: 4h 27m 52s. Rate: 7.7 symbols/min [2025-09-19T17:41:51.310940] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:51.309972] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:51.366469] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:51.362771] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:51.400781] [DEBUG] [LOCAL ] BOE: Loaded 17840 existing records from primary storage. [2025-09-19T17:41:51.404864] [INFO ] [MAIN ] BOE: Loaded 17840 existing records. [2025-09-19T17:41:51.573102] [DEBUG] [LOCAL ] BOND: Loaded 32453 existing records from primary storage. [2025-09-19T17:41:51.590149] [INFO ] [MAIN ] BOND: Loaded 32453 existing records. [2025-09-19T17:41:51.590035] [DEBUG] [LOCAL ] BOH: Loaded 31739 existing records from primary storage. [2025-09-19T17:41:51.618168] [INFO ] [MAIN ] BOH: Loaded 31739 existing records. [2025-09-19T17:41:51.732343] [DEBUG] [LOCAL ] BOOT: Loaded 41664 existing records from primary storage. [2025-09-19T17:41:51.816790] [INFO ] [MAIN ] BOOT: Loaded 41664 existing records. [2025-09-19T17:41:51.907499] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:52.071240] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-19T17:41:52.098590] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-19T17:41:52.148742] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:52.165058] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-19T17:41:52.200198] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-19T17:41:52.216672] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-19T17:41:52.206349] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:52.202688] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-19T17:41:52.256353] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-19T17:41:52.265810] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-19T17:41:52.269788] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-19T17:41:52.279200] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:52.289819] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-19T17:41:52.295283] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-19T17:41:52.300556] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-19T17:41:52.327675] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-19T17:41:52.362916] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-19T17:41:52.409787] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-19T17:41:52.455704] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-19T17:41:53.579164] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:53.573479] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:53.593949] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-19T17:41:53.637006] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-19T17:41:53.710630] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:53.726300] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-19T17:41:53.758424] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:53.758852] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-19T17:41:54.877848] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T17:41:54.883702] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-19T17:41:54.948618] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T17:41:54.955689] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-19T17:41:55.125871] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T17:41:55.131515] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-19T17:41:55.533713] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:41:55.541853] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-19T17:41:55.960317] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T17:41:55.967685] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-19T17:41:56.076000] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T17:41:56.084251] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-19T17:41:56.371168] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:41:56.375982] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-19T17:41:57.091428] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T17:41:57.097509] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-19T17:41:57.154893] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T17:41:57.164247] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-19T17:41:57.592291] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T17:41:57.599386] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-19T17:41:57.611181] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T17:41:58.243248] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-19T17:41:58.325429] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:41:58.452890] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T17:41:58.687521] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T17:41:59.043270] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-19T17:41:59.472164] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:41:59.843271] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-19T17:42:00.184857] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T17:42:00.643259] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-19T17:42:01.443318] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-19T17:42:02.243299] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-19T17:42:02.310136] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T17:42:02.445687] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:42:03.043276] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-19T17:42:03.843284] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-19T17:42:04.198400] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-19T17:42:04.643271] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-19T17:42:05.555992] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (3.31 seconds). [2025-09-19T17:42:05.563608] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-19T17:42:06.048128] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-19T17:42:06.110080] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:42:06.243287] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-19T17:42:06.439116] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T17:42:06.471271] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T17:42:07.043280] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-19T17:42:07.650488] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:42:07.843267] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-19T17:42:08.643270] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-19T17:42:09.054485] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T17:42:09.213258] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:42:09.443275] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-19T17:42:10.051200] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T17:42:10.243305] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-19T17:42:11.050481] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-19T17:42:11.056164] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T17:42:11.741532] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T17:42:11.843237] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-19T17:42:12.643299] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-19T17:42:12.912356] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T17:42:13.102100] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T17:42:13.443268] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-19T17:42:14.243282] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-19T17:42:15.043402] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-19T17:42:15.490839] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T17:42:15.496557] [INFO ] [REMOTE ] BOND: Full fetch complete (46296 records). [2025-09-19T17:42:15.496790] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-19T17:42:15.984964] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-19T17:42:15.985125] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-19T17:42:15.985785] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-19T17:42:16.001783] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-19T17:42:16.006134] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:42:16.013465] [DEBUG] [LOCAL ] BOND: Trimmed 46296 records to 32694 (keeping 200 days of data) [2025-09-19T17:42:16.015262] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-19T17:42:16.238925] [DEBUG] [LOCAL ] BOND: Primary data saved (32694 records). [2025-09-19T17:42:16.239094] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-19T17:42:16.239230] [INFO ] [MAIN ] Update Progress: 321/2372 symbols completed. BOND took 25.6s. Estimated remaining: 4h 29m 38s. Rate: 7.6 symbols/min [2025-09-19T17:42:16.383622] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:42:16.438934] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:16.465251] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (3.82 seconds). [2025-09-19T17:42:16.532398] [DEBUG] [LOCAL ] BORR: Loaded 51586 existing records from primary storage. [2025-09-19T17:42:16.532552] [INFO ] [MAIN ] BORR: Loaded 51586 existing records. [2025-09-19T17:42:16.648356] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-19T17:42:16.721241] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:16.721560] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-19T17:42:16.721612] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-19T17:42:16.723501] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-19T17:42:16.723742] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-19T17:42:17.089379] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:17.443244] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-19T17:42:17.818167] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T17:42:17.824078] [INFO ] [REMOTE ] BOH: Full fetch complete (44755 records). [2025-09-19T17:42:17.824225] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-19T17:42:18.229544] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-19T17:42:18.229693] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-19T17:42:18.230374] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-19T17:42:18.230457] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-19T17:42:18.247169] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-19T17:42:18.256342] [DEBUG] [LOCAL ] BOH: Trimmed 44755 records to 32007 (keeping 200 days of data) [2025-09-19T17:42:18.266028] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T17:42:18.478136] [DEBUG] [LOCAL ] BOH: Primary data saved (32007 records). [2025-09-19T17:42:18.478439] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-19T17:42:18.478564] [INFO ] [MAIN ] Update Progress: 322/2372 symbols completed. BOH took 27.9s. Estimated remaining: 4h 28m 54s. Rate: 7.6 symbols/min [2025-09-19T17:42:18.653197] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:18.680097] [DEBUG] [LOCAL ] BOW: Loaded 23934 existing records from primary storage. [2025-09-19T17:42:18.680248] [INFO ] [MAIN ] BOW: Loaded 23934 existing records. [2025-09-19T17:42:18.861729] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:18.862045] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-19T17:42:18.862133] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-19T17:42:18.863104] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-19T17:42:18.863170] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-19T17:42:19.048851] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-19T17:42:19.262504] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:19.274677] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T17:42:19.278435] [INFO ] [REMOTE ] BOE: Full fetch complete (26771 records). [2025-09-19T17:42:19.278525] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-19T17:42:19.658291] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-19T17:42:19.658411] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-19T17:42:19.659042] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-19T17:42:19.659155] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-19T17:42:19.660327] [DEBUG] [LOCAL ] BOE: Trimmed 26771 records to 17919 (keeping 200 days of data) [2025-09-19T17:42:19.738467] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T17:42:19.814428] [DEBUG] [LOCAL ] BOE: Primary data saved (17919 records). [2025-09-19T17:42:19.814599] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-19T17:42:19.814748] [INFO ] [MAIN ] Update Progress: 323/2372 symbols completed. BOE took 29.2s. Estimated remaining: 4h 28m 5s. Rate: 7.6 symbols/min [2025-09-19T17:42:19.848363] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-19T17:42:19.992812] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:20.059612] [DEBUG] [LOCAL ] BOX: Loaded 50755 existing records from primary storage. [2025-09-19T17:42:20.059782] [INFO ] [MAIN ] BOX: Loaded 50755 existing records. [2025-09-19T17:42:20.239263] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:20.239562] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-19T17:42:20.239609] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-19T17:42:20.240990] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-19T17:42:20.241050] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-19T17:42:20.551501] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:42:20.596285] [INFO ] [REMOTE ] BOOT: Full fetch complete (60394 records). [2025-09-19T17:42:20.615577] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-19T17:42:20.637707] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:20.651022] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-19T17:42:21.082327] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-19T17:42:21.082422] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-19T17:42:21.083153] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-19T17:42:21.083220] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-19T17:42:21.084577] [DEBUG] [LOCAL ] BOOT: Trimmed 60394 records to 41895 (keeping 200 days of data) [2025-09-19T17:42:21.355473] [DEBUG] [LOCAL ] BOOT: Primary data saved (41895 records). [2025-09-19T17:42:21.355900] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-19T17:42:21.356008] [INFO ] [MAIN ] Update Progress: 324/2372 symbols completed. BOOT took 30.8s. Estimated remaining: 4h 27m 17s. Rate: 7.7 symbols/min [2025-09-19T17:42:21.449054] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-19T17:42:21.536125] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:21.551763] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T17:42:21.612684] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-09-19T17:42:21.612868] [INFO ] [MAIN ] BP: Loaded 54101 existing records. [2025-09-19T17:42:21.788886] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:21.789173] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-19T17:42:21.789221] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-19T17:42:21.791125] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-19T17:42:21.791187] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-19T17:42:22.150480] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:22.243275] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-19T17:42:23.043283] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-19T17:42:23.141411] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T17:42:23.610308] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-19T17:42:23.843271] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-19T17:42:24.016445] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T17:42:24.501818] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T17:42:24.643257] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-19T17:42:25.443256] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-19T17:42:25.947460] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T17:42:26.010779] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T17:42:26.243299] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-19T17:42:26.915584] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T17:42:27.043295] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-19T17:42:27.416591] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T17:42:27.843265] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-19T17:42:28.594107] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T17:42:28.643223] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-19T17:42:29.443248] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-19T17:42:30.149401] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-19T17:42:30.243260] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-19T17:42:30.303120] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:42:31.043271] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-19T17:42:31.275164] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T17:42:31.843282] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-19T17:42:32.643252] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-19T17:42:32.761967] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-19T17:42:33.194906] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T17:42:33.265538] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T17:42:33.443267] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-19T17:42:34.243276] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-19T17:42:34.773915] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T17:42:35.043262] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-19T17:42:35.396951] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:42:35.843278] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-19T17:42:35.956527] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T17:42:36.643293] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-19T17:42:37.443306] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-19T17:42:37.656439] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T17:42:37.822418] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-19T17:42:37.959958] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T17:42:38.243276] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-19T17:42:39.043275] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-19T17:42:39.125811] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T17:42:39.494527] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T17:42:39.843300] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-19T17:42:40.643304] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-19T17:42:41.443252] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-19T17:42:41.558040] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-19T17:42:41.880160] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T17:42:42.150917] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T17:42:42.243264] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-19T17:42:43.043261] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-19T17:42:43.614467] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T17:42:43.716412] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T17:42:43.843260] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-19T17:42:44.643292] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-19T17:42:44.869142] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T17:42:44.888773] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T17:42:44.892355] [INFO ] [REMOTE ] BOW: Full fetch complete (30969 records). [2025-09-19T17:42:44.892440] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-19T17:42:44.893007] [FATAL] [VALIDATOR ] BOW: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:42:44.893097] [FATAL] [MAIN ] BOW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:42:44.893196] [WARN ] [MAIN ] BOW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:42:44.893271] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-19T17:42:44.893336] [DEBUG] [LOCAL ] BOW: No primary data file found to delete. [2025-09-19T17:42:44.893373] [INFO ] [LOCAL ] BOW: Starting deletion of derivative data. [2025-09-19T17:42:44.893889] [DEBUG] [LOCAL ] BOW: Deleted derivative data file. [2025-09-19T17:42:44.893985] [INFO ] [MAIN ] Update Progress: 325/2372 symbols completed. BOW took 26.4s. Estimated remaining: 4h 28m 48s. Rate: 7.6 symbols/min [2025-09-19T17:42:45.065858] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:45.066054] [DEBUG] [LOCAL ] BR: No existing data file found in primary storage. [2025-09-19T17:42:45.066091] [WARN ] [MAIN ] BR: No existing data found, performing full refresh instead. [2025-09-19T17:42:45.066236] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-19T17:42:45.066279] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-19T17:42:45.066318] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-09-19T17:42:45.066349] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-19T17:42:45.425761] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:45.443227] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-19T17:42:46.243287] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-19T17:42:46.968877] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T17:42:47.043272] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-19T17:42:47.843284] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-19T17:42:51.678074] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (6.23 seconds). [2025-09-19T17:42:51.685824] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-19T17:42:52.631065] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (6.39 seconds). [2025-09-19T17:42:52.638346] [INFO ] [REMOTE ] BORR: Full fetch complete (74440 records). [2025-09-19T17:42:52.638472] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-19T17:42:52.639319] [FATAL] [VALIDATOR ] BORR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:42:52.639406] [FATAL] [MAIN ] BORR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:42:52.639449] [WARN ] [MAIN ] BORR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:42:52.639487] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-19T17:42:52.639547] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-09-19T17:42:52.639582] [INFO ] [LOCAL ] BORR: Starting deletion of derivative data. [2025-09-19T17:42:52.640028] [DEBUG] [LOCAL ] BORR: Deleted derivative data file. [2025-09-19T17:42:52.640766] [INFO ] [MAIN ] Update Progress: 326/2372 symbols completed. BORR took 36.4s. Estimated remaining: 4h 28m 39s. Rate: 7.6 symbols/min [2025-09-19T17:42:52.815735] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:52.872886] [DEBUG] [LOCAL ] BRBR: Loaded 51577 existing records from primary storage. [2025-09-19T17:42:52.873041] [INFO ] [MAIN ] BRBR: Loaded 51577 existing records. [2025-09-19T17:42:53.056805] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:53.057221] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-19T17:42:53.057360] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-19T17:42:53.058811] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-19T17:42:53.058948] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-19T17:42:53.385349] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (6.34 seconds). [2025-09-19T17:42:53.521588] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:53.522698] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-19T17:42:53.523788] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-19T17:42:53.527269] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (5.68 seconds). [2025-09-19T17:42:53.542919] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-19T17:42:53.573471] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T17:42:53.581243] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-19T17:42:55.233488] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T17:42:55.239869] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-19T17:42:55.577823] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:42:55.587148] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-19T17:42:55.618282] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T17:42:55.630300] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-19T17:42:55.854200] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:42:55.865792] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-19T17:42:56.382060] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T17:42:56.390178] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-19T17:42:57.093831] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:42:57.101471] [INFO ] [REMOTE ] BOX: Full fetch complete (72181 records). [2025-09-19T17:42:57.101592] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-19T17:42:57.510182] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-19T17:42:57.510410] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-19T17:42:57.511451] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-19T17:42:57.511621] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-19T17:42:57.514258] [DEBUG] [LOCAL ] BOX: Trimmed 72181 records to 51127 (keeping 200 days of data) [2025-09-19T17:42:57.632066] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T17:42:57.645715] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-19T17:42:57.680678] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:42:57.692668] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-19T17:42:57.828865] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T17:42:57.845764] [INFO ] [REMOTE ] BP: Full fetch complete (77762 records). [2025-09-19T17:42:57.850224] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-19T17:42:58.174370] [DEBUG] [LOCAL ] BOX: Primary data saved (51127 records). [2025-09-19T17:42:58.207006] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-19T17:42:58.223357] [INFO ] [MAIN ] Update Progress: 327/2372 symbols completed. BOX took 38.4s. Estimated remaining: 4h 28m 17s. Rate: 7.6 symbols/min [2025-09-19T17:42:58.495285] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-19T17:42:58.510724] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-19T17:42:58.514345] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:58.515203] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-19T17:42:58.515286] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-19T17:42:58.517201] [DEBUG] [LOCAL ] BP: Trimmed 77762 records to 54491 (keeping 200 days of data) [2025-09-19T17:42:58.589924] [DEBUG] [LOCAL ] BRC: Loaded 19955 existing records from primary storage. [2025-09-19T17:42:58.598980] [INFO ] [MAIN ] BRC: Loaded 19955 existing records. [2025-09-19T17:42:58.834302] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:58.835075] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-19T17:42:58.835384] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-19T17:42:58.836815] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-19T17:42:58.836887] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-19T17:42:59.224017] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:59.228016] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-19T17:42:59.369202] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T17:42:59.379338] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-19T17:42:59.413269] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T17:42:59.509536] [DEBUG] [LOCAL ] BP: Primary data saved (54491 records). [2025-09-19T17:42:59.510720] [INFO ] [MAIN ] BP: Full history saved. [2025-09-19T17:42:59.510837] [INFO ] [MAIN ] Update Progress: 328/2372 symbols completed. BP took 38.2s. Estimated remaining: 4h 27m 28s. Rate: 7.6 symbols/min [2025-09-19T17:42:59.688906] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:59.731588] [DEBUG] [LOCAL ] BRCC: Loaded 40797 existing records from primary storage. [2025-09-19T17:42:59.731761] [INFO ] [MAIN ] BRCC: Loaded 40797 existing records. [2025-09-19T17:42:59.848493] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-19T17:42:59.913702] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:59.913972] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-19T17:42:59.914031] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-19T17:42:59.915097] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-19T17:42:59.915159] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-19T17:43:00.284481] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:00.301711] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T17:43:00.643278] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-19T17:43:01.114692] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:43:01.388083] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:43:01.443242] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-19T17:43:02.243317] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-19T17:43:02.394526] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:43:03.043238] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-19T17:43:03.396178] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:43:03.621478] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T17:43:03.843271] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-19T17:43:04.271441] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T17:43:04.643262] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-19T17:43:05.443312] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-19T17:43:05.919342] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T17:43:06.027110] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T17:43:06.243264] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-19T17:43:06.396303] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T17:43:07.043312] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-19T17:43:07.843343] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-19T17:43:08.070139] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T17:43:08.273569] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:43:08.643284] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-19T17:43:09.178186] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:43:09.443276] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-19T17:43:10.023578] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:43:10.243303] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-19T17:43:10.983820] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:43:11.043275] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-19T17:43:11.843293] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-19T17:43:12.006634] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:43:12.106548] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T17:43:12.643305] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-19T17:43:13.116845] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T17:43:13.122444] [INFO ] [REMOTE ] BR: Full fetch complete (48850 records). [2025-09-19T17:43:13.122555] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-19T17:43:13.457293] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-19T17:43:13.510378] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-19T17:43:13.510465] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-19T17:43:13.511075] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-19T17:43:13.511143] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-19T17:43:13.512351] [DEBUG] [LOCAL ] BR: Trimmed 48850 records to 35370 (keeping 200 days of data) [2025-09-19T17:43:13.732883] [DEBUG] [LOCAL ] BR: Primary data saved (35370 records). [2025-09-19T17:43:13.733037] [INFO ] [MAIN ] BR: Full history saved. [2025-09-19T17:43:13.733117] [INFO ] [MAIN ] Update Progress: 329/2372 symbols completed. BR took 28.8s. Estimated remaining: 4h 27m 60s. Rate: 7.6 symbols/min [2025-09-19T17:43:13.913639] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:13.913984] [DEBUG] [LOCAL ] BRFS: No existing data file found in primary storage. [2025-09-19T17:43:13.914057] [WARN ] [MAIN ] BRFS: No existing data found, performing full refresh instead. [2025-09-19T17:43:13.914356] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-19T17:43:13.914462] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-19T17:43:13.914583] [DEBUG] [LOCAL ] BRFS: No primary data file found to delete. [2025-09-19T17:43:13.914737] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-19T17:43:14.185552] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T17:43:14.248504] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-19T17:43:14.313973] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:15.043296] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-12. [2025-09-19T17:43:15.494501] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T17:43:15.843290] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-19T17:43:16.308253] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T17:43:16.551839] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T17:43:16.643251] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-19T17:43:17.336500] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T17:43:17.443280] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-01. [2025-09-19T17:43:18.243315] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-19T17:43:18.760510] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T17:43:18.838780] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T17:43:18.927939] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-19T17:43:19.043278] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-19T17:43:19.843292] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-19T17:43:20.643301] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-19T17:43:21.076235] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T17:43:21.093854] [INFO ] [REMOTE ] BRBR: Full fetch complete (71631 records). [2025-09-19T17:43:21.094949] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T17:43:21.095041] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-19T17:43:21.449227] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-19T17:43:21.499040] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-19T17:43:21.499125] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-19T17:43:21.499981] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-19T17:43:21.500049] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-19T17:43:21.501578] [DEBUG] [LOCAL ] BRBR: Trimmed 71631 records to 51940 (keeping 200 days of data) [2025-09-19T17:43:21.814865] [DEBUG] [LOCAL ] BRBR: Primary data saved (51940 records). [2025-09-19T17:43:21.815035] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-19T17:43:21.815722] [INFO ] [MAIN ] Update Progress: 330/2372 symbols completed. BRBR took 29.2s. Estimated remaining: 4h 27m 53s. Rate: 7.6 symbols/min [2025-09-19T17:43:21.987575] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:22.052296] [DEBUG] [LOCAL ] BRO: Loaded 52306 existing records from primary storage. [2025-09-19T17:43:22.052451] [INFO ] [MAIN ] BRO: Loaded 52306 existing records. [2025-09-19T17:43:22.242364] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:43:22.242707] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-19T17:43:22.242776] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-19T17:43:22.243241] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-19T17:43:22.244333] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-19T17:43:22.244408] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-19T17:43:22.633324] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:22.656893] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:43:23.043262] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-19T17:43:23.110137] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T17:43:23.644963] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T17:43:23.648407] [INFO ] [REMOTE ] BRC: Full fetch complete (29193 records). [2025-09-19T17:43:23.648521] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-19T17:43:23.854717] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-19T17:43:24.035171] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-19T17:43:24.035290] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-19T17:43:24.036131] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-19T17:43:24.036212] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-19T17:43:24.037455] [DEBUG] [LOCAL ] BRC: Trimmed 29193 records to 20122 (keeping 200 days of data) [2025-09-19T17:43:24.175051] [DEBUG] [LOCAL ] BRC: Primary data saved (20122 records). [2025-09-19T17:43:24.175188] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-19T17:43:24.175274] [INFO ] [MAIN ] Update Progress: 331/2372 symbols completed. BRC took 25.9s. Estimated remaining: 4h 27m 12s. Rate: 7.6 symbols/min [2025-09-19T17:43:24.371698] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:24.371880] [DEBUG] [LOCAL ] BROS: No existing data file found in primary storage. [2025-09-19T17:43:24.371917] [WARN ] [MAIN ] BROS: No existing data found, performing full refresh instead. [2025-09-19T17:43:24.372202] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-19T17:43:24.372256] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-19T17:43:24.372299] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-19T17:43:24.372332] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-19T17:43:24.647178] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-19T17:43:24.774635] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:24.804758] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T17:43:25.373038] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:43:25.443264] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-19T17:43:26.243273] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-19T17:43:26.547085] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T17:43:26.922055] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T17:43:27.043257] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-19T17:43:27.843323] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-19T17:43:28.146472] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T17:43:28.653709] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-19T17:43:28.659525] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T17:43:29.443276] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-19T17:43:29.667855] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T17:43:30.243233] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-19T17:43:30.856249] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T17:43:30.973095] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T17:43:30.979697] [INFO ] [REMOTE ] BRCC: Full fetch complete (58047 records). [2025-09-19T17:43:30.979804] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-19T17:43:31.048406] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-19T17:43:31.378264] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-19T17:43:31.378346] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-19T17:43:31.379008] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-19T17:43:31.379092] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-19T17:43:31.380523] [DEBUG] [LOCAL ] BRCC: Trimmed 58047 records to 41163 (keeping 200 days of data) [2025-09-19T17:43:31.617171] [DEBUG] [LOCAL ] BRCC: Primary data saved (41163 records). [2025-09-19T17:43:31.617332] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-19T17:43:31.617443] [INFO ] [MAIN ] Update Progress: 332/2372 symbols completed. BRCC took 32.1s. Estimated remaining: 4h 27m 1s. Rate: 7.6 symbols/min [2025-09-19T17:43:31.787616] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:31.787836] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-19T17:43:31.787877] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-19T17:43:31.788019] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-19T17:43:31.788061] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-19T17:43:31.788100] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-19T17:43:31.788132] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-19T17:43:31.855414] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-19T17:43:32.173916] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:32.186755] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:43:32.643267] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-19T17:43:32.808885] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T17:43:32.887326] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:32.887668] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-19T17:43:33.443260] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-19T17:43:33.671334] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:33.671678] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-19T17:43:33.854066] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:43:34.243289] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-19T17:43:35.043268] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-19T17:43:35.843281] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-19T17:43:36.003181] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T17:43:36.086733] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:36.087026] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-19T17:43:36.643226] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-19T17:43:37.287099] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-19T17:43:37.443294] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-19T17:43:38.243277] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-19T17:43:38.466844] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T17:43:38.485756] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:38.486128] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-19T17:43:39.043255] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-19T17:43:39.240981] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T17:43:39.843260] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-19T17:43:40.643270] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-19T17:43:40.880114] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:40.880452] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-19T17:43:41.102097] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:43:41.443231] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-19T17:43:41.530867] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T17:43:42.243277] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-19T17:43:42.470864] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:42.471192] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-19T17:43:43.043262] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-19T17:43:43.552157] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T17:43:43.843231] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-19T17:43:44.643310] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-19T17:43:45.420419] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:43:45.425938] [INFO ] [REMOTE ] BRFS: Full fetch complete (60830 records). [2025-09-19T17:43:45.426058] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-19T17:43:45.448460] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-19T17:43:45.637626] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-19T17:43:45.792923] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:45.804027] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-19T17:43:45.886616] [DEBUG] [VALIDATOR ] BRFS: All expected trading days are present. [2025-09-19T17:43:45.886722] [DEBUG] [VALIDATOR ] BRFS: Primary data validation passed. [2025-09-19T17:43:45.887428] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-19T17:43:45.887493] [DEBUG] [LOCAL ] BRFS: Saving primary data. [2025-09-19T17:43:45.888871] [DEBUG] [LOCAL ] BRFS: Trimmed 60830 records to 41644 (keeping 200 days of data) [2025-09-19T17:43:46.126012] [DEBUG] [LOCAL ] BRFS: Primary data saved (41644 records). [2025-09-19T17:43:46.126145] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-19T17:43:46.126243] [INFO ] [MAIN ] Update Progress: 333/2372 symbols completed. BRFS took 32.4s. Estimated remaining: 4h 27m 34s. Rate: 7.6 symbols/min [2025-09-19T17:43:46.247933] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-19T17:43:46.309036] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:46.309347] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-09-19T17:43:46.309432] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-09-19T17:43:46.309664] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-19T17:43:46.309736] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-19T17:43:46.309828] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-19T17:43:46.309943] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-19T17:43:46.493574] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T17:43:46.758688] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:47.043312] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-19T17:43:47.843296] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-19T17:43:48.632314] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T17:43:48.643450] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-19T17:43:49.310941] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:43:49.453951] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-19T17:43:49.460480] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-19T17:43:50.245190] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-19T17:43:50.249203] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T17:43:51.043300] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-19T17:43:51.557114] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:43:51.755932] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T17:43:51.843231] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-19T17:43:52.433270] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T17:43:52.643252] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-19T17:43:53.443283] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-19T17:43:53.499603] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:43:53.507399] [INFO ] [REMOTE ] BRO: Full fetch complete (74097 records). [2025-09-19T17:43:53.507529] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-19T17:43:53.906203] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-19T17:43:53.906290] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-19T17:43:53.907085] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-19T17:43:53.907151] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-19T17:43:53.908737] [DEBUG] [LOCAL ] BRO: Trimmed 74097 records to 52689 (keeping 200 days of data) [2025-09-19T17:43:54.243248] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-19T17:43:54.286013] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T17:43:54.302432] [DEBUG] [LOCAL ] BRO: Primary data saved (52689 records). [2025-09-19T17:43:54.302614] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-19T17:43:54.302749] [INFO ] [MAIN ] Update Progress: 334/2372 symbols completed. BRO took 32.5s. Estimated remaining: 4h 27m 28s. Rate: 7.6 symbols/min [2025-09-19T17:43:54.484370] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:54.491803] [DEBUG] [LOCAL ] BRT: Loaded 4864 existing records from primary storage. [2025-09-19T17:43:54.491919] [INFO ] [MAIN ] BRT: Loaded 4864 existing records. [2025-09-19T17:43:54.678700] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:43:54.679016] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-19T17:43:54.679064] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-19T17:43:54.679494] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-19T17:43:54.679554] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-19T17:43:55.035465] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:55.052894] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-19T17:43:55.057424] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T17:43:55.065151] [INFO ] [REMOTE ] BRSL: Full fetch complete (20502 records). [2025-09-19T17:43:55.065244] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-19T17:43:55.259472] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 56 unique days, need 200 days [2025-09-19T17:43:55.259880] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:43:55.259952] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:43:55.260020] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-19T17:43:55.260087] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-19T17:43:55.260122] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-19T17:43:55.260177] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-19T17:43:55.260259] [INFO ] [MAIN ] Update Progress: 335/2372 symbols completed. BRSL took 23.6s. Estimated remaining: 4h 26m 38s. Rate: 7.6 symbols/min [2025-09-19T17:43:55.433512] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:55.453522] [DEBUG] [LOCAL ] BRW: Loaded 19407 existing records from primary storage. [2025-09-19T17:43:55.453693] [INFO ] [MAIN ] BRW: Loaded 19407 existing records. [2025-09-19T17:43:55.633486] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:43:55.633826] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-19T17:43:55.633884] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-19T17:43:55.634640] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-19T17:43:55.634737] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-19T17:43:55.853997] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-19T17:43:55.994783] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:56.622143] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T17:43:56.637590] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-19T17:43:56.643202] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-19T17:43:56.679977] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:43:57.403589] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T17:43:57.443289] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-19T17:43:58.243282] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-19T17:43:59.043280] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-19T17:43:59.262319] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T17:43:59.377557] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-19T17:43:59.686691] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T17:43:59.843245] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-19T17:44:00.643284] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-19T17:44:01.381828] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T17:44:01.443262] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-19T17:44:02.243320] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-19T17:44:02.346209] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:44:02.560745] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-19T17:44:02.570171] [INFO ] [REMOTE ] BROS: Full fetch complete (76948 records). [2025-09-19T17:44:02.570394] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-19T17:44:02.977419] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-19T17:44:02.977513] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-19T17:44:02.978321] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-19T17:44:02.978385] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-19T17:44:02.979909] [DEBUG] [LOCAL ] BROS: Trimmed 76948 records to 54061 (keeping 200 days of data) [2025-09-19T17:44:03.064072] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-19T17:44:03.305742] [DEBUG] [LOCAL ] BROS: Primary data saved (54061 records). [2025-09-19T17:44:03.305919] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-19T17:44:03.306044] [INFO ] [MAIN ] Update Progress: 336/2372 symbols completed. BROS took 39.1s. Estimated remaining: 4h 26m 31s. Rate: 7.6 symbols/min [2025-09-19T17:44:03.477410] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:03.529210] [DEBUG] [LOCAL ] BRX: Loaded 52216 existing records from primary storage. [2025-09-19T17:44:03.529385] [INFO ] [MAIN ] BRX: Loaded 52216 existing records. [2025-09-19T17:44:03.726167] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:03.726409] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-19T17:44:03.726455] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-19T17:44:03.727886] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-19T17:44:03.727957] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-19T17:44:03.848431] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-19T17:44:04.123816] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:04.148545] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T17:44:04.390358] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T17:44:04.506053] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:44:04.643245] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-19T17:44:05.377380] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T17:44:05.443250] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-19T17:44:06.184989] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:44:06.243294] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-19T17:44:07.043294] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-19T17:44:07.475349] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T17:44:07.843278] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-19T17:44:07.953089] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T17:44:08.643269] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-19T17:44:08.818516] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T17:44:09.443313] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-19T17:44:10.243290] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-19T17:44:10.568266] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T17:44:10.730872] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:44:11.043276] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-19T17:44:11.645791] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T17:44:11.843280] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-19T17:44:12.650757] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-19T17:44:12.655409] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T17:44:12.915728] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T17:44:13.443273] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-19T17:44:13.944919] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:44:14.014880] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-19T17:44:14.016308] [INFO ] [REMOTE ] BRT: Full fetch complete (6768 records). [2025-09-19T17:44:14.016440] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-19T17:44:14.248458] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-19T17:44:14.399594] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-19T17:44:14.399705] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-19T17:44:14.400014] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-19T17:44:14.400075] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-19T17:44:14.400491] [DEBUG] [LOCAL ] BRT: Trimmed 6768 records to 4924 (keeping 200 days of data) [2025-09-19T17:44:14.431374] [DEBUG] [LOCAL ] BRT: Primary data saved (4924 records). [2025-09-19T17:44:14.431507] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-19T17:44:14.431613] [INFO ] [MAIN ] Update Progress: 337/2372 symbols completed. BRT took 20.1s. Estimated remaining: 4h 26m 43s. Rate: 7.6 symbols/min [2025-09-19T17:44:14.603304] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:14.603533] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-09-19T17:44:14.603589] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-09-19T17:44:14.603758] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-19T17:44:14.603805] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-19T17:44:14.603849] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-09-19T17:44:14.603882] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-19T17:44:14.968254] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:15.043293] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-19T17:44:15.704033] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:44:15.843270] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-19T17:44:16.643226] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-19T17:44:16.794209] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:44:16.982419] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:44:17.443287] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-19T17:44:18.117815] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:44:18.243315] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-19T17:44:18.518841] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T17:44:19.043316] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-19T17:44:19.122706] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T17:44:19.843331] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-19T17:44:20.259990] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T17:44:20.643226] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-19T17:44:21.133945] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:44:21.443231] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-19T17:44:21.757873] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T17:44:22.243267] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-19T17:44:23.043264] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-19T17:44:23.458775] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T17:44:23.843274] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-19T17:44:24.090888] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T17:44:24.095203] [INFO ] [REMOTE ] BRW: Full fetch complete (29503 records). [2025-09-19T17:44:24.095306] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-19T17:44:24.485633] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-19T17:44:24.485758] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-19T17:44:24.486362] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-19T17:44:24.486437] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-19T17:44:24.487418] [DEBUG] [LOCAL ] BRW: Trimmed 29503 records to 19506 (keeping 200 days of data) [2025-09-19T17:44:24.607542] [DEBUG] [LOCAL ] BRW: Primary data saved (19506 records). [2025-09-19T17:44:24.607792] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-19T17:44:24.607952] [INFO ] [MAIN ] Update Progress: 338/2372 symbols completed. BRW took 29.3s. Estimated remaining: 4h 26m 49s. Rate: 7.6 symbols/min [2025-09-19T17:44:24.652094] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-19T17:44:24.788173] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:24.805249] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:44:24.843835] [DEBUG] [LOCAL ] BSBR: Loaded 35306 existing records from primary storage. [2025-09-19T17:44:24.844006] [INFO ] [MAIN ] BSBR: Loaded 35306 existing records. [2025-09-19T17:44:25.026484] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:25.026762] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-19T17:44:25.026818] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-19T17:44:25.027966] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-19T17:44:25.028062] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-19T17:44:25.400229] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:25.443226] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-19T17:44:25.473105] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:44:25.478678] [INFO ] [REMOTE ] BRSP: Full fetch complete (53881 records). [2025-09-19T17:44:25.478791] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-19T17:44:25.864563] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-19T17:44:25.864675] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-19T17:44:25.865311] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-19T17:44:25.865367] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-19T17:44:25.866498] [DEBUG] [LOCAL ] BRSP: Trimmed 53881 records to 37505 (keeping 200 days of data) [2025-09-19T17:44:26.074229] [DEBUG] [LOCAL ] BRSP: Primary data saved (37505 records). [2025-09-19T17:44:26.074377] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-19T17:44:26.074471] [INFO ] [MAIN ] Update Progress: 339/2372 symbols completed. BRSP took 39.9s. Estimated remaining: 4h 26m 3s. Rate: 7.6 symbols/min [2025-09-19T17:44:26.246793] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:26.245683] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-19T17:44:26.259885] [DEBUG] [LOCAL ] BSL: Loaded 8070 existing records from primary storage. [2025-09-19T17:44:26.260135] [INFO ] [MAIN ] BSL: Loaded 8070 existing records. [2025-09-19T17:44:26.450965] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:26.451272] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-19T17:44:26.451330] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-19T17:44:26.451765] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-19T17:44:26.451847] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-19T17:44:26.835665] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:26.869397] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T17:44:27.005691] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T17:44:27.043229] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-19T17:44:27.355260] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T17:44:27.843284] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-19T17:44:28.115698] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T17:44:28.643250] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-19T17:44:29.443294] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-19T17:44:29.639350] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:44:30.210385] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T17:44:30.243214] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-19T17:44:31.043236] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-19T17:44:31.130902] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T17:44:31.826245] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T17:44:31.843207] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-19T17:44:32.643248] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-19T17:44:32.765684] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:44:33.443265] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-19T17:44:33.521713] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T17:44:34.153081] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T17:44:34.243242] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-19T17:44:34.547426] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T17:44:35.043274] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-19T17:44:35.206305] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T17:44:35.843282] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-19T17:44:36.643263] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-19T17:44:36.949000] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T17:44:37.115622] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T17:44:37.443268] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-19T17:44:38.248399] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-19T17:44:38.265410] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:44:39.014099] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T17:44:39.029700] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T17:44:39.043234] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-19T17:44:39.843270] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-19T17:44:40.643313] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-19T17:44:40.767909] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T17:44:40.834471] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T17:44:41.443304] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-19T17:44:42.243292] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-19T17:44:42.600403] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:44:42.988466] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:44:43.043217] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-19T17:44:43.401790] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T17:44:43.843325] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-19T17:44:44.625334] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:44:44.632692] [INFO ] [REMOTE ] BSAC: Full fetch complete (43496 records). [2025-09-19T17:44:44.632816] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-19T17:44:44.648507] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-19T17:44:45.017717] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-19T17:44:45.017856] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-19T17:44:45.018398] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-19T17:44:45.018476] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-19T17:44:45.019845] [DEBUG] [LOCAL ] BSAC: Trimmed 43496 records to 33535 (keeping 200 days of data) [2025-09-19T17:44:45.218231] [DEBUG] [LOCAL ] BSAC: Primary data saved (33535 records). [2025-09-19T17:44:45.218377] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-19T17:44:45.218500] [INFO ] [MAIN ] Update Progress: 340/2372 symbols completed. BSAC took 30.8s. Estimated remaining: 4h 27m 3s. Rate: 7.6 symbols/min [2025-09-19T17:44:45.431074] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:45.443320] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-19T17:44:45.474876] [DEBUG] [LOCAL ] BSM: Loaded 32852 existing records from primary storage. [2025-09-19T17:44:45.475013] [INFO ] [MAIN ] BSM: Loaded 32852 existing records. [2025-09-19T17:44:45.660027] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:45.660506] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-19T17:44:45.660575] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-19T17:44:45.670467] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-19T17:44:45.683540] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-19T17:44:45.737304] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T17:44:46.061719] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:46.243224] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-19T17:44:46.476880] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T17:44:46.798918] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T17:44:46.808016] [INFO ] [REMOTE ] BRX: Full fetch complete (74934 records). [2025-09-19T17:44:46.808143] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-19T17:44:47.054683] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-19T17:44:47.200415] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-19T17:44:47.200504] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-19T17:44:47.201300] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-19T17:44:47.201388] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-19T17:44:47.202981] [DEBUG] [LOCAL ] BRX: Trimmed 74934 records to 52569 (keeping 200 days of data) [2025-09-19T17:44:47.448762] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T17:44:47.560628] [DEBUG] [LOCAL ] BRX: Primary data saved (52569 records). [2025-09-19T17:44:47.560834] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-19T17:44:47.560927] [INFO ] [MAIN ] Update Progress: 341/2372 symbols completed. BRX took 44.3s. Estimated remaining: 4h 26m 22s. Rate: 7.6 symbols/min [2025-09-19T17:44:47.730594] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:47.730812] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-09-19T17:44:47.730855] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-09-19T17:44:47.731001] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-19T17:44:47.731042] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-19T17:44:47.731082] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-19T17:44:47.731113] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-19T17:44:47.848365] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-19T17:44:48.102717] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:48.423552] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:44:48.643304] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-19T17:44:49.449778] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-19T17:44:49.453688] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T17:44:49.727000] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T17:44:50.243269] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-19T17:44:50.366888] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T17:44:51.043267] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-19T17:44:51.843256] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-19T17:44:51.885914] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T17:44:51.891686] [INFO ] [REMOTE ] BSBR: Full fetch complete (50560 records). [2025-09-19T17:44:51.891791] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-19T17:44:52.277526] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-19T17:44:52.277603] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-19T17:44:52.278179] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-19T17:44:52.278243] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-19T17:44:52.280075] [DEBUG] [LOCAL ] BSBR: Trimmed 50560 records to 35603 (keeping 200 days of data) [2025-09-19T17:44:52.396697] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T17:44:52.511405] [DEBUG] [LOCAL ] BSBR: Primary data saved (35603 records). [2025-09-19T17:44:52.511553] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-19T17:44:52.511667] [INFO ] [MAIN ] Update Progress: 342/2372 symbols completed. BSBR took 27.9s. Estimated remaining: 4h 25m 57s. Rate: 7.6 symbols/min [2025-09-19T17:44:52.656297] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-19T17:44:52.690704] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:52.719597] [DEBUG] [LOCAL ] BSTZ: Loaded 25254 existing records from primary storage. [2025-09-19T17:44:52.719783] [INFO ] [MAIN ] BSTZ: Loaded 25254 existing records. [2025-09-19T17:44:52.901145] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:52.901415] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-19T17:44:52.901465] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-19T17:44:52.902539] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-19T17:44:52.902604] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-19T17:44:53.276222] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T17:44:53.299452] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:53.443217] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-19T17:44:53.987742] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:44:54.243312] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-19T17:44:54.423489] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T17:44:54.828900] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:44:55.043275] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-19T17:44:55.767849] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T17:44:55.843270] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-19T17:44:56.643258] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-19T17:44:56.917105] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T17:44:56.918904] [INFO ] [REMOTE ] BSL: Full fetch complete (12552 records). [2025-09-19T17:44:56.918975] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-19T17:44:57.300351] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-19T17:44:57.300463] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-19T17:44:57.300807] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-19T17:44:57.300869] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-19T17:44:57.301349] [DEBUG] [LOCAL ] BSL: Trimmed 12552 records to 8186 (keeping 200 days of data) [2025-09-19T17:44:57.354663] [DEBUG] [LOCAL ] BSL: Primary data saved (8186 records). [2025-09-19T17:44:57.354805] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-19T17:44:57.354906] [INFO ] [MAIN ] Update Progress: 343/2372 symbols completed. BSL took 31.3s. Estimated remaining: 4h 25m 31s. Rate: 7.6 symbols/min [2025-09-19T17:44:57.452775] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-19T17:44:57.529501] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:57.600304] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-09-19T17:44:57.600454] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-09-19T17:44:57.780764] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:57.781028] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-19T17:44:57.781093] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-19T17:44:57.782709] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-19T17:44:57.782773] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-19T17:44:58.165539] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T17:44:58.164387] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:58.243234] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-19T17:44:58.975901] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T17:44:59.043243] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-19T17:44:59.639007] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T17:44:59.843222] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-19T17:44:59.878575] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T17:45:00.643280] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-19T17:45:01.443291] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-19T17:45:02.243388] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-19T17:45:02.297034] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-19T17:45:02.524752] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T17:45:03.043290] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-19T17:45:03.843306] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-19T17:45:03.867509] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-19T17:45:04.643263] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-19T17:45:05.194060] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-09-19T17:45:05.443283] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-19T17:45:06.462851] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T17:45:06.470595] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-19T17:45:06.676739] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T17:45:06.953897] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T17:45:07.043306] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-19T17:45:07.142746] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (4.10 seconds). [2025-09-19T17:45:07.843294] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-19T17:45:08.017345] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T17:45:08.134162] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T17:45:08.643321] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-19T17:45:09.044804] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T17:45:09.443274] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-19T17:45:09.930208] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T17:45:09.938561] [INFO ] [REMOTE ] BSM: Full fetch complete (47701 records). [2025-09-19T17:45:09.938780] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-19T17:45:10.243832] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-19T17:45:10.337376] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-19T17:45:10.337462] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-19T17:45:10.338088] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-19T17:45:10.338162] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-19T17:45:10.339242] [DEBUG] [LOCAL ] BSM: Trimmed 47701 records to 33095 (keeping 200 days of data) [2025-09-19T17:45:10.548877] [DEBUG] [LOCAL ] BSM: Primary data saved (33095 records). [2025-09-19T17:45:10.549019] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-19T17:45:10.549111] [INFO ] [MAIN ] Update Progress: 344/2372 symbols completed. BSM took 25.3s. Estimated remaining: 4h 25m 55s. Rate: 7.6 symbols/min [2025-09-19T17:45:10.739259] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:10.746923] [DEBUG] [LOCAL ] BTA: Loaded 5346 existing records from primary storage. [2025-09-19T17:45:10.747051] [INFO ] [MAIN ] BTA: Loaded 5346 existing records. [2025-09-19T17:45:10.938020] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:10.938549] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-19T17:45:10.938634] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-19T17:45:10.939139] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-19T17:45:10.944369] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-19T17:45:10.998717] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T17:45:11.055525] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-19T17:45:11.328989] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:11.850605] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-19T17:45:11.867992] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T17:45:12.457755] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T17:45:12.643268] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-19T17:45:13.275353] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T17:45:13.443368] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-19T17:45:14.231712] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T17:45:14.243207] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-19T17:45:15.043283] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-19T17:45:15.336694] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T17:45:15.623443] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T17:45:15.843284] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-19T17:45:16.643282] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-19T17:45:17.041862] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T17:45:17.046244] [INFO ] [REMOTE ] BST: Full fetch complete (28602 records). [2025-09-19T17:45:17.046463] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-19T17:45:17.049720] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:45:17.049954] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:45:17.050006] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:45:17.050082] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-19T17:45:17.050357] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-19T17:45:17.050398] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-09-19T17:45:17.050456] [DEBUG] [LOCAL ] BST: No derivative data file found to delete. [2025-09-19T17:45:17.050579] [INFO ] [MAIN ] Update Progress: 345/2372 symbols completed. BST took 29.5s. Estimated remaining: 4h 25m 39s. Rate: 7.6 symbols/min [2025-09-19T17:45:17.245523] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:17.264030] [DEBUG] [LOCAL ] BTCM: Loaded 14279 existing records from primary storage. [2025-09-19T17:45:17.264259] [INFO ] [MAIN ] BTCM: Loaded 14279 existing records. [2025-09-19T17:45:17.452738] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-19T17:45:17.469396] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:17.471673] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-19T17:45:17.471849] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-19T17:45:17.472908] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-19T17:45:17.472985] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-19T17:45:17.922757] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:17.926416] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-09-19T17:45:17.976271] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T17:45:18.243268] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-19T17:45:18.891121] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T17:45:19.043291] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-19T17:45:19.111997] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T17:45:19.843279] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-19T17:45:19.974106] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T17:45:20.643269] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-19T17:45:20.832851] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T17:45:21.443286] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-19T17:45:21.507408] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-19T17:45:22.243274] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-19T17:45:22.909883] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:45:22.914031] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36706 records). [2025-09-19T17:45:22.914166] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-19T17:45:23.048448] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-19T17:45:23.239813] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T17:45:23.311496] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-19T17:45:23.311578] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-19T17:45:23.312109] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-19T17:45:23.312172] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-19T17:45:23.313121] [DEBUG] [LOCAL ] BSTZ: Trimmed 36706 records to 25410 (keeping 200 days of data) [2025-09-19T17:45:23.486094] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25410 records). [2025-09-19T17:45:23.486287] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-19T17:45:23.486391] [INFO ] [MAIN ] Update Progress: 346/2372 symbols completed. BSTZ took 31.0s. Estimated remaining: 4h 25m 22s. Rate: 7.6 symbols/min [2025-09-19T17:45:23.659062] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:23.715387] [DEBUG] [LOCAL ] BTE: Loaded 53147 existing records from primary storage. [2025-09-19T17:45:23.715569] [INFO ] [MAIN ] BTE: Loaded 53147 existing records. [2025-09-19T17:45:23.857190] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-19T17:45:23.899670] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:23.899925] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-19T17:45:23.899988] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-19T17:45:23.901564] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-19T17:45:23.901632] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-19T17:45:24.273424] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:24.287056] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T17:45:24.396208] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:45:24.643260] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-19T17:45:25.443278] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-19T17:45:25.587765] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T17:45:26.243285] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-19T17:45:26.812425] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T17:45:27.043287] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-19T17:45:27.554336] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T17:45:27.843233] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-19T17:45:28.100464] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T17:45:28.643316] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-19T17:45:29.443244] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-19T17:45:29.512985] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T17:45:30.243328] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-19T17:45:30.287180] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T17:45:30.289001] [INFO ] [REMOTE ] BTA: Full fetch complete (9478 records). [2025-09-19T17:45:30.289130] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-19T17:45:30.672741] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-19T17:45:30.673031] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-19T17:45:30.673351] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-19T17:45:30.673452] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-19T17:45:30.674210] [DEBUG] [LOCAL ] BTA: Trimmed 9478 records to 5358 (keeping 200 days of data) [2025-09-19T17:45:30.735095] [DEBUG] [LOCAL ] BTA: Primary data saved (5358 records). [2025-09-19T17:45:30.736848] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T17:45:30.735812] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-19T17:45:30.737007] [INFO ] [MAIN ] Update Progress: 347/2372 symbols completed. BTA took 20.2s. Estimated remaining: 4h 25m 11s. Rate: 7.6 symbols/min [2025-09-19T17:45:30.925131] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:30.981771] [DEBUG] [LOCAL ] BTI: Loaded 53942 existing records from primary storage. [2025-09-19T17:45:30.981919] [INFO ] [MAIN ] BTI: Loaded 53942 existing records. [2025-09-19T17:45:31.048521] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-19T17:45:31.171359] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:31.171637] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-19T17:45:31.171723] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-19T17:45:31.173171] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-19T17:45:31.173232] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-19T17:45:31.547393] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:31.843268] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-19T17:45:32.314666] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T17:45:32.381880] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T17:45:32.643281] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-19T17:45:32.830167] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T17:45:33.133507] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-19T17:45:33.443264] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-19T17:45:34.243262] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-19T17:45:34.398627] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T17:45:35.043261] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-19T17:45:35.843261] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-19T17:45:36.172541] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:45:36.254304] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T17:45:36.643259] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-19T17:45:37.443250] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-19T17:45:37.463401] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T17:45:38.018565] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:45:38.243260] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-19T17:45:39.043270] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-19T17:45:39.815037] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T17:45:39.843214] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-19T17:45:40.340685] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:45:40.643235] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-19T17:45:40.679425] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T17:45:41.443314] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-19T17:45:41.606120] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:45:42.243235] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-19T17:45:42.567727] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T17:45:42.982790] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T17:45:43.043222] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-19T17:45:43.843281] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-19T17:45:44.353044] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T17:45:44.643232] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-19T17:45:45.322736] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-19T17:45:45.330934] [INFO ] [REMOTE ] BSX: Full fetch complete (77675 records). [2025-09-19T17:45:45.331087] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-19T17:45:45.444790] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-19T17:45:45.776309] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-19T17:45:45.776450] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-19T17:45:45.777571] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-19T17:45:45.777719] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-19T17:45:45.796518] [DEBUG] [LOCAL ] BSX: Trimmed 77675 records to 54468 (keeping 200 days of data) [2025-09-19T17:45:45.815983] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T17:45:46.172117] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-09-19T17:45:46.172330] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-19T17:45:46.172592] [INFO ] [MAIN ] Update Progress: 348/2372 symbols completed. BSX took 48.8s. Estimated remaining: 4h 25m 47s. Rate: 7.6 symbols/min [2025-09-19T17:45:46.248432] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-19T17:45:46.348027] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:46.358783] [DEBUG] [LOCAL ] BTO: Loaded 9115 existing records from primary storage. [2025-09-19T17:45:46.359430] [INFO ] [MAIN ] BTO: Loaded 9115 existing records. [2025-09-19T17:45:46.534074] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:46.534370] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-19T17:45:46.534420] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-19T17:45:46.534844] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-19T17:45:46.534906] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-19T17:45:46.889491] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:45:46.912463] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:46.917261] [INFO ] [REMOTE ] BTCM: Full fetch complete (19491 records). [2025-09-19T17:45:46.917521] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-19T17:45:47.043547] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-19T17:45:47.372525] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-19T17:45:47.394820] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-19T17:45:47.395249] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-19T17:45:47.395840] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-19T17:45:47.395920] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-19T17:45:47.397007] [DEBUG] [LOCAL ] BTCM: Trimmed 19491 records to 14565 (keeping 200 days of data) [2025-09-19T17:45:47.479495] [DEBUG] [LOCAL ] BTCM: Primary data saved (14565 records). [2025-09-19T17:45:47.479681] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-19T17:45:47.479791] [INFO ] [MAIN ] Update Progress: 349/2372 symbols completed. BTCM took 30.4s. Estimated remaining: 4h 25m 1s. Rate: 7.6 symbols/min [2025-09-19T17:45:47.654680] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:47.671810] [DEBUG] [LOCAL ] BTT: Loaded 16236 existing records from primary storage. [2025-09-19T17:45:47.671947] [INFO ] [MAIN ] BTT: Loaded 16236 existing records. [2025-09-19T17:45:47.844633] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-19T17:45:47.848503] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:47.849806] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-19T17:45:47.849880] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-19T17:45:47.850439] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-19T17:45:47.850502] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-19T17:45:48.202715] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:48.211341] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T17:45:48.273486] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:45:48.643272] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-19T17:45:49.443294] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-19T17:45:49.622147] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T17:45:50.243271] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-19T17:45:50.440020] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T17:45:50.550884] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-19T17:45:51.043351] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-19T17:45:51.198633] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T17:45:51.843297] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-19T17:45:52.214174] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T17:45:52.643278] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-19T17:45:53.443291] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-19T17:45:53.998722] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T17:45:54.138313] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T17:45:54.243291] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-19T17:45:55.008321] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-19T17:45:55.027828] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T17:45:55.043224] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-19T17:45:55.843295] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-19T17:45:56.643282] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-19T17:45:56.725237] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T17:45:57.443272] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-19T17:45:57.694247] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T17:45:57.882537] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T17:45:58.204733] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:45:58.243267] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-19T17:45:59.043310] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-19T17:45:59.843292] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-19T17:46:00.034757] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T17:46:00.239992] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T17:46:00.643321] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-19T17:46:00.686906] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T17:46:01.443334] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-19T17:46:01.627724] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T17:46:02.243296] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-19T17:46:02.588451] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T17:46:03.043274] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-19T17:46:03.843269] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-19T17:46:04.026824] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T17:46:04.388560] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T17:46:04.643271] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-19T17:46:05.304348] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:46:05.443268] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-19T17:46:06.243340] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-19T17:46:06.818553] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T17:46:06.956017] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:46:07.043327] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-19T17:46:07.098925] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:46:07.111218] [INFO ] [REMOTE ] BTE: Full fetch complete (75982 records). [2025-09-19T17:46:07.111425] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-19T17:46:07.573736] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-19T17:46:07.573866] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-19T17:46:07.574785] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-19T17:46:07.574856] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-19T17:46:07.576516] [DEBUG] [LOCAL ] BTE: Trimmed 75982 records to 53527 (keeping 200 days of data) [2025-09-19T17:46:07.864595] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-19T17:46:07.919760] [DEBUG] [LOCAL ] BTE: Primary data saved (53527 records). [2025-09-19T17:46:07.919978] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-19T17:46:07.920098] [INFO ] [MAIN ] Update Progress: 350/2372 symbols completed. BTE took 44.4s. Estimated remaining: 4h 26m 6s. Rate: 7.6 symbols/min [2025-09-19T17:46:08.102387] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:08.159099] [DEBUG] [LOCAL ] BTU: Loaded 53692 existing records from primary storage. [2025-09-19T17:46:08.159329] [INFO ] [MAIN ] BTU: Loaded 53692 existing records. [2025-09-19T17:46:08.340149] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:08.340450] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-19T17:46:08.340498] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-19T17:46:08.341782] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-19T17:46:08.341843] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-19T17:46:08.648401] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-19T17:46:08.702168] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:09.146759] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T17:46:09.443279] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-19T17:46:09.494847] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T17:46:09.496826] [INFO ] [REMOTE ] BTO: Full fetch complete (13383 records). [2025-09-19T17:46:09.496912] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-19T17:46:09.893972] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-19T17:46:09.894360] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-19T17:46:09.894798] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-19T17:46:09.901972] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-19T17:46:09.916985] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-09-19T17:46:09.917115] [DEBUG] [LOCAL ] BTO: Trimmed 13383 records to 9175 (keeping 200 days of data) [2025-09-19T17:46:09.957875] [INFO ] [REMOTE ] BTI: Full fetch complete (77425 records). [2025-09-19T17:46:09.970615] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-19T17:46:10.253554] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-19T17:46:10.366021] [DEBUG] [LOCAL ] BTO: Primary data saved (9175 records). [2025-09-19T17:46:10.377155] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-19T17:46:10.396873] [INFO ] [MAIN ] Update Progress: 351/2372 symbols completed. BTO took 24.2s. Estimated remaining: 4h 25m 27s. Rate: 7.6 symbols/min [2025-09-19T17:46:10.448965] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-19T17:46:10.487008] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-19T17:46:10.509686] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-19T17:46:10.520453] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-19T17:46:10.575284] [DEBUG] [LOCAL ] BTI: Trimmed 77425 records to 54332 (keeping 200 days of data) [2025-09-19T17:46:10.594737] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:10.595166] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-19T17:46:10.595223] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-19T17:46:10.595678] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-19T17:46:10.595746] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-19T17:46:10.595795] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-19T17:46:10.595829] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-19T17:46:11.077138] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:11.078570] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-19T17:46:11.314533] [DEBUG] [LOCAL ] BTI: Primary data saved (54332 records). [2025-09-19T17:46:11.314712] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-19T17:46:11.314813] [INFO ] [MAIN ] Update Progress: 352/2372 symbols completed. BTI took 40.6s. Estimated remaining: 4h 24m 39s. Rate: 7.6 symbols/min [2025-09-19T17:46:11.463738] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:46:11.492397] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-19T17:46:11.492180] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:11.525401] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T17:46:11.554759] [DEBUG] [LOCAL ] BTZ: Loaded 23255 existing records from primary storage. [2025-09-19T17:46:11.554948] [INFO ] [MAIN ] BTZ: Loaded 23255 existing records. [2025-09-19T17:46:11.727786] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T17:46:11.749914] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:11.753509] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-19T17:46:11.753704] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-19T17:46:11.754583] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-19T17:46:11.754685] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-19T17:46:11.848327] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-19T17:46:12.128485] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:12.643265] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-19T17:46:12.889291] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:46:12.889610] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-19T17:46:13.080052] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T17:46:13.084520] [INFO ] [REMOTE ] BTT: Full fetch complete (24461 records). [2025-09-19T17:46:13.084633] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-19T17:46:13.447622] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-19T17:46:13.483887] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-19T17:46:13.483973] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-19T17:46:13.484387] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-19T17:46:13.484570] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-19T17:46:13.485524] [DEBUG] [LOCAL ] BTT: Trimmed 24461 records to 16323 (keeping 200 days of data) [2025-09-19T17:46:13.597536] [DEBUG] [LOCAL ] BTT: Primary data saved (16323 records). [2025-09-19T17:46:13.597723] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-19T17:46:13.597882] [INFO ] [MAIN ] Update Progress: 353/2372 symbols completed. BTT took 26.1s. Estimated remaining: 4h 23m 59s. Rate: 7.6 symbols/min [2025-09-19T17:46:13.781899] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:13.837393] [DEBUG] [LOCAL ] BUD: Loaded 53148 existing records from primary storage. [2025-09-19T17:46:13.837600] [INFO ] [MAIN ] BUD: Loaded 53148 existing records. [2025-09-19T17:46:14.020702] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:14.021019] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-19T17:46:14.021116] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-19T17:46:14.022373] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-19T17:46:14.022439] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-19T17:46:14.251183] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-19T17:46:14.399116] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:15.043297] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-19T17:46:15.570442] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T17:46:15.710290] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T17:46:15.776973] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T17:46:15.843298] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-19T17:46:16.643252] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-19T17:46:17.443263] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-19T17:46:18.122987] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T17:46:18.243248] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-19T17:46:18.461179] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:46:19.043275] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-19T17:46:19.123700] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T17:46:19.842582] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T17:46:19.847405] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-19T17:46:20.643254] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-19T17:46:20.708764] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T17:46:21.390780] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:46:21.443292] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-19T17:46:21.671513] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T17:46:22.243281] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-19T17:46:23.043270] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-19T17:46:23.370597] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T17:46:23.843239] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-19T17:46:23.966364] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-19T17:46:24.297396] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T17:46:24.643290] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-19T17:46:25.443313] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-19T17:46:26.062344] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-19T17:46:26.241839] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T17:46:26.245957] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-19T17:46:26.892454] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T17:46:27.043280] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-19T17:46:27.458516] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T17:46:27.843263] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-19T17:46:28.643271] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-19T17:46:29.076962] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T17:46:29.443273] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-19T17:46:29.639989] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T17:46:30.254977] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-19T17:46:30.260893] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-19T17:46:31.043244] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-19T17:46:31.113240] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:46:31.376630] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T17:46:31.843264] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-19T17:46:32.154638] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T17:46:32.643265] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-19T17:46:32.668684] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T17:46:33.443268] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-19T17:46:34.243279] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-19T17:46:34.295902] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T17:46:34.317954] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T17:46:35.043272] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-19T17:46:35.843274] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-19T17:46:36.101997] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T17:46:36.639862] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T17:46:36.644278] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-19T17:46:36.646288] [INFO ] [REMOTE ] BTX: Full fetch complete (35060 records). [2025-09-19T17:46:36.646451] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-19T17:46:36.851832] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 147 unique days, need 200 days [2025-09-19T17:46:36.859770] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:46:36.872517] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:46:36.874166] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T17:46:36.873147] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-19T17:46:36.881931] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-19T17:46:36.882005] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-19T17:46:36.882081] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-19T17:46:36.882197] [INFO ] [MAIN ] Update Progress: 354/2372 symbols completed. BTX took 26.5s. Estimated remaining: 4h 25m 20s. Rate: 7.6 symbols/min [2025-09-19T17:46:37.056432] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:37.070191] [DEBUG] [LOCAL ] BUI: Loaded 11572 existing records from primary storage. [2025-09-19T17:46:37.070313] [INFO ] [MAIN ] BUI: Loaded 11572 existing records. [2025-09-19T17:46:37.252957] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:37.253247] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-19T17:46:37.253309] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-19T17:46:37.253889] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-19T17:46:37.253986] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-19T17:46:37.448354] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-19T17:46:37.623925] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:38.243253] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-19T17:46:38.892577] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T17:46:39.083310] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-19T17:46:39.106421] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T17:46:39.350088] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T17:46:39.843267] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-19T17:46:40.518584] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:46:40.522716] [INFO ] [REMOTE ] BTZ: Full fetch complete (33952 records). [2025-09-19T17:46:40.522821] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-19T17:46:40.648451] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-19T17:46:40.921026] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-19T17:46:40.921126] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-19T17:46:40.921682] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-19T17:46:40.921783] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-19T17:46:40.930567] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:46:40.934209] [DEBUG] [LOCAL ] BTZ: Trimmed 33952 records to 23355 (keeping 200 days of data) [2025-09-19T17:46:41.078762] [DEBUG] [LOCAL ] BTZ: Primary data saved (23355 records). [2025-09-19T17:46:41.078904] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-19T17:46:41.079008] [INFO ] [MAIN ] Update Progress: 355/2372 symbols completed. BTZ took 29.8s. Estimated remaining: 4h 24m 51s. Rate: 7.6 symbols/min [2025-09-19T17:46:41.250738] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:41.300502] [DEBUG] [LOCAL ] BUR: Loaded 45435 existing records from primary storage. [2025-09-19T17:46:41.300699] [INFO ] [MAIN ] BUR: Loaded 45435 existing records. [2025-09-19T17:46:41.448420] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-19T17:46:41.496087] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:41.496432] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-19T17:46:41.496504] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-19T17:46:41.497482] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-19T17:46:41.497568] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-19T17:46:41.864714] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:42.243226] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-19T17:46:42.918526] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T17:46:42.931470] [INFO ] [REMOTE ] BTU: Full fetch complete (76827 records). [2025-09-19T17:46:42.931636] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-19T17:46:43.048314] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-19T17:46:43.359036] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-19T17:46:43.359129] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-19T17:46:43.359942] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-19T17:46:43.360009] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-19T17:46:43.362042] [DEBUG] [LOCAL ] BTU: Trimmed 76827 records to 54082 (keeping 200 days of data) [2025-09-19T17:46:43.750306] [DEBUG] [LOCAL ] BTU: Primary data saved (54082 records). [2025-09-19T17:46:43.751750] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-19T17:46:43.751871] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-19T17:46:43.761984] [INFO ] [MAIN ] Update Progress: 356/2372 symbols completed. BTU took 35.8s. Estimated remaining: 4h 24m 13s. Rate: 7.6 symbols/min [2025-09-19T17:46:43.856432] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-19T17:46:43.943009] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:43.994442] [DEBUG] [LOCAL ] BURL: Loaded 46881 existing records from primary storage. [2025-09-19T17:46:43.994755] [INFO ] [MAIN ] BURL: Loaded 46881 existing records. [2025-09-19T17:46:44.185967] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:44.194278] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T17:46:44.194418] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-19T17:46:44.197127] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-19T17:46:44.205638] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-19T17:46:44.219477] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-19T17:46:44.252828] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:46:44.587508] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:44.643235] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-19T17:46:45.443310] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-19T17:46:45.583232] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T17:46:45.934883] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T17:46:46.243305] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-19T17:46:46.784079] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-19T17:46:47.043266] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-19T17:46:47.197725] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T17:46:47.622799] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T17:46:47.843260] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-19T17:46:48.643254] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-19T17:46:49.443300] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-19T17:46:49.725249] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T17:46:50.243247] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-19T17:46:50.309396] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T17:46:51.043263] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-19T17:46:51.451082] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:46:51.761251] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:46:51.843238] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-19T17:46:52.643220] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-19T17:46:52.684428] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T17:46:53.117859] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:46:53.443267] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-19T17:46:54.243269] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-19T17:46:54.399563] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T17:46:54.402678] [INFO ] [REMOTE ] BUI: Full fetch complete (16158 records). [2025-09-19T17:46:54.402878] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-19T17:46:54.562134] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T17:46:54.818537] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-19T17:46:54.818620] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-19T17:46:54.819010] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-19T17:46:54.819086] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-19T17:46:54.819963] [DEBUG] [LOCAL ] BUI: Trimmed 16158 records to 11660 (keeping 200 days of data) [2025-09-19T17:46:54.898341] [DEBUG] [LOCAL ] BUI: Primary data saved (11660 records). [2025-09-19T17:46:54.898505] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-19T17:46:54.898675] [INFO ] [MAIN ] Update Progress: 357/2372 symbols completed. BUI took 18.0s. Estimated remaining: 4h 24m 24s. Rate: 7.6 symbols/min [2025-09-19T17:46:55.043263] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-19T17:46:55.843241] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-19T17:46:56.489851] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T17:46:56.497740] [INFO ] [REMOTE ] BUD: Full fetch complete (76490 records). [2025-09-19T17:46:56.497872] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-19T17:46:56.897907] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-19T17:46:56.898108] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-19T17:46:56.899129] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-19T17:46:56.899227] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-19T17:46:56.901192] [DEBUG] [LOCAL ] BUD: Trimmed 76490 records to 53535 (keeping 200 days of data) [2025-09-19T17:46:56.925602] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T17:46:56.934368] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-19T17:46:57.271439] [DEBUG] [LOCAL ] BUD: Primary data saved (53535 records). [2025-09-19T17:46:57.271867] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-19T17:46:57.272046] [INFO ] [MAIN ] Update Progress: 358/2372 symbols completed. BUD took 43.7s. Estimated remaining: 4h 23m 45s. Rate: 7.6 symbols/min [2025-09-19T17:46:57.792549] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T17:46:57.803153] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-19T17:46:59.003496] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T17:46:59.015187] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-19T17:46:59.696504] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T17:46:59.712495] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-19T17:47:01.024923] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:47:01.035403] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-19T17:47:03.035170] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (3.32 seconds). [2025-09-19T17:47:03.044555] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-19T17:47:03.179760] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T17:47:03.189961] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-19T17:47:04.380832] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T17:47:04.391300] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-19T17:47:04.940995] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T17:47:04.950945] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-19T17:47:06.150504] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:47:06.160738] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-19T17:47:06.381579] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T17:47:06.392637] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-19T17:47:07.637758] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T17:47:07.648288] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-19T17:47:08.443840] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T17:47:08.453736] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-19T17:47:09.652221] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T17:47:09.659505] [INFO ] [REMOTE ] BURL: Full fetch complete (65708 records). [2025-09-19T17:47:09.659802] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-19T17:47:10.047761] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-19T17:47:10.047856] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-19T17:47:10.048560] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-19T17:47:10.048605] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-19T17:47:10.049989] [DEBUG] [LOCAL ] BURL: Trimmed 65708 records to 47179 (keeping 200 days of data) [2025-09-19T17:47:10.342034] [DEBUG] [LOCAL ] BURL: Primary data saved (47179 records). [2025-09-19T17:47:10.342494] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-19T17:47:10.342613] [INFO ] [MAIN ] Update Progress: 359/2372 symbols completed. BURL took 26.6s. Estimated remaining: 4h 24m 7s. Rate: 7.6 symbols/min [2025-09-19T17:47:10.395730] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T17:47:10.402602] [INFO ] [REMOTE ] BUR: Full fetch complete (63192 records). [2025-09-19T17:47:10.402749] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-19T17:47:10.788833] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-19T17:47:10.788922] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-19T17:47:10.789597] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-19T17:47:10.789637] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-19T17:47:10.790928] [DEBUG] [LOCAL ] BUR: Trimmed 63192 records to 45780 (keeping 200 days of data) [2025-09-19T17:47:11.075252] [DEBUG] [LOCAL ] BUR: Primary data saved (45780 records). [2025-09-19T17:47:11.075408] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-19T17:47:11.076559] [INFO ] [MAIN ] Update Progress: 360/2372 symbols completed. BUR took 30.0s. Estimated remaining: 4h 23m 19s. Rate: 7.6 symbols/min [2025-09-19T17:47:11.744553] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:11.743638] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:11.822344] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:11.841750] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:11.860051] [DEBUG] [LOCAL ] BUXX: Loaded 15320 existing records from primary storage. [2025-09-19T17:47:11.860353] [INFO ] [MAIN ] BUXX: Loaded 15320 existing records. [2025-09-19T17:47:12.119849] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:12.131921] [DEBUG] [LOCAL ] BV: Loaded 38955 existing records from primary storage. [2025-09-19T17:47:12.132132] [INFO ] [MAIN ] BV: Loaded 38955 existing records. [2025-09-19T17:47:12.154007] [DEBUG] [LOCAL ] BW: Loaded 39797 existing records from primary storage. [2025-09-19T17:47:12.154163] [INFO ] [MAIN ] BW: Loaded 39797 existing records. [2025-09-19T17:47:12.132333] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-19T17:47:12.154825] [DEBUG] [LOCAL ] BVN: Loaded 43859 existing records from primary storage. [2025-09-19T17:47:12.169363] [INFO ] [MAIN ] BVN: Loaded 43859 existing records. [2025-09-19T17:47:12.169285] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-19T17:47:12.249282] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-19T17:47:12.282991] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-19T17:47:12.717846] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:12.800913] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:12.926414] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-19T17:47:12.926165] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:12.891913] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-19T17:47:12.931970] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-19T17:47:12.931879] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-19T17:47:12.958371] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-19T17:47:12.946500] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-19T17:47:12.963677] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-19T17:47:12.972199] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-19T17:47:12.997456] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-19T17:47:12.991434] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-19T17:47:13.002743] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-19T17:47:13.008992] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-19T17:47:13.457149] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:13.522461] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-19T17:47:14.067930] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:14.099404] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-19T17:47:14.201324] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:14.217186] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-19T17:47:14.223920] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:14.225074] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-19T17:47:14.453915] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T17:47:14.456955] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-19T17:47:15.381945] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T17:47:15.385026] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-19T17:47:15.783230] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:47:15.795229] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-19T17:47:15.852497] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T17:47:15.859258] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-19T17:47:15.967123] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T17:47:15.970576] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-19T17:47:16.000817] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T17:47:16.010268] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-19T17:47:16.837409] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T17:47:16.841101] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-19T17:47:16.858382] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T17:47:16.865158] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-19T17:47:16.976481] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:47:16.985816] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-19T17:47:17.282978] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T17:47:17.443270] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-19T17:47:17.519298] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T17:47:18.243270] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-19T17:47:18.624161] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:47:18.684351] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T17:47:18.801038] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:47:18.875946] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T17:47:19.043263] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-19T17:47:19.843285] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-19T17:47:20.257355] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T17:47:20.643263] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-19T17:47:21.408739] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:47:21.443247] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-19T17:47:21.846810] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T17:47:22.243269] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-19T17:47:22.617728] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T17:47:23.043254] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-19T17:47:23.644151] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T17:47:23.843292] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-19T17:47:24.643293] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-19T17:47:24.870577] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T17:47:24.982283] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-19T17:47:25.443309] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-19T17:47:26.243314] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-19T17:47:26.598975] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T17:47:26.601690] [INFO ] [REMOTE ] BUXX: Full fetch complete (20284 records). [2025-09-19T17:47:26.601810] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-19T17:47:27.022765] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-19T17:47:27.023479] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-19T17:47:27.025358] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-19T17:47:27.024673] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T17:47:27.025493] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-19T17:47:27.035624] [DEBUG] [LOCAL ] BUXX: Trimmed 20284 records to 15425 (keeping 200 days of data) [2025-09-19T17:47:27.085480] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-19T17:47:27.142955] [DEBUG] [LOCAL ] BUXX: Primary data saved (15425 records). [2025-09-19T17:47:27.143136] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-19T17:47:27.143234] [INFO ] [MAIN ] Update Progress: 361/2372 symbols completed. BUXX took 16.1s. Estimated remaining: 4h 23m 57s. Rate: 7.6 symbols/min [2025-09-19T17:47:27.325262] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:27.380513] [DEBUG] [LOCAL ] BWA: Loaded 52658 existing records from primary storage. [2025-09-19T17:47:27.380699] [INFO ] [MAIN ] BWA: Loaded 52658 existing records. [2025-09-19T17:47:27.573540] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:27.573841] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-19T17:47:27.573904] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-19T17:47:27.575579] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-19T17:47:27.575662] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-19T17:47:27.844484] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-19T17:47:27.937570] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:27.961896] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:47:28.277818] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:47:28.643284] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-19T17:47:29.443265] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-19T17:47:29.684543] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T17:47:30.243256] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-19T17:47:30.696055] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T17:47:31.043281] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-19T17:47:31.209619] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T17:47:31.843265] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-19T17:47:32.160171] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T17:47:32.429771] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T17:47:32.643252] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-19T17:47:33.041282] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T17:47:33.443257] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-19T17:47:34.192361] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:47:34.243234] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-19T17:47:35.043289] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-19T17:47:35.564564] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T17:47:35.843286] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-19T17:47:36.136796] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:47:36.648576] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-19T17:47:36.658528] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T17:47:37.364802] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:47:37.443257] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-19T17:47:38.214195] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T17:47:38.221529] [INFO ] [REMOTE ] BW: Full fetch complete (58678 records). [2025-09-19T17:47:38.221671] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-19T17:47:38.253387] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-19T17:47:38.618015] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-19T17:47:38.618115] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-19T17:47:38.618801] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-19T17:47:38.618869] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-19T17:47:38.620272] [DEBUG] [LOCAL ] BW: Trimmed 58678 records to 40158 (keeping 200 days of data) [2025-09-19T17:47:38.865409] [DEBUG] [LOCAL ] BW: Primary data saved (40158 records). [2025-09-19T17:47:38.901617] [INFO ] [MAIN ] BW: Full history saved. [2025-09-19T17:47:38.902221] [INFO ] [MAIN ] Update Progress: 362/2372 symbols completed. BW took 27.8s. Estimated remaining: 4h 24m 10s. Rate: 7.6 symbols/min [2025-09-19T17:47:38.904969] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T17:47:39.048363] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-19T17:47:39.108596] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:39.122878] [DEBUG] [LOCAL ] BWG: Loaded 12419 existing records from primary storage. [2025-09-19T17:47:39.123026] [INFO ] [MAIN ] BWG: Loaded 12419 existing records. [2025-09-19T17:47:39.322131] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:39.322419] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-19T17:47:39.322471] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-19T17:47:39.323065] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-19T17:47:39.323127] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-19T17:47:39.721434] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:39.843274] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-19T17:47:40.113580] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:47:40.643266] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-19T17:47:41.163801] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T17:47:41.443247] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-19T17:47:41.783929] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T17:47:41.878124] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T17:47:42.243281] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-19T17:47:42.790763] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T17:47:43.043262] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-19T17:47:43.843302] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-19T17:47:44.155213] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T17:47:44.188320] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T17:47:44.643258] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-19T17:47:45.345081] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T17:47:45.443315] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-19T17:47:46.243286] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-19T17:47:46.597090] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T17:47:46.607886] [INFO ] [REMOTE ] BVN: Full fetch complete (62593 records). [2025-09-19T17:47:46.608135] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-19T17:47:47.007537] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-19T17:47:47.007697] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-19T17:47:47.008416] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-19T17:47:47.008465] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-19T17:47:47.009932] [DEBUG] [LOCAL ] BVN: Trimmed 62593 records to 44243 (keeping 200 days of data) [2025-09-19T17:47:47.061209] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-19T17:47:47.280516] [DEBUG] [LOCAL ] BVN: Primary data saved (44243 records). [2025-09-19T17:47:47.280721] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-19T17:47:47.280850] [INFO ] [MAIN ] Update Progress: 363/2372 symbols completed. BVN took 36.2s. Estimated remaining: 4h 24m 5s. Rate: 7.6 symbols/min [2025-09-19T17:47:47.469682] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:47.506422] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T17:47:47.548995] [DEBUG] [LOCAL ] BWLP: Loaded 33217 existing records from primary storage. [2025-09-19T17:47:47.549153] [INFO ] [MAIN ] BWLP: Loaded 33217 existing records. [2025-09-19T17:47:47.740480] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:47.740790] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-19T17:47:47.740848] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-19T17:47:47.742071] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-19T17:47:47.742140] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-19T17:47:47.848977] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-19T17:47:48.134347] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:48.136798] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T17:47:48.166193] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T17:47:48.643258] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-19T17:47:49.443297] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-19T17:47:50.048790] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T17:47:50.056610] [INFO ] [REMOTE ] BWA: Full fetch complete (75755 records). [2025-09-19T17:47:50.056765] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-19T17:47:50.243931] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-19T17:47:50.477210] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-19T17:47:50.477321] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-19T17:47:50.478138] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-19T17:47:50.478216] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-19T17:47:50.502349] [DEBUG] [LOCAL ] BWA: Trimmed 75755 records to 53029 (keeping 200 days of data) [2025-09-19T17:47:50.503599] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T17:47:50.842457] [DEBUG] [LOCAL ] BWA: Primary data saved (53029 records). [2025-09-19T17:47:50.842612] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-19T17:47:50.842731] [INFO ] [MAIN ] Update Progress: 364/2372 symbols completed. BWA took 23.7s. Estimated remaining: 4h 23m 33s. Rate: 7.6 symbols/min [2025-09-19T17:47:51.011158] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:51.020816] [DEBUG] [LOCAL ] BWMX: Loaded 7627 existing records from primary storage. [2025-09-19T17:47:51.020936] [INFO ] [MAIN ] BWMX: Loaded 7627 existing records. [2025-09-19T17:47:51.058057] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-19T17:47:51.211824] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:51.212412] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-19T17:47:51.212558] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-19T17:47:51.213016] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-19T17:47:51.213159] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-19T17:47:51.357276] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T17:47:51.375445] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T17:47:51.405326] [INFO ] [REMOTE ] BV: Full fetch complete (53839 records). [2025-09-19T17:47:51.420408] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-19T17:47:51.844891] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-19T17:47:51.874586] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:52.047528] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-19T17:47:52.047629] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-19T17:47:52.048223] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-19T17:47:52.048276] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-19T17:47:52.049630] [DEBUG] [LOCAL ] BV: Trimmed 53839 records to 39305 (keeping 200 days of data) [2025-09-19T17:47:52.282833] [DEBUG] [LOCAL ] BV: Primary data saved (39305 records). [2025-09-19T17:47:52.283065] [INFO ] [MAIN ] BV: Full history saved. [2025-09-19T17:47:52.283427] [INFO ] [MAIN ] Update Progress: 365/2372 symbols completed. BV took 41.2s. Estimated remaining: 4h 22m 50s. Rate: 7.6 symbols/min [2025-09-19T17:47:52.459744] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:52.466804] [DEBUG] [LOCAL ] BWNB: Loaded 4527 existing records from primary storage. [2025-09-19T17:47:52.466929] [INFO ] [MAIN ] BWNB: Loaded 4527 existing records. [2025-09-19T17:47:52.648203] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:52.644031] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-19T17:47:52.650077] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-19T17:47:52.650230] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-19T17:47:52.650499] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-19T17:47:52.650570] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-19T17:47:52.922965] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T17:47:52.987281] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T17:47:53.072902] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:53.404956] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T17:47:53.443218] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-19T17:47:54.243324] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-19T17:47:54.416034] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T17:47:55.043279] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-19T17:47:55.641149] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T17:47:55.843295] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-19T17:47:55.948467] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:47:56.643280] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-19T17:47:56.669008] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T17:47:57.443274] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-19T17:47:57.625249] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T17:47:58.243297] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-19T17:47:59.028694] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T17:47:59.043220] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-19T17:47:59.190247] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:47:59.596671] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T17:47:59.843254] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-19T17:48:00.643231] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-19T17:48:01.011276] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:48:01.443304] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-19T17:48:02.243310] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-19T17:48:02.542360] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T17:48:02.752515] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T17:48:03.043277] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-19T17:48:03.843273] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-19T17:48:03.877277] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:48:04.643266] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-19T17:48:05.366472] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T17:48:05.374499] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T17:48:05.396871] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-19T17:48:05.443227] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-19T17:48:06.243282] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-19T17:48:06.416147] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T17:48:07.043269] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-19T17:48:07.843272] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-19T17:48:07.956487] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T17:48:08.643240] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-19T17:48:08.845461] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T17:48:09.140330] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-09-19T17:48:09.443309] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-19T17:48:10.203480] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:48:10.211507] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T17:48:10.243232] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-19T17:48:10.934494] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T17:48:11.043296] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-19T17:48:11.831151] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T17:48:11.838768] [INFO ] [REMOTE ] BWG: Full fetch complete (17627 records). [2025-09-19T17:48:11.838979] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-19T17:48:11.853377] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-19T17:48:12.315985] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-19T17:48:12.316098] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-19T17:48:12.316446] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-19T17:48:12.316485] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-19T17:48:12.317160] [DEBUG] [LOCAL ] BWG: Trimmed 17627 records to 12521 (keeping 200 days of data) [2025-09-19T17:48:12.398530] [DEBUG] [LOCAL ] BWG: Primary data saved (12521 records). [2025-09-19T17:48:12.398711] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-19T17:48:12.398835] [INFO ] [MAIN ] Update Progress: 366/2372 symbols completed. BWG took 33.5s. Estimated remaining: 4h 23m 50s. Rate: 7.6 symbols/min [2025-09-19T17:48:12.607599] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:12.615849] [DEBUG] [LOCAL ] BWSN: Loaded 5136 existing records from primary storage. [2025-09-19T17:48:12.615971] [INFO ] [MAIN ] BWSN: Loaded 5136 existing records. [2025-09-19T17:48:12.648383] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-19T17:48:12.798066] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:12.798359] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-19T17:48:12.798427] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-19T17:48:12.798832] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-19T17:48:12.798911] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-19T17:48:13.169332] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:13.443274] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-19T17:48:13.524294] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T17:48:13.718158] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:48:14.109971] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-19T17:48:14.243304] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-19T17:48:15.043285] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-19T17:48:15.227973] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T17:48:15.843272] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-19T17:48:16.187702] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T17:48:16.643286] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-19T17:48:17.443318] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-19T17:48:17.931950] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T17:48:17.934509] [INFO ] [REMOTE ] BWMX: Full fetch complete (10060 records). [2025-09-19T17:48:17.934701] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-19T17:48:18.234827] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T17:48:18.247117] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-19T17:48:18.336092] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-19T17:48:18.336188] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-19T17:48:18.336490] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-19T17:48:18.336530] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-19T17:48:18.337049] [DEBUG] [LOCAL ] BWMX: Trimmed 10060 records to 7670 (keeping 200 days of data) [2025-09-19T17:48:18.387220] [DEBUG] [LOCAL ] BWMX: Primary data saved (7670 records). [2025-09-19T17:48:18.387358] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-19T17:48:18.387460] [INFO ] [MAIN ] Update Progress: 367/2372 symbols completed. BWMX took 27.5s. Estimated remaining: 4h 23m 31s. Rate: 7.6 symbols/min [2025-09-19T17:48:18.568533] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:18.616671] [DEBUG] [LOCAL ] BWXT: Loaded 47026 existing records from primary storage. [2025-09-19T17:48:18.616823] [INFO ] [MAIN ] BWXT: Loaded 47026 existing records. [2025-09-19T17:48:18.800222] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T17:48:18.806811] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:18.809763] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-19T17:48:18.809857] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-19T17:48:18.811303] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-19T17:48:18.811366] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-19T17:48:19.049416] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-19T17:48:19.181312] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:19.284375] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T17:48:19.772728] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T17:48:19.773927] [INFO ] [REMOTE ] BWNB: Full fetch complete (5728 records). [2025-09-19T17:48:19.773997] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-19T17:48:19.774358] [FATAL] [VALIDATOR ] BWNB: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:48:19.774440] [FATAL] [MAIN ] BWNB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:48:19.774482] [WARN ] [MAIN ] BWNB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:48:19.774521] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-19T17:48:19.774576] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-19T17:48:19.774610] [INFO ] [LOCAL ] BWNB: Starting deletion of derivative data. [2025-09-19T17:48:19.775095] [DEBUG] [LOCAL ] BWNB: Deleted derivative data file. [2025-09-19T17:48:19.775189] [INFO ] [MAIN ] Update Progress: 368/2372 symbols completed. BWNB took 27.5s. Estimated remaining: 4h 22m 48s. Rate: 7.6 symbols/min [2025-09-19T17:48:19.848387] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-19T17:48:19.949862] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:20.013729] [DEBUG] [LOCAL ] BX: Loaded 53891 existing records from primary storage. [2025-09-19T17:48:20.013941] [INFO ] [MAIN ] BX: Loaded 53891 existing records. [2025-09-19T17:48:20.192510] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:20.192853] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-19T17:48:20.192909] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-19T17:48:20.195238] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-19T17:48:20.195300] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-19T17:48:20.497876] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T17:48:20.585227] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:20.643259] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-19T17:48:21.443308] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-19T17:48:22.243352] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-19T17:48:22.436859] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T17:48:22.441703] [INFO ] [REMOTE ] BWLP: Full fetch complete (48793 records). [2025-09-19T17:48:22.441801] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-19T17:48:22.819921] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-19T17:48:22.820018] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-19T17:48:22.820600] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-19T17:48:22.820667] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-19T17:48:22.821875] [DEBUG] [LOCAL ] BWLP: Trimmed 48793 records to 33422 (keeping 200 days of data) [2025-09-19T17:48:22.943182] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T17:48:23.029885] [DEBUG] [LOCAL ] BWLP: Primary data saved (33422 records). [2025-09-19T17:48:23.030053] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-19T17:48:23.030147] [INFO ] [MAIN ] Update Progress: 369/2372 symbols completed. BWLP took 35.7s. Estimated remaining: 4h 22m 15s. Rate: 7.6 symbols/min [2025-09-19T17:48:23.051126] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-19T17:48:23.201432] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:23.216740] [DEBUG] [LOCAL ] BXC: Loaded 13710 existing records from primary storage. [2025-09-19T17:48:23.216939] [INFO ] [MAIN ] BXC: Loaded 13710 existing records. [2025-09-19T17:48:23.394418] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:23.394943] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-19T17:48:23.395085] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-19T17:48:23.395742] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-19T17:48:23.395807] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-19T17:48:23.793799] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T17:48:23.819167] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:23.843228] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-19T17:48:24.643230] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-19T17:48:24.862679] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T17:48:25.344792] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T17:48:25.443326] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-19T17:48:26.243251] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-19T17:48:27.043300] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-19T17:48:27.405868] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T17:48:27.664244] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T17:48:27.843222] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-19T17:48:28.643333] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-19T17:48:28.646829] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (4.00 seconds). [2025-09-19T17:48:28.836848] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:48:29.443265] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-19T17:48:29.696904] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T17:48:29.802216] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:48:30.243275] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-19T17:48:30.412966] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T17:48:31.043281] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-19T17:48:31.843263] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-19T17:48:32.034128] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T17:48:32.280602] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:48:32.540436] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T17:48:32.643265] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-19T17:48:33.443271] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-19T17:48:34.243270] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-19T17:48:34.711708] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T17:48:34.763722] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T17:48:35.017310] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T17:48:35.043230] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-19T17:48:35.843261] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-19T17:48:36.503155] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T17:48:36.643258] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-19T17:48:37.374915] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T17:48:37.443262] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-19T17:48:38.148134] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T17:48:38.243265] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-19T17:48:39.043256] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-19T17:48:39.606936] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T17:48:39.626020] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T17:48:39.710230] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T17:48:39.843268] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-19T17:48:40.643260] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-19T17:48:41.443370] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-19T17:48:42.129017] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T17:48:42.186323] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T17:48:42.188507] [INFO ] [REMOTE ] BWSN: Full fetch complete (6181 records). [2025-09-19T17:48:42.188829] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-19T17:48:42.250138] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-19T17:48:42.616753] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-19T17:48:42.617014] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-19T17:48:42.617326] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-19T17:48:42.617437] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-19T17:48:42.618342] [DEBUG] [LOCAL ] BWSN: Trimmed 6181 records to 5145 (keeping 200 days of data) [2025-09-19T17:48:42.655213] [DEBUG] [LOCAL ] BWSN: Primary data saved (5145 records). [2025-09-19T17:48:42.655510] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-19T17:48:42.655714] [INFO ] [MAIN ] Update Progress: 370/2372 symbols completed. BWSN took 30.3s. Estimated remaining: 4h 23m 11s. Rate: 7.6 symbols/min [2025-09-19T17:48:42.823991] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T17:48:42.904437] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:42.958282] [DEBUG] [LOCAL ] BXMT: Loaded 47617 existing records from primary storage. [2025-09-19T17:48:42.958455] [INFO ] [MAIN ] BXMT: Loaded 47617 existing records. [2025-09-19T17:48:43.048525] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-19T17:48:43.159621] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:43.159906] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-19T17:48:43.159957] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-19T17:48:43.161478] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-19T17:48:43.161542] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-19T17:48:43.522938] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:43.843291] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-19T17:48:44.241364] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T17:48:44.508274] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T17:48:44.516011] [INFO ] [REMOTE ] BWXT: Full fetch complete (67075 records). [2025-09-19T17:48:44.516173] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-19T17:48:44.648419] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-19T17:48:44.934515] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-19T17:48:44.934634] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-19T17:48:44.935539] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-19T17:48:44.935610] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-19T17:48:44.937193] [DEBUG] [LOCAL ] BWXT: Trimmed 67075 records to 47373 (keeping 200 days of data) [2025-09-19T17:48:45.254435] [DEBUG] [LOCAL ] BWXT: Primary data saved (47373 records). [2025-09-19T17:48:45.254701] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-19T17:48:45.254848] [INFO ] [MAIN ] Update Progress: 371/2372 symbols completed. BWXT took 26.9s. Estimated remaining: 4h 22m 35s. Rate: 7.6 symbols/min [2025-09-19T17:48:45.429899] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:45.444705] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-19T17:48:45.456767] [DEBUG] [LOCAL ] BXMX: Loaded 19877 existing records from primary storage. [2025-09-19T17:48:45.456976] [INFO ] [MAIN ] BXMX: Loaded 19877 existing records. [2025-09-19T17:48:45.634556] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:45.634837] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-19T17:48:45.634887] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-19T17:48:45.635521] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-19T17:48:45.635591] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-19T17:48:45.993162] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:46.225962] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-19T17:48:46.243222] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-19T17:48:46.471753] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T17:48:47.043311] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-19T17:48:47.580661] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T17:48:47.843273] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-19T17:48:48.344846] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:48:48.643245] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-19T17:48:48.717684] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (4.07 seconds). [2025-09-19T17:48:49.358124] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T17:48:49.446226] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-19T17:48:49.449036] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T17:48:50.243282] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-19T17:48:50.430342] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T17:48:50.947043] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T17:48:50.950489] [INFO ] [REMOTE ] BXC: Full fetch complete (17559 records). [2025-09-19T17:48:50.950609] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-19T17:48:51.048351] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-19T17:48:51.333444] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-19T17:48:51.333544] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-19T17:48:51.333941] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-19T17:48:51.334022] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-19T17:48:51.334714] [DEBUG] [LOCAL ] BXC: Trimmed 17559 records to 13833 (keeping 200 days of data) [2025-09-19T17:48:51.433217] [DEBUG] [LOCAL ] BXC: Primary data saved (13833 records). [2025-09-19T17:48:51.433411] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-19T17:48:51.433723] [INFO ] [MAIN ] Update Progress: 372/2372 symbols completed. BXC took 28.4s. Estimated remaining: 4h 22m 18s. Rate: 7.6 symbols/min [2025-09-19T17:48:51.604164] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:51.660343] [DEBUG] [LOCAL ] BXP: Loaded 50269 existing records from primary storage. [2025-09-19T17:48:51.660482] [INFO ] [MAIN ] BXP: Loaded 50269 existing records. [2025-09-19T17:48:51.848393] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-19T17:48:51.856094] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:51.857541] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-19T17:48:51.857629] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-19T17:48:51.858971] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-19T17:48:51.859049] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-19T17:48:52.217457] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:52.643230] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-19T17:48:53.169406] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T17:48:53.443276] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-19T17:48:54.243328] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-19T17:48:54.333999] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T17:48:55.043272] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-19T17:48:55.313594] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (3.47 seconds). [2025-09-19T17:48:55.843241] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-19T17:48:56.420037] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T17:48:56.643244] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-19T17:48:57.064831] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:48:57.174500] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:48:57.443286] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-19T17:48:58.075187] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T17:48:58.243300] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-19T17:48:59.043304] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-19T17:48:59.061343] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T17:48:59.498474] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (6.06 seconds). [2025-09-19T17:48:59.843258] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-19T17:49:00.065449] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:49:00.643292] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-19T17:49:01.443378] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-19T17:49:01.738506] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-19T17:49:02.243325] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-19T17:49:02.267356] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T17:49:02.519579] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:49:03.043236] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-19T17:49:03.406107] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:49:03.843303] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-19T17:49:04.198445] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T17:49:04.562640] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T17:49:04.643276] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-19T17:49:05.443275] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-19T17:49:05.707870] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T17:49:05.715680] [INFO ] [REMOTE ] BX: Full fetch complete (77400 records). [2025-09-19T17:49:05.715828] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-19T17:49:06.124144] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-19T17:49:06.124294] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-19T17:49:06.125161] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-19T17:49:06.125228] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-19T17:49:06.126985] [DEBUG] [LOCAL ] BX: Trimmed 77400 records to 54281 (keeping 200 days of data) [2025-09-19T17:49:06.243387] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-19T17:49:06.517989] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T17:49:06.539767] [DEBUG] [LOCAL ] BX: Primary data saved (54281 records). [2025-09-19T17:49:06.539948] [INFO ] [MAIN ] BX: Full history saved. [2025-09-19T17:49:06.540101] [INFO ] [MAIN ] Update Progress: 373/2372 symbols completed. BX took 46.8s. Estimated remaining: 4h 22m 48s. Rate: 7.6 symbols/min [2025-09-19T17:49:06.715140] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:06.767927] [DEBUG] [LOCAL ] BXSL: Loaded 47757 existing records from primary storage. [2025-09-19T17:49:06.768079] [INFO ] [MAIN ] BXSL: Loaded 47757 existing records. [2025-09-19T17:49:06.951294] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:06.951540] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-19T17:49:06.951588] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-19T17:49:06.952872] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-19T17:49:06.952942] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-19T17:49:07.049263] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-19T17:49:07.308995] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:07.631872] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T17:49:07.723995] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T17:49:07.843265] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-19T17:49:08.547557] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:49:08.643241] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-19T17:49:09.443310] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-19T17:49:09.512264] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T17:49:10.243242] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-19T17:49:11.043238] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-19T17:49:11.366175] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T17:49:11.374371] [INFO ] [REMOTE ] BXMT: Full fetch complete (69369 records). [2025-09-19T17:49:11.380985] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-19T17:49:11.393853] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T17:49:11.827029] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-19T17:49:11.829372] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-19T17:49:11.828286] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-19T17:49:11.840298] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-19T17:49:11.840372] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-19T17:49:11.841638] [DEBUG] [LOCAL ] BXMT: Trimmed 69369 records to 47995 (keeping 200 days of data) [2025-09-19T17:49:11.843220] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-19T17:49:12.135485] [DEBUG] [LOCAL ] BXMT: Primary data saved (47995 records). [2025-09-19T17:49:12.135670] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-19T17:49:12.135772] [INFO ] [MAIN ] Update Progress: 374/2372 symbols completed. BXMT took 29.5s. Estimated remaining: 4h 22m 28s. Rate: 7.6 symbols/min [2025-09-19T17:49:12.306278] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:12.327877] [DEBUG] [LOCAL ] BY: Loaded 21642 existing records from primary storage. [2025-09-19T17:49:12.328003] [INFO ] [MAIN ] BY: Loaded 21642 existing records. [2025-09-19T17:49:12.514576] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:12.514914] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-19T17:49:12.514966] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-19T17:49:12.515711] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-19T17:49:12.515773] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-19T17:49:12.655803] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-19T17:49:12.877283] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:13.025852] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T17:49:13.401639] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T17:49:13.443226] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-19T17:49:13.776380] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T17:49:14.243290] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-19T17:49:14.636707] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:49:14.639575] [INFO ] [REMOTE ] BXMX: Full fetch complete (28604 records). [2025-09-19T17:49:14.639676] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-19T17:49:15.011473] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-19T17:49:15.011820] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-19T17:49:15.012301] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-19T17:49:15.012362] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-19T17:49:15.013449] [DEBUG] [LOCAL ] BXMX: Trimmed 28604 records to 19972 (keeping 200 days of data) [2025-09-19T17:49:15.079250] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-19T17:49:15.151839] [DEBUG] [LOCAL ] BXMX: Primary data saved (19972 records). [2025-09-19T17:49:15.152008] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-19T17:49:15.152151] [INFO ] [MAIN ] Update Progress: 375/2372 symbols completed. BXMX took 29.9s. Estimated remaining: 4h 21m 55s. Rate: 7.6 symbols/min [2025-09-19T17:49:15.326813] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:15.377530] [DEBUG] [LOCAL ] BYD: Loaded 45747 existing records from primary storage. [2025-09-19T17:49:15.377706] [INFO ] [MAIN ] BYD: Loaded 45747 existing records. [2025-09-19T17:49:15.555443] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:15.555790] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-19T17:49:15.555890] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-19T17:49:15.557221] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-19T17:49:15.557282] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-19T17:49:15.847153] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-19T17:49:15.870721] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:49:15.942939] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:16.643311] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-19T17:49:16.691859] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T17:49:17.443292] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-19T17:49:17.887593] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:49:18.002082] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T17:49:18.243294] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-19T17:49:19.043273] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-19T17:49:19.281554] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T17:49:19.519926] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T17:49:19.843278] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-19T17:49:20.643290] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-19T17:49:21.443320] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-19T17:49:21.706516] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T17:49:22.119082] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T17:49:22.161542] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-09-19T17:49:22.243231] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-19T17:49:22.679417] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T17:49:23.043266] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-19T17:49:23.843267] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-19T17:49:23.915518] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:49:24.643325] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-19T17:49:25.000841] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:49:25.443331] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-19T17:49:26.221177] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-19T17:49:26.228542] [INFO ] [REMOTE ] BXP: Full fetch complete (71120 records). [2025-09-19T17:49:26.228693] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-19T17:49:26.263766] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-19T17:49:26.628708] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T17:49:26.733633] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-19T17:49:26.733741] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-19T17:49:26.734481] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-19T17:49:26.734522] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-19T17:49:26.735976] [DEBUG] [LOCAL ] BXP: Trimmed 71120 records to 50587 (keeping 200 days of data) [2025-09-19T17:49:26.968988] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T17:49:27.053429] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-19T17:49:27.072824] [DEBUG] [LOCAL ] BXP: Primary data saved (50587 records). [2025-09-19T17:49:27.072935] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-19T17:49:27.073024] [INFO ] [MAIN ] Update Progress: 376/2372 symbols completed. BXP took 35.6s. Estimated remaining: 4h 22m 8s. Rate: 7.6 symbols/min [2025-09-19T17:49:27.243944] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:27.257365] [DEBUG] [LOCAL ] BYM: Loaded 12392 existing records from primary storage. [2025-09-19T17:49:27.257484] [INFO ] [MAIN ] BYM: Loaded 12392 existing records. [2025-09-19T17:49:27.435949] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:27.436267] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-19T17:49:27.436336] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-19T17:49:27.436856] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-19T17:49:27.436916] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-19T17:49:27.789216] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:27.843226] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-19T17:49:28.236431] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T17:49:28.323770] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T17:49:28.643231] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-19T17:49:29.132674] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T17:49:29.443268] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-19T17:49:29.974707] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T17:49:30.243267] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-19T17:49:30.974272] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T17:49:31.043273] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-19T17:49:31.843231] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-19T17:49:32.260586] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:49:32.443461] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T17:49:32.643278] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-19T17:49:33.443282] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-19T17:49:33.814198] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T17:49:33.846453] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T17:49:34.241807] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T17:49:34.247244] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-19T17:49:35.043267] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-19T17:49:35.739615] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T17:49:35.843226] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-19T17:49:36.643242] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-19T17:49:36.876771] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T17:49:37.346464] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:49:37.443303] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-19T17:49:38.251511] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-19T17:49:38.256811] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T17:49:38.264574] [INFO ] [REMOTE ] BXSL: Full fetch complete (69135 records). [2025-09-19T17:49:38.264738] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-19T17:49:38.686570] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-19T17:49:38.686719] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-19T17:49:38.687589] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-19T17:49:38.687734] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-19T17:49:38.689696] [DEBUG] [LOCAL ] BXSL: Trimmed 69135 records to 48143 (keeping 200 days of data) [2025-09-19T17:49:38.931637] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T17:49:38.938939] [INFO ] [REMOTE ] BY: Full fetch complete (28859 records). [2025-09-19T17:49:38.939612] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-19T17:49:39.043601] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-19T17:49:39.347576] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T17:49:39.416687] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-19T17:49:39.417112] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-19T17:49:39.417617] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-19T17:49:39.417728] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-19T17:49:39.421688] [DEBUG] [LOCAL ] BY: Trimmed 28859 records to 21803 (keeping 200 days of data) [2025-09-19T17:49:39.519713] [DEBUG] [LOCAL ] BXSL: Primary data saved (48143 records). [2025-09-19T17:49:39.520418] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-19T17:49:39.520807] [INFO ] [MAIN ] Update Progress: 377/2372 symbols completed. BXSL took 33.0s. Estimated remaining: 4h 22m 24s. Rate: 7.6 symbols/min [2025-09-19T17:49:39.702263] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:39.758943] [DEBUG] [LOCAL ] BY: Primary data saved (21803 records). [2025-09-19T17:49:39.760327] [INFO ] [MAIN ] BY: Full history saved. [2025-09-19T17:49:39.761799] [INFO ] [MAIN ] Update Progress: 378/2372 symbols completed. BY took 27.6s. Estimated remaining: 4h 21m 36s. Rate: 7.6 symbols/min [2025-09-19T17:49:39.761622] [DEBUG] [LOCAL ] BZH: Loaded 33190 existing records from primary storage. [2025-09-19T17:49:39.762272] [INFO ] [MAIN ] BZH: Loaded 33190 existing records. [2025-09-19T17:49:39.850209] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-19T17:49:40.164287] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:40.164478] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:40.165062] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-19T17:49:40.165144] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-19T17:49:40.166688] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-19T17:49:40.166762] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-19T17:49:40.543632] [DEBUG] [LOCAL ] C: Loaded 54131 existing records from primary storage. [2025-09-19T17:49:40.563380] [INFO ] [MAIN ] C: Loaded 54131 existing records. [2025-09-19T17:49:40.665263] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:40.681105] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-19T17:49:40.811750] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:40.812204] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-19T17:49:40.812309] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-19T17:49:40.813537] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-19T17:49:40.813602] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-19T17:49:40.999361] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T17:49:41.099472] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T17:49:41.282304] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:41.443265] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-19T17:49:41.731546] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:49:42.243285] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-19T17:49:43.043284] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-19T17:49:43.637785] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T17:49:43.728689] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T17:49:43.843244] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-19T17:49:44.471538] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:49:44.643282] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-19T17:49:45.443302] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-19T17:49:45.524913] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T17:49:46.243263] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-19T17:49:46.751348] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:49:47.043265] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-19T17:49:47.270931] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T17:49:47.405663] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-19T17:49:47.843248] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-19T17:49:48.076690] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T17:49:48.643284] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-19T17:49:49.443238] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-19T17:49:50.093211] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-19T17:49:50.243268] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-19T17:49:50.472510] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:49:50.479037] [INFO ] [REMOTE ] BYD: Full fetch complete (64997 records). [2025-09-19T17:49:50.479160] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-19T17:49:50.615976] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:49:50.885953] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-19T17:49:50.886097] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-19T17:49:50.887897] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-19T17:49:50.887979] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-19T17:49:50.889547] [DEBUG] [LOCAL ] BYD: Trimmed 64997 records to 46035 (keeping 200 days of data) [2025-09-19T17:49:51.070338] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-19T17:49:51.180804] [DEBUG] [LOCAL ] BYD: Primary data saved (46035 records). [2025-09-19T17:49:51.180957] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-19T17:49:51.181089] [INFO ] [MAIN ] Update Progress: 379/2372 symbols completed. BYD took 36.0s. Estimated remaining: 4h 21m 47s. Rate: 7.6 symbols/min [2025-09-19T17:49:51.361552] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:51.381880] [DEBUG] [LOCAL ] CAAP: Loaded 19312 existing records from primary storage. [2025-09-19T17:49:51.382016] [INFO ] [MAIN ] CAAP: Loaded 19312 existing records. [2025-09-19T17:49:51.583741] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:51.584448] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-19T17:49:51.584561] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-19T17:49:51.585239] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-19T17:49:51.604256] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-19T17:49:51.640194] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T17:49:51.742870] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T17:49:51.850679] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-19T17:49:52.011701] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:52.643280] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-19T17:49:53.356255] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T17:49:53.443241] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-19T17:49:53.632833] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T17:49:54.243279] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-19T17:49:55.043278] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-19T17:49:55.069557] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:49:55.843331] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-19T17:49:56.504292] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:49:56.643290] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-19T17:49:56.702790] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-19T17:49:57.136557] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:49:57.419215] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T17:49:57.423537] [INFO ] [REMOTE ] BYM: Full fetch complete (17953 records). [2025-09-19T17:49:57.423739] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-19T17:49:57.448499] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-19T17:49:57.996125] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-19T17:49:57.996229] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-19T17:49:57.996784] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-19T17:49:57.996854] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-19T17:49:57.998998] [DEBUG] [LOCAL ] BYM: Trimmed 17953 records to 12414 (keeping 200 days of data) [2025-09-19T17:49:58.095464] [DEBUG] [LOCAL ] BYM: Primary data saved (12414 records). [2025-09-19T17:49:58.095636] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-19T17:49:58.095812] [INFO ] [MAIN ] Update Progress: 380/2372 symbols completed. BYM took 31.0s. Estimated remaining: 4h 21m 34s. Rate: 7.6 symbols/min [2025-09-19T17:49:58.245602] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-19T17:49:58.357402] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:58.383398] [DEBUG] [LOCAL ] CABO: Loaded 17861 existing records from primary storage. [2025-09-19T17:49:58.383636] [INFO ] [MAIN ] CABO: Loaded 17861 existing records. [2025-09-19T17:49:58.602018] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:58.602460] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-19T17:49:58.602524] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-19T17:49:58.603223] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-19T17:49:58.603320] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-19T17:49:59.000861] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:59.024845] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T17:49:59.043218] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-19T17:49:59.177020] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T17:49:59.843277] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-19T17:50:00.079958] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T17:50:00.610919] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T17:50:00.643271] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-19T17:50:01.443310] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-19T17:50:02.243319] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-19T17:50:02.329310] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T17:50:02.335320] [INFO ] [REMOTE ] BZH: Full fetch complete (46870 records). [2025-09-19T17:50:02.335505] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-19T17:50:02.336249] [FATAL] [VALIDATOR ] BZH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:50:02.336350] [FATAL] [MAIN ] BZH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:50:02.336419] [WARN ] [MAIN ] BZH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:50:02.336499] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-19T17:50:02.336574] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-09-19T17:50:02.336611] [INFO ] [LOCAL ] BZH: Starting deletion of derivative data. [2025-09-19T17:50:02.337144] [DEBUG] [LOCAL ] BZH: Deleted derivative data file. [2025-09-19T17:50:02.337263] [INFO ] [MAIN ] Update Progress: 381/2372 symbols completed. BZH took 22.8s. Estimated remaining: 4h 21m 7s. Rate: 7.6 symbols/min [2025-09-19T17:50:02.523272] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:02.535694] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:50:02.563280] [DEBUG] [LOCAL ] CACI: Loaded 26140 existing records from primary storage. [2025-09-19T17:50:02.563428] [INFO ] [MAIN ] CACI: Loaded 26140 existing records. [2025-09-19T17:50:02.752828] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:02.753130] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-19T17:50:02.753183] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-19T17:50:02.754238] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-19T17:50:02.754356] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-19T17:50:03.048420] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-19T17:50:03.157857] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:03.579743] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T17:50:03.843270] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-19T17:50:04.643276] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-19T17:50:05.274246] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T17:50:05.443264] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-19T17:50:06.113520] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-19T17:50:06.190940] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T17:50:06.243255] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-19T17:50:06.757826] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T17:50:07.043326] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-19T17:50:07.342098] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T17:50:07.843286] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-19T17:50:08.643240] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-19T17:50:08.861439] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T17:50:09.443255] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-19T17:50:09.573784] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T17:50:10.171675] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-09-19T17:50:10.243225] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-19T17:50:10.547622] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T17:50:11.043325] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-19T17:50:11.843288] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-19T17:50:11.901086] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T17:50:12.168969] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T17:50:12.643270] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-19T17:50:13.387469] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:50:13.443271] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-19T17:50:13.957139] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T17:50:14.194708] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T17:50:14.243262] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-19T17:50:15.043270] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-19T17:50:15.843259] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-19T17:50:16.643257] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-19T17:50:17.188625] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:50:17.443236] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-19T17:50:17.919596] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T17:50:18.243270] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-19T17:50:19.095546] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (4.05 seconds). [2025-09-19T17:50:19.104015] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-19T17:50:19.172546] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (4.93 seconds). [2025-09-19T17:50:19.209070] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T17:50:19.843299] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-19T17:50:20.025551] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T17:50:20.029580] [INFO ] [REMOTE ] CAAP: Full fetch complete (27484 records). [2025-09-19T17:50:20.029725] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-19T17:50:20.410282] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-19T17:50:20.410369] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-19T17:50:20.410835] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-19T17:50:20.410898] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-19T17:50:20.411671] [DEBUG] [LOCAL ] CAAP: Trimmed 27484 records to 19495 (keeping 200 days of data) [2025-09-19T17:50:20.524637] [DEBUG] [LOCAL ] CAAP: Primary data saved (19495 records). [2025-09-19T17:50:20.524797] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-19T17:50:20.524896] [INFO ] [MAIN ] Update Progress: 382/2372 symbols completed. CAAP took 29.3s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-19T17:50:20.643319] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-19T17:50:20.688868] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:50:20.729032] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:20.774493] [DEBUG] [LOCAL ] CADE: Loaded 49099 existing records from primary storage. [2025-09-19T17:50:20.774633] [INFO ] [MAIN ] CADE: Loaded 49099 existing records. [2025-09-19T17:50:20.957045] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:20.957392] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-19T17:50:20.957461] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-19T17:50:20.963854] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-19T17:50:20.970189] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-19T17:50:21.003892] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T17:50:21.330541] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:21.443214] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-19T17:50:22.243305] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-19T17:50:22.746352] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T17:50:23.024772] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T17:50:23.043211] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-19T17:50:23.618058] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:50:23.843301] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-19T17:50:24.643279] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-19T17:50:24.918909] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T17:50:25.443319] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-19T17:50:25.715596] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T17:50:25.726247] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-09-19T17:50:25.726410] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-19T17:50:26.149849] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-19T17:50:26.150823] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-19T17:50:26.151819] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-19T17:50:26.153515] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-19T17:50:26.153390] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T17:50:26.162774] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54521 (keeping 200 days of data) [2025-09-19T17:50:26.265595] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-19T17:50:26.528954] [DEBUG] [LOCAL ] C: Primary data saved (54521 records). [2025-09-19T17:50:26.529115] [INFO ] [MAIN ] C: Full history saved. [2025-09-19T17:50:26.530130] [INFO ] [MAIN ] Update Progress: 383/2372 symbols completed. C took 46.8s. Estimated remaining: 4h 21m 35s. Rate: 7.6 symbols/min [2025-09-19T17:50:26.708455] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:26.748747] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T17:50:26.789558] [DEBUG] [LOCAL ] CAE: Loaded 39162 existing records from primary storage. [2025-09-19T17:50:26.789747] [INFO ] [MAIN ] CAE: Loaded 39162 existing records. [2025-09-19T17:50:26.965733] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:26.966021] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-19T17:50:26.966070] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-19T17:50:26.967350] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-19T17:50:26.967411] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-19T17:50:27.048419] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-19T17:50:27.324271] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:27.843284] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-19T17:50:27.859258] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T17:50:28.540465] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T17:50:28.643242] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-19T17:50:29.240792] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T17:50:29.443260] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-19T17:50:29.978173] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T17:50:29.982776] [INFO ] [REMOTE ] CACI: Full fetch complete (39227 records). [2025-09-19T17:50:29.982886] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-19T17:50:30.248465] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-19T17:50:30.379707] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-19T17:50:30.379803] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-19T17:50:30.380440] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-19T17:50:30.380482] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-19T17:50:30.381463] [DEBUG] [LOCAL ] CACI: Trimmed 39227 records to 26262 (keeping 200 days of data) [2025-09-19T17:50:30.540215] [DEBUG] [LOCAL ] CACI: Primary data saved (26262 records). [2025-09-19T17:50:30.540362] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-19T17:50:30.540470] [INFO ] [MAIN ] Update Progress: 384/2372 symbols completed. CACI took 28.2s. Estimated remaining: 4h 21m 7s. Rate: 7.6 symbols/min [2025-09-19T17:50:30.716448] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:30.722166] [DEBUG] [LOCAL ] CAF: Loaded 3464 existing records from primary storage. [2025-09-19T17:50:30.722291] [INFO ] [MAIN ] CAF: Loaded 3464 existing records. [2025-09-19T17:50:30.903941] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:30.904242] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-19T17:50:30.904292] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-19T17:50:30.904583] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-19T17:50:30.904682] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-19T17:50:31.048506] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-19T17:50:31.280243] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:31.301474] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T17:50:31.426684] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T17:50:31.429077] [INFO ] [REMOTE ] CABO: Full fetch complete (22946 records). [2025-09-19T17:50:31.429266] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-19T17:50:31.794585] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-19T17:50:31.794693] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-19T17:50:31.795142] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-19T17:50:31.795216] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-19T17:50:31.796000] [DEBUG] [LOCAL ] CABO: Trimmed 22946 records to 17935 (keeping 200 days of data) [2025-09-19T17:50:31.849745] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-19T17:50:31.910499] [DEBUG] [LOCAL ] CABO: Primary data saved (17935 records). [2025-09-19T17:50:31.910705] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-19T17:50:31.910815] [INFO ] [MAIN ] Update Progress: 385/2372 symbols completed. CABO took 33.8s. Estimated remaining: 4h 20m 26s. Rate: 7.6 symbols/min [2025-09-19T17:50:32.089543] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:32.149532] [DEBUG] [LOCAL ] CAG: Loaded 54048 existing records from primary storage. [2025-09-19T17:50:32.149713] [INFO ] [MAIN ] CAG: Loaded 54048 existing records. [2025-09-19T17:50:32.390378] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:32.390667] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-19T17:50:32.390728] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-19T17:50:32.393530] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-19T17:50:32.393597] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-19T17:50:32.649210] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-19T17:50:32.679729] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:50:32.791721] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T17:50:32.837250] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:33.443278] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-19T17:50:34.243260] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-19T17:50:34.469711] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:50:35.043242] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-19T17:50:35.573635] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T17:50:35.843277] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-19T17:50:36.449001] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T17:50:36.566927] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:50:36.643244] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-19T17:50:37.443297] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-19T17:50:38.176292] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-19T17:50:38.194181] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:50:38.243235] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-19T17:50:38.529751] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T17:50:39.043293] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-19T17:50:39.843294] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-19T17:50:40.177877] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:50:40.283494] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T17:50:40.297607] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-19T17:50:40.643264] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-19T17:50:41.443271] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-19T17:50:42.243280] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-19T17:50:42.479582] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T17:50:43.017851] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T17:50:43.043213] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-19T17:50:43.843330] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-19T17:50:44.307666] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T17:50:44.416681] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:50:44.643067] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T17:50:44.643229] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-19T17:50:45.443304] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-19T17:50:46.243308] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-19T17:50:46.651611] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:50:47.043281] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-19T17:50:47.289891] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T17:50:47.843287] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-19T17:50:47.901324] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:50:48.560623] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T17:50:48.643272] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-19T17:50:48.995532] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T17:50:49.388366] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T17:50:49.443257] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-19T17:50:50.028791] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-19T17:50:50.243285] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-19T17:50:51.043337] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-19T17:50:51.806099] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T17:50:51.843315] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-19T17:50:52.643310] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-19T17:50:52.764258] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T17:50:52.770219] [INFO ] [REMOTE ] CAE: Full fetch complete (55570 records). [2025-09-19T17:50:52.770344] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-19T17:50:53.155488] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-19T17:50:53.155603] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-19T17:50:53.156403] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-19T17:50:53.156483] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-19T17:50:53.157964] [DEBUG] [LOCAL ] CAE: Trimmed 55570 records to 39492 (keeping 200 days of data) [2025-09-19T17:50:53.246801] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T17:50:53.392291] [DEBUG] [LOCAL ] CAE: Primary data saved (39492 records). [2025-09-19T17:50:53.392457] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-19T17:50:53.394979] [INFO ] [MAIN ] Update Progress: 386/2372 symbols completed. CAE took 26.9s. Estimated remaining: 4h 21m 28s. Rate: 7.6 symbols/min [2025-09-19T17:50:53.452088] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-19T17:50:53.580435] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:53.646491] [DEBUG] [LOCAL ] CAH: Loaded 51889 existing records from primary storage. [2025-09-19T17:50:53.646684] [INFO ] [MAIN ] CAH: Loaded 51889 existing records. [2025-09-19T17:50:53.837882] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:53.838308] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-19T17:50:53.838383] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-19T17:50:53.852877] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-19T17:50:53.872831] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-19T17:50:53.923190] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T17:50:54.253494] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-19T17:50:54.298846] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:54.305505] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T17:50:55.043272] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-19T17:50:55.843367] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-19T17:50:55.926892] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T17:50:55.928819] [INFO ] [REMOTE ] CAF: Full fetch complete (5892 records). [2025-09-19T17:50:55.929025] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-19T17:50:56.315482] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-19T17:50:56.315587] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-19T17:50:56.315852] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-19T17:50:56.315934] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-19T17:50:56.316352] [DEBUG] [LOCAL ] CAF: Trimmed 5892 records to 3481 (keeping 200 days of data) [2025-09-19T17:50:56.337987] [DEBUG] [LOCAL ] CAF: Primary data saved (3481 records). [2025-09-19T17:50:56.338060] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-19T17:50:56.338167] [INFO ] [MAIN ] Update Progress: 387/2372 symbols completed. CAF took 25.8s. Estimated remaining: 4h 20m 55s. Rate: 7.6 symbols/min [2025-09-19T17:50:56.526419] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:56.567766] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:50:56.624900] [DEBUG] [LOCAL ] CAL: Loaded 43648 existing records from primary storage. [2025-09-19T17:50:56.625078] [INFO ] [MAIN ] CAL: Loaded 43648 existing records. [2025-09-19T17:50:56.648368] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-19T17:50:56.829903] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:56.830205] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-19T17:50:56.830254] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-19T17:50:56.831378] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-19T17:50:56.831449] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-19T17:50:57.217331] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:57.443287] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-19T17:50:58.243243] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-19T17:50:58.378863] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-19T17:50:58.782088] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T17:50:58.791130] [INFO ] [REMOTE ] CADE: Full fetch complete (69265 records). [2025-09-19T17:50:58.791318] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-19T17:50:58.792207] [FATAL] [VALIDATOR ] CADE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:50:58.792322] [FATAL] [MAIN ] CADE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:50:58.792400] [WARN ] [MAIN ] CADE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:50:58.792509] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-19T17:50:58.792607] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-19T17:50:58.792720] [INFO ] [LOCAL ] CADE: Starting deletion of derivative data. [2025-09-19T17:50:58.793154] [DEBUG] [LOCAL ] CADE: Deleted derivative data file. [2025-09-19T17:50:58.793313] [INFO ] [MAIN ] Update Progress: 388/2372 symbols completed. CADE took 38.3s. Estimated remaining: 4h 20m 19s. Rate: 7.6 symbols/min [2025-09-19T17:50:58.993721] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:59.043847] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-19T17:50:59.046176] [DEBUG] [LOCAL ] CALX: Loaded 39114 existing records from primary storage. [2025-09-19T17:50:59.046537] [INFO ] [MAIN ] CALX: Loaded 39114 existing records. [2025-09-19T17:50:59.214737] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T17:50:59.285066] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:59.285336] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-19T17:50:59.285390] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-19T17:50:59.286212] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-19T17:50:59.286273] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-19T17:50:59.656693] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:59.843293] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-19T17:51:00.133613] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T17:51:00.643318] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-19T17:51:01.443262] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-19T17:51:01.523940] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:51:01.686731] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-19T17:51:02.243306] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-19T17:51:02.623064] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T17:51:03.043301] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-19T17:51:03.843404] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-19T17:51:04.815549] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (3.37 seconds). [2025-09-19T17:51:04.826002] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-19T17:51:05.784306] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:51:05.792434] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-19T17:51:06.503124] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (4.26 seconds). [2025-09-19T17:51:06.510912] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-19T17:51:06.627139] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (3.58 seconds). [2025-09-19T17:51:06.635338] [INFO ] [REMOTE ] CAG: Full fetch complete (77641 records). [2025-09-19T17:51:06.635508] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-19T17:51:07.046216] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-19T17:51:07.046514] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-19T17:51:07.047394] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-19T17:51:07.047479] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-19T17:51:07.050780] [DEBUG] [LOCAL ] CAG: Trimmed 77641 records to 54438 (keeping 200 days of data) [2025-09-19T17:51:07.178167] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-19T17:51:07.191718] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-19T17:51:07.343084] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T17:51:07.480930] [DEBUG] [LOCAL ] CAG: Primary data saved (54438 records). [2025-09-19T17:51:07.481221] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-19T17:51:07.481346] [INFO ] [MAIN ] Update Progress: 389/2372 symbols completed. CAG took 35.6s. Estimated remaining: 4h 20m 15s. Rate: 7.6 symbols/min [2025-09-19T17:51:07.660918] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:07.683101] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T17:51:07.715866] [DEBUG] [LOCAL ] CANG: Loaded 26838 existing records from primary storage. [2025-09-19T17:51:07.716022] [INFO ] [MAIN ] CANG: Loaded 26838 existing records. [2025-09-19T17:51:07.848400] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-19T17:51:07.905880] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:07.906130] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-19T17:51:07.906181] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-19T17:51:07.907035] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-19T17:51:07.907101] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-19T17:51:08.291794] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:08.643308] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-19T17:51:08.823252] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:51:09.443337] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-19T17:51:09.782829] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T17:51:10.007197] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T17:51:10.243290] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-19T17:51:11.043278] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-19T17:51:11.742735] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T17:51:11.843273] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-19T17:51:12.164776] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T17:51:12.370616] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T17:51:12.643267] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-19T17:51:13.443284] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-19T17:51:13.783282] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T17:51:14.243278] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-19T17:51:15.043275] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-19T17:51:16.115722] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (3.47 seconds). [2025-09-19T17:51:16.127361] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-19T17:51:16.241426] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-19T17:51:16.300884] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T17:51:16.341980] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T17:51:16.643268] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-19T17:51:17.443307] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-19T17:51:17.649081] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T17:51:18.243248] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-19T17:51:18.318679] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:51:19.043266] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-19T17:51:19.239399] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T17:51:19.492289] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T17:51:19.843273] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-19T17:51:20.618532] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T17:51:20.643230] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-19T17:51:21.429216] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T17:51:21.443223] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-19T17:51:22.243280] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-19T17:51:22.398161] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T17:51:22.836413] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T17:51:23.043282] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-19T17:51:23.843285] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-19T17:51:24.436530] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-19T17:51:24.643284] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-19T17:51:25.029397] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T17:51:25.449870] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-19T17:51:25.454355] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T17:51:26.243270] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-19T17:51:26.398450] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:51:27.043263] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-19T17:51:27.680180] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T17:51:27.690680] [INFO ] [REMOTE ] CAL: Full fetch complete (61852 records). [2025-09-19T17:51:27.690859] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-19T17:51:27.848353] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-19T17:51:28.088408] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-19T17:51:28.088510] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-19T17:51:28.089221] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-19T17:51:28.089287] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-19T17:51:28.090707] [DEBUG] [LOCAL ] CAL: Trimmed 61852 records to 43947 (keeping 200 days of data) [2025-09-19T17:51:28.373557] [DEBUG] [LOCAL ] CAL: Primary data saved (43947 records). [2025-09-19T17:51:28.373723] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-19T17:51:28.373850] [INFO ] [MAIN ] Update Progress: 390/2372 symbols completed. CAL took 32.0s. Estimated remaining: 4h 21m 14s. Rate: 7.6 symbols/min [2025-09-19T17:51:28.567706] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:28.568992] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-19T17:51:28.577294] [INFO ] [REMOTE ] CAH: Full fetch complete (74592 records). [2025-09-19T17:51:28.577637] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-19T17:51:28.683795] [DEBUG] [LOCAL ] CAPL: Loaded 5996 existing records from primary storage. [2025-09-19T17:51:28.687331] [INFO ] [MAIN ] CAPL: Loaded 5996 existing records. [2025-09-19T17:51:29.094510] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:29.110817] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-19T17:51:29.193137] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-19T17:51:29.220235] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:51:29.221437] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T17:51:29.238835] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-19T17:51:29.237854] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-19T17:51:29.238441] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-19T17:51:29.239788] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-19T17:51:29.239728] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-19T17:51:29.252921] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-19T17:51:29.271688] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-19T17:51:29.262676] [INFO ] [REMOTE ] CALX: Full fetch complete (54202 records). [2025-09-19T17:51:29.314524] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-19T17:51:29.344839] [DEBUG] [LOCAL ] CAH: Trimmed 74592 records to 52263 (keeping 200 days of data) [2025-09-19T17:51:30.048749] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:30.055110] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-19T17:51:30.149998] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-19T17:51:30.150470] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-19T17:51:30.151939] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-19T17:51:30.152020] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-19T17:51:30.156972] [DEBUG] [LOCAL ] CALX: Trimmed 54202 records to 39339 (keeping 200 days of data) [2025-09-19T17:51:30.501678] [DEBUG] [LOCAL ] CALX: Primary data saved (39339 records). [2025-09-19T17:51:30.502287] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-19T17:51:30.502707] [INFO ] [MAIN ] Update Progress: 391/2372 symbols completed. CALX took 31.7s. Estimated remaining: 4h 20m 36s. Rate: 7.6 symbols/min [2025-09-19T17:51:30.682828] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:30.790780] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-19T17:51:30.794090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-19T17:51:30.812977] [DEBUG] [LOCAL ] CARR: Loaded 53988 existing records from primary storage. [2025-09-19T17:51:30.813402] [INFO ] [MAIN ] CARR: Loaded 53988 existing records. [2025-09-19T17:51:30.930013] [DEBUG] [LOCAL ] CAH: Primary data saved (52263 records). [2025-09-19T17:51:30.946036] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-19T17:51:30.952979] [INFO ] [MAIN ] Update Progress: 392/2372 symbols completed. CAH took 37.6s. Estimated remaining: 4h 19m 51s. Rate: 7.6 symbols/min [2025-09-19T17:51:31.114331] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:31.114783] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-19T17:51:31.114853] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-19T17:51:31.132825] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-19T17:51:31.132995] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-19T17:51:31.144851] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:51:31.282732] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:31.254886] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-19T17:51:31.452571] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T17:51:31.612032] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:31.613024] [DEBUG] [LOCAL ] CARS: Loaded 40751 existing records from primary storage. [2025-09-19T17:51:31.613098] [INFO ] [MAIN ] CARS: Loaded 40751 existing records. [2025-09-19T17:51:31.788701] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:31.788962] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-19T17:51:31.789013] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-19T17:51:31.789905] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-19T17:51:31.789965] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-19T17:51:31.852349] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-19T17:51:32.190019] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:32.312243] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T17:51:32.643257] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-19T17:51:33.443304] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-19T17:51:33.863720] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:51:34.140522] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:51:34.145885] [INFO ] [REMOTE ] CANG: Full fetch complete (40579 records). [2025-09-19T17:51:34.146025] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-19T17:51:34.251481] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-19T17:51:34.552589] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-19T17:51:34.552703] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-19T17:51:34.553296] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-19T17:51:34.553341] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-19T17:51:34.554513] [DEBUG] [LOCAL ] CANG: Trimmed 40579 records to 27140 (keeping 200 days of data) [2025-09-19T17:51:34.716079] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T17:51:34.732370] [DEBUG] [LOCAL ] CANG: Primary data saved (27140 records). [2025-09-19T17:51:34.732448] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-19T17:51:34.732521] [INFO ] [MAIN ] Update Progress: 393/2372 symbols completed. CANG took 27.3s. Estimated remaining: 4h 19m 22s. Rate: 7.6 symbols/min [2025-09-19T17:51:34.904401] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:34.963216] [DEBUG] [LOCAL ] CAT: Loaded 53322 existing records from primary storage. [2025-09-19T17:51:34.963361] [INFO ] [MAIN ] CAT: Loaded 53322 existing records. [2025-09-19T17:51:35.048610] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-19T17:51:35.125861] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T17:51:35.152336] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:35.154484] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-19T17:51:35.154534] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-19T17:51:35.155712] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-19T17:51:35.155772] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-19T17:51:35.509745] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:35.843264] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-19T17:51:36.394917] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T17:51:36.643275] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-19T17:51:37.335844] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T17:51:37.443263] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-19T17:51:37.655142] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T17:51:37.919930] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-19T17:51:38.243257] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-19T17:51:38.989722] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T17:51:39.043219] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-19T17:51:39.843278] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-19T17:51:40.643264] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-19T17:51:41.070517] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:51:41.443232] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-19T17:51:42.003817] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:51:42.093981] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-19T17:51:42.243218] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-19T17:51:43.043280] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-19T17:51:43.518265] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T17:51:43.843240] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-19T17:51:43.890730] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T17:51:44.643267] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-19T17:51:44.941551] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-19T17:51:45.439014] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T17:51:45.443204] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-19T17:51:45.844540] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:51:45.941829] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T17:51:46.243272] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-19T17:51:47.043276] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-19T17:51:47.843281] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-19T17:51:47.861448] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-19T17:51:47.866585] [INFO ] [REMOTE ] CAPL: Full fetch complete (8970 records). [2025-09-19T17:51:47.866733] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-19T17:51:47.867381] [FATAL] [VALIDATOR ] CAPL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:51:47.867472] [FATAL] [MAIN ] CAPL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:51:47.867515] [WARN ] [MAIN ] CAPL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:51:47.867590] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-19T17:51:47.867716] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-09-19T17:51:47.867772] [INFO ] [LOCAL ] CAPL: Starting deletion of derivative data. [2025-09-19T17:51:47.868152] [DEBUG] [LOCAL ] CAPL: Deleted derivative data file. [2025-09-19T17:51:47.868244] [INFO ] [MAIN ] Update Progress: 394/2372 symbols completed. CAPL took 19.5s. Estimated remaining: 4h 19m 41s. Rate: 7.6 symbols/min [2025-09-19T17:51:48.038810] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:48.047844] [DEBUG] [LOCAL ] CATO: Loaded 7490 existing records from primary storage. [2025-09-19T17:51:48.047965] [INFO ] [MAIN ] CATO: Loaded 7490 existing records. [2025-09-19T17:51:48.264282] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:48.264921] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-19T17:51:48.265153] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-19T17:51:48.265639] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-19T17:51:48.265855] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-19T17:51:48.645638] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-19T17:51:48.682213] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:48.684720] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T17:51:49.443265] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-19T17:51:49.974085] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T17:51:50.243301] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-19T17:51:50.441921] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T17:51:50.655523] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T17:51:51.043270] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-19T17:51:51.843299] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-19T17:51:51.913187] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:51:52.643337] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-19T17:51:53.057179] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:51:53.443285] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-19T17:51:53.604321] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T17:51:53.990689] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T17:51:54.243278] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-19T17:51:55.043286] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-19T17:51:55.238264] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T17:51:55.265386] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T17:51:55.843319] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-19T17:51:56.643268] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-19T17:51:56.854558] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:51:56.956158] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T17:51:57.443358] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-19T17:51:58.243299] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-19T17:51:59.043240] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-19T17:51:59.125926] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T17:51:59.348507] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-19T17:51:59.544536] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:51:59.843287] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-19T17:52:00.098746] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T17:52:00.643269] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-19T17:52:01.443315] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-19T17:52:01.655699] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T17:52:02.046341] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T17:52:02.243290] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-19T17:52:03.043340] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-19T17:52:03.192987] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:52:03.227609] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-19T17:52:03.843264] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-19T17:52:04.635734] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T17:52:04.643200] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-19T17:52:05.020223] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:52:05.028036] [INFO ] [REMOTE ] CARR: Full fetch complete (77594 records). [2025-09-19T17:52:05.028173] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-19T17:52:05.158914] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-19T17:52:05.437703] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-19T17:52:05.437828] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-19T17:52:05.438666] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-19T17:52:05.438730] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-19T17:52:05.440242] [DEBUG] [LOCAL ] CARR: Trimmed 77594 records to 54375 (keeping 200 days of data) [2025-09-19T17:52:05.443279] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-19T17:52:05.771967] [DEBUG] [LOCAL ] CARR: Primary data saved (54375 records). [2025-09-19T17:52:05.772137] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-19T17:52:05.772232] [INFO ] [MAIN ] Update Progress: 395/2372 symbols completed. CARR took 35.3s. Estimated remaining: 4h 20m 23s. Rate: 7.6 symbols/min [2025-09-19T17:52:05.941215] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:05.993806] [DEBUG] [LOCAL ] CAVA: Loaded 53942 existing records from primary storage. [2025-09-19T17:52:05.993957] [INFO ] [MAIN ] CAVA: Loaded 53942 existing records. [2025-09-19T17:52:06.186753] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:06.187080] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-19T17:52:06.187150] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-19T17:52:06.188228] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-19T17:52:06.188288] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-19T17:52:06.248551] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-19T17:52:06.586379] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:06.593870] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T17:52:07.043268] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-19T17:52:07.528238] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T17:52:07.534967] [INFO ] [REMOTE ] CARS: Full fetch complete (55356 records). [2025-09-19T17:52:07.535150] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-19T17:52:07.848328] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-19T17:52:07.976322] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-19T17:52:07.976414] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-19T17:52:07.977161] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-19T17:52:07.977245] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-19T17:52:07.978586] [DEBUG] [LOCAL ] CARS: Trimmed 55356 records to 41029 (keeping 200 days of data) [2025-09-19T17:52:08.226246] [DEBUG] [LOCAL ] CARS: Primary data saved (41029 records). [2025-09-19T17:52:08.226384] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-19T17:52:08.226472] [INFO ] [MAIN ] Update Progress: 396/2372 symbols completed. CARS took 37.3s. Estimated remaining: 4h 19m 48s. Rate: 7.6 symbols/min [2025-09-19T17:52:08.402356] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:08.455371] [DEBUG] [LOCAL ] CB: Loaded 50493 existing records from primary storage. [2025-09-19T17:52:08.455528] [INFO ] [MAIN ] CB: Loaded 50493 existing records. [2025-09-19T17:52:08.635758] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:08.636031] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-19T17:52:08.636080] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-19T17:52:08.637166] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-19T17:52:08.637226] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-19T17:52:08.668697] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-19T17:52:09.002301] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:09.009680] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T17:52:09.012910] [INFO ] [REMOTE ] CATO: Full fetch complete (12341 records). [2025-09-19T17:52:09.013494] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-19T17:52:09.399855] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-19T17:52:09.399934] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-19T17:52:09.400205] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-19T17:52:09.400242] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-19T17:52:09.400714] [DEBUG] [LOCAL ] CATO: Trimmed 12341 records to 7531 (keeping 200 days of data) [2025-09-19T17:52:09.443753] [DEBUG] [LOCAL ] CATO: Primary data saved (7531 records). [2025-09-19T17:52:09.444105] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-19T17:52:09.444261] [INFO ] [MAIN ] Update Progress: 397/2372 symbols completed. CATO took 21.6s. Estimated remaining: 4h 19m 7s. Rate: 7.6 symbols/min [2025-09-19T17:52:09.443908] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-19T17:52:09.474866] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-19T17:52:10.243276] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-19T17:52:11.066392] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-19T17:52:11.077600] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-19T17:52:11.742203] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T17:52:11.843317] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-19T17:52:12.419519] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T17:52:12.643288] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-19T17:52:12.999395] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T17:52:13.288627] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T17:52:13.443268] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-19T17:52:14.243358] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-19T17:52:14.931347] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T17:52:15.043231] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-19T17:52:15.755248] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:52:15.843268] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-19T17:52:15.878542] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T17:52:16.643266] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-19T17:52:17.563333] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-19T17:52:17.575560] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-19T17:52:18.231021] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T17:52:18.263604] [INFO ] [REMOTE ] CAT: Full fetch complete (76564 records). [2025-09-19T17:52:18.267532] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-19T17:52:18.269319] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:52:18.343251] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-19T17:52:18.734160] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-19T17:52:18.734246] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-19T17:52:18.735062] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-19T17:52:18.735126] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-19T17:52:18.736692] [DEBUG] [LOCAL ] CAT: Trimmed 76564 records to 53709 (keeping 200 days of data) [2025-09-19T17:52:19.090560] [DEBUG] [LOCAL ] CAT: Primary data saved (53709 records). [2025-09-19T17:52:19.090891] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-19T17:52:19.091202] [INFO ] [MAIN ] Update Progress: 398/2372 symbols completed. CAT took 44.4s. Estimated remaining: 4h 19m 8s. Rate: 7.6 symbols/min [2025-09-19T17:52:19.236628] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:52:19.248032] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-19T17:52:20.572303] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T17:52:20.583284] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-19T17:52:21.660763] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-19T17:52:21.671985] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-19T17:52:22.656145] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T17:52:22.666900] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-19T17:52:23.987185] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-19T17:52:23.998297] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-19T17:52:24.614143] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:52:24.624609] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-19T17:52:25.892076] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T17:52:25.903847] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-19T17:52:26.142749] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:52:26.153928] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-19T17:52:28.174237] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T17:52:28.187238] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-19T17:52:28.315989] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T17:52:28.328538] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-19T17:52:30.288910] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T17:52:30.301487] [INFO ] [REMOTE ] CB: Full fetch complete (72669 records). [2025-09-19T17:52:30.301713] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-19T17:52:30.703240] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-19T17:52:30.703355] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-19T17:52:30.704254] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-19T17:52:30.704419] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-19T17:52:30.706378] [DEBUG] [LOCAL ] CB: Trimmed 72669 records to 50868 (keeping 200 days of data) [2025-09-19T17:52:30.823989] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-19T17:52:30.842448] [INFO ] [REMOTE ] CAVA: Full fetch complete (77267 records). [2025-09-19T17:52:30.843357] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-19T17:52:31.254914] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-19T17:52:31.255223] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-19T17:52:31.256322] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-19T17:52:31.256712] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-19T17:52:31.261170] [DEBUG] [LOCAL ] CAVA: Trimmed 77267 records to 54332 (keeping 200 days of data) [2025-09-19T17:52:31.679301] [DEBUG] [LOCAL ] CB: Primary data saved (50868 records). [2025-09-19T17:52:31.680274] [INFO ] [MAIN ] CB: Full history saved. [2025-09-19T17:52:31.680401] [INFO ] [MAIN ] Update Progress: 399/2372 symbols completed. CB took 23.5s. Estimated remaining: 4h 19m 24s. Rate: 7.6 symbols/min [2025-09-19T17:52:31.791443] [DEBUG] [LOCAL ] CAVA: Primary data saved (54332 records). [2025-09-19T17:52:31.791610] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-19T17:52:31.791735] [INFO ] [MAIN ] Update Progress: 400/2372 symbols completed. CAVA took 26.0s. Estimated remaining: 4h 18m 37s. Rate: 7.6 symbols/min [2025-09-19T17:52:32.385934] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:32.451826] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:32.455398] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:32.478789] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-19T17:52:32.504301] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:32.504530] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-19T17:52:32.504837] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-19T17:52:32.504893] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-19T17:52:32.504940] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-19T17:52:32.504973] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-19T17:52:32.641381] [DEBUG] [LOCAL ] CBAN: Loaded 11306 existing records from primary storage. [2025-09-19T17:52:32.642216] [DEBUG] [LOCAL ] CBL: Loaded 16995 existing records from primary storage. [2025-09-19T17:52:32.641809] [INFO ] [MAIN ] CBAN: Loaded 11306 existing records. [2025-09-19T17:52:32.642778] [INFO ] [MAIN ] CBL: Loaded 16995 existing records. [2025-09-19T17:52:32.641599] [DEBUG] [LOCAL ] CBNA: Loaded 2970 existing records from primary storage. [2025-09-19T17:52:32.664234] [INFO ] [MAIN ] CBNA: Loaded 2970 existing records. [2025-09-19T17:52:33.348167] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:33.420720] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:33.420872] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-19T17:52:33.445251] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-19T17:52:33.460389] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-19T17:52:33.467154] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-19T17:52:33.471761] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-19T17:52:33.454598] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:33.471868] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-19T17:52:33.495005] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-19T17:52:33.503816] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:33.500729] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-19T17:52:33.522251] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-19T17:52:33.495068] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-19T17:52:33.528468] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-19T17:52:33.622849] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-19T17:52:33.668181] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-19T17:52:33.833538] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:33.915035] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-19T17:52:33.981564] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-19T17:52:34.420069] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:34.448751] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-19T17:52:34.536070] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:34.573158] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-19T17:52:34.576780] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:34.577179] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-19T17:52:34.577459] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-19T17:52:34.663574] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:34.663967] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-19T17:52:35.103002] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:35.103321] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-19T17:52:35.103813] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-19T17:52:35.345454] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T17:52:35.350358] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-19T17:52:35.506402] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T17:52:35.507298] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-19T17:52:35.548891] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T17:52:35.550630] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-19T17:52:35.676545] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T17:52:35.678712] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-19T17:52:35.755123] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-19T17:52:35.843252] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-19T17:52:36.096314] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:52:36.277210] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T17:52:36.315382] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-19T17:52:36.508272] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T17:52:36.643341] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-19T17:52:36.956590] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-19T17:52:37.443335] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-19T17:52:38.021734] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T17:52:38.243274] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-19T17:52:39.043302] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-19T17:52:39.274531] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T17:52:39.843229] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-19T17:52:40.354924] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T17:52:40.643279] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-19T17:52:40.876525] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-19T17:52:41.018482] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T17:52:41.443254] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-19T17:52:42.243268] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-19T17:52:42.490615] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:42.490968] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-19T17:52:42.507773] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T17:52:43.043290] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-19T17:52:43.843274] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-19T17:52:44.164137] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:44.164568] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-19T17:52:44.164700] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-19T17:52:44.164781] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-19T17:52:44.165520] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:52:44.165601] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:52:44.165686] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:52:44.165763] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-19T17:52:44.165831] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-19T17:52:44.165868] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-19T17:52:44.165974] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-19T17:52:44.166062] [INFO ] [MAIN ] Update Progress: 401/2372 symbols completed. CBO took 12.4s. Estimated remaining: 4h 18m 52s. Rate: 7.6 symbols/min [2025-09-19T17:52:44.364040] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:44.421433] [DEBUG] [LOCAL ] CBRE: Loaded 51090 existing records from primary storage. [2025-09-19T17:52:44.421588] [INFO ] [MAIN ] CBRE: Loaded 51090 existing records. [2025-09-19T17:52:44.627408] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:44.627774] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-19T17:52:44.627848] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-19T17:52:44.639133] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-19T17:52:44.639242] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-19T17:52:44.650735] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-19T17:52:44.700179] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:52:45.032711] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:45.443273] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-19T17:52:45.474602] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T17:52:46.243275] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-19T17:52:46.754671] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T17:52:47.043277] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-19T17:52:47.657892] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-19T17:52:47.843281] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-19T17:52:48.350179] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T17:52:48.555900] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T17:52:48.643302] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-19T17:52:49.443316] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-19T17:52:50.007251] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T17:52:50.183983] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:52:50.243245] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-19T17:52:51.043319] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-19T17:52:51.639100] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T17:52:51.843269] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-19T17:52:52.275941] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T17:52:52.643316] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-19T17:52:53.396073] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T17:52:53.443252] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-19T17:52:53.544671] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T17:52:54.243281] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-19T17:52:55.043334] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-19T17:52:55.349639] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T17:52:55.520083] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T17:52:55.573513] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T17:52:55.843344] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-19T17:52:56.643279] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-19T17:52:57.448437] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-19T17:52:57.467511] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:52:57.548924] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T17:52:58.083435] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T17:52:58.243294] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-19T17:52:58.998353] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T17:52:59.043279] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-19T17:52:59.843319] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-19T17:52:59.974295] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T17:53:00.643276] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-19T17:53:01.197764] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-19T17:53:01.443276] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-19T17:53:01.584745] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:53:01.918429] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T17:53:02.243279] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-19T17:53:03.043274] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-19T17:53:03.686218] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T17:53:03.701071] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T17:53:03.703529] [INFO ] [REMOTE ] CBNA: Full fetch complete (4808 records). [2025-09-19T17:53:03.704099] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-19T17:53:03.848439] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-19T17:53:04.121787] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-19T17:53:04.121874] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-19T17:53:04.122055] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-19T17:53:04.122133] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-19T17:53:04.122551] [DEBUG] [LOCAL ] CBNA: Trimmed 4808 records to 2982 (keeping 200 days of data) [2025-09-19T17:53:04.140045] [DEBUG] [LOCAL ] CBNA: Primary data saved (2982 records). [2025-09-19T17:53:04.140105] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-19T17:53:04.140214] [INFO ] [MAIN ] Update Progress: 402/2372 symbols completed. CBNA took 32.3s. Estimated remaining: 4h 19m 43s. Rate: 7.6 symbols/min [2025-09-19T17:53:04.307775] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:04.341221] [DEBUG] [LOCAL ] CBT: Loaded 31624 existing records from primary storage. [2025-09-19T17:53:04.341383] [INFO ] [MAIN ] CBT: Loaded 31624 existing records. [2025-09-19T17:53:04.517049] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:04.517275] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-19T17:53:04.517373] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-19T17:53:04.518336] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-19T17:53:04.518405] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-19T17:53:04.648512] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-19T17:53:04.899890] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:05.303958] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T17:53:05.443324] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-19T17:53:05.714050] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T17:53:05.716966] [INFO ] [REMOTE ] CBAN: Full fetch complete (15961 records). [2025-09-19T17:53:05.717045] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-19T17:53:06.080039] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-19T17:53:06.080120] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-19T17:53:06.080493] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-19T17:53:06.080533] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-19T17:53:06.081100] [DEBUG] [LOCAL ] CBAN: Trimmed 15961 records to 11389 (keeping 200 days of data) [2025-09-19T17:53:06.151414] [DEBUG] [LOCAL ] CBAN: Primary data saved (11389 records). [2025-09-19T17:53:06.151565] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-19T17:53:06.151673] [INFO ] [MAIN ] Update Progress: 403/2372 symbols completed. CBAN took 34.4s. Estimated remaining: 4h 19m 6s. Rate: 7.6 symbols/min [2025-09-19T17:53:06.249025] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-19T17:53:06.323475] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:06.349066] [DEBUG] [LOCAL ] CBU: Loaded 23167 existing records from primary storage. [2025-09-19T17:53:06.349244] [INFO ] [MAIN ] CBU: Loaded 23167 existing records. [2025-09-19T17:53:06.552540] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:06.552886] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-19T17:53:06.552950] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-19T17:53:06.553762] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-19T17:53:06.553833] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-19T17:53:06.964710] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:07.043269] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-19T17:53:07.137847] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T17:53:07.203813] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T17:53:07.206596] [INFO ] [REMOTE ] CBL: Full fetch complete (25824 records). [2025-09-19T17:53:07.206708] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-19T17:53:07.586339] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-19T17:53:07.586451] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-19T17:53:07.586947] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-19T17:53:07.587031] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-19T17:53:07.590339] [DEBUG] [LOCAL ] CBL: Trimmed 25824 records to 17100 (keeping 200 days of data) [2025-09-19T17:53:07.701131] [DEBUG] [LOCAL ] CBL: Primary data saved (17100 records). [2025-09-19T17:53:07.701271] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-19T17:53:07.701389] [INFO ] [MAIN ] Update Progress: 404/2372 symbols completed. CBL took 35.9s. Estimated remaining: 4h 18m 27s. Rate: 7.6 symbols/min [2025-09-19T17:53:07.850114] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-19T17:53:07.876016] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:07.877601] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-19T17:53:07.877690] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-19T17:53:07.877876] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-19T17:53:07.877934] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-19T17:53:07.877992] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-19T17:53:07.878062] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-19T17:53:08.248519] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:08.643303] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-19T17:53:08.855856] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T17:53:08.918730] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T17:53:08.927473] [INFO ] [REMOTE ] CBRE: Full fetch complete (73960 records). [2025-09-19T17:53:08.927633] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-19T17:53:09.333768] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-19T17:53:09.333871] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-19T17:53:09.334690] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-19T17:53:09.334770] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-19T17:53:09.336281] [DEBUG] [LOCAL ] CBRE: Trimmed 73960 records to 51439 (keeping 200 days of data) [2025-09-19T17:53:09.444681] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-19T17:53:09.654425] [DEBUG] [LOCAL ] CBRE: Primary data saved (51439 records). [2025-09-19T17:53:09.654605] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-19T17:53:09.654751] [INFO ] [MAIN ] Update Progress: 405/2372 symbols completed. CBRE took 25.5s. Estimated remaining: 4h 17m 51s. Rate: 7.6 symbols/min [2025-09-19T17:53:09.830918] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:09.869933] [DEBUG] [LOCAL ] CBZ: Loaded 33568 existing records from primary storage. [2025-09-19T17:53:09.870180] [INFO ] [MAIN ] CBZ: Loaded 33568 existing records. [2025-09-19T17:53:10.046183] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:10.046443] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-19T17:53:10.046491] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-19T17:53:10.047461] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-19T17:53:10.047532] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-19T17:53:10.250834] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-19T17:53:10.425714] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:10.437871] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:53:10.538554] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:10.538930] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-19T17:53:10.780435] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T17:53:11.043261] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-19T17:53:11.843273] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-19T17:53:12.036888] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T17:53:12.643267] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-19T17:53:13.198603] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T17:53:13.443242] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-19T17:53:13.577336] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T17:53:13.931419] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:13.931767] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-19T17:53:14.243285] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-19T17:53:15.043273] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-19T17:53:15.305919] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:15.306229] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-19T17:53:15.843281] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-19T17:53:15.957062] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:53:16.079165] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:16.079447] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-19T17:53:16.643270] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-19T17:53:17.443281] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-19T17:53:18.158681] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:53:18.243246] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-19T17:53:18.273966] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T17:53:19.043268] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-19T17:53:19.843282] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-19T17:53:19.880102] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T17:53:20.000409] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T17:53:20.069027] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:20.069395] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-19T17:53:20.643257] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-19T17:53:21.443317] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-19T17:53:22.213273] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:53:22.243264] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-19T17:53:22.492313] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T17:53:23.043264] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-19T17:53:23.332383] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-19T17:53:23.387371] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T17:53:23.843315] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-19T17:53:24.643303] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-19T17:53:24.964913] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T17:53:25.443263] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-19T17:53:26.126109] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T17:53:26.243287] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-19T17:53:26.991245] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T17:53:27.043268] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-19T17:53:27.058712] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T17:53:27.843261] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-19T17:53:28.550632] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T17:53:28.643260] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-19T17:53:28.723343] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T17:53:29.443265] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-19T17:53:29.524713] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-19T17:53:30.243275] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-19T17:53:30.972954] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T17:53:30.994603] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:53:31.043248] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-19T17:53:31.843294] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-19T17:53:32.084852] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:32.085288] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-19T17:53:32.145862] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T17:53:32.643299] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-19T17:53:33.002371] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:33.002838] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-19T17:53:33.002968] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-19T17:53:33.003058] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-19T17:53:33.003907] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:53:33.004005] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:53:33.004087] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:53:33.004176] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-19T17:53:33.004258] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-19T17:53:33.004325] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-19T17:53:33.004413] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-19T17:53:33.004512] [INFO ] [MAIN ] Update Progress: 406/2372 symbols completed. CBX took 25.3s. Estimated remaining: 4h 18m 58s. Rate: 7.6 symbols/min [2025-09-19T17:53:33.226133] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:33.304700] [DEBUG] [LOCAL ] CC: Loaded 53424 existing records from primary storage. [2025-09-19T17:53:33.304900] [INFO ] [MAIN ] CC: Loaded 53424 existing records. [2025-09-19T17:53:33.450632] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-19T17:53:33.493068] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:33.493361] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-19T17:53:33.493419] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-19T17:53:33.496294] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-19T17:53:33.496357] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-19T17:53:33.875024] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:34.243278] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-19T17:53:34.650711] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:53:35.043313] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-19T17:53:35.214894] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T17:53:35.843334] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-19T17:53:36.608196] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T17:53:36.643220] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-19T17:53:37.313454] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:53:37.443250] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-19T17:53:38.055071] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T17:53:38.058999] [INFO ] [REMOTE ] CBU: Full fetch complete (32050 records). [2025-09-19T17:53:38.059081] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-19T17:53:38.248587] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-19T17:53:38.430296] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-19T17:53:38.430380] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-19T17:53:38.430852] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-19T17:53:38.430912] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-19T17:53:38.431632] [DEBUG] [LOCAL ] CBU: Trimmed 32050 records to 23402 (keeping 200 days of data) [2025-09-19T17:53:38.591269] [DEBUG] [LOCAL ] CBU: Primary data saved (23402 records). [2025-09-19T17:53:38.591684] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-19T17:53:38.591798] [INFO ] [MAIN ] Update Progress: 407/2372 symbols completed. CBU took 32.4s. Estimated remaining: 4h 18m 39s. Rate: 7.6 symbols/min [2025-09-19T17:53:38.760553] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:38.829415] [DEBUG] [LOCAL ] CCI: Loaded 53549 existing records from primary storage. [2025-09-19T17:53:38.829557] [INFO ] [MAIN ] CCI: Loaded 53549 existing records. [2025-09-19T17:53:39.005874] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:39.006146] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-19T17:53:39.006194] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-19T17:53:39.008087] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-19T17:53:39.008149] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-19T17:53:39.050565] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-19T17:53:39.373658] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:39.402332] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T17:53:39.843251] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-19T17:53:39.925073] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T17:53:39.929544] [INFO ] [REMOTE ] CBT: Full fetch complete (45929 records). [2025-09-19T17:53:39.929627] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-19T17:53:40.307916] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-19T17:53:40.308022] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-19T17:53:40.308584] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-19T17:53:40.308623] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-19T17:53:40.309704] [DEBUG] [LOCAL ] CBT: Trimmed 45929 records to 31844 (keeping 200 days of data) [2025-09-19T17:53:40.506580] [DEBUG] [LOCAL ] CBT: Primary data saved (31844 records). [2025-09-19T17:53:40.506741] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-19T17:53:40.506834] [INFO ] [MAIN ] Update Progress: 408/2372 symbols completed. CBT took 36.4s. Estimated remaining: 4h 18m 2s. Rate: 7.6 symbols/min [2025-09-19T17:53:40.652160] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-19T17:53:40.677731] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:40.677862] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-19T17:53:40.677916] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-19T17:53:40.678052] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-19T17:53:40.678095] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-19T17:53:40.678136] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-19T17:53:40.678168] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-19T17:53:41.039879] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:41.060019] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T17:53:41.443284] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-19T17:53:41.685433] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T17:53:41.894281] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T17:53:42.243336] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-19T17:53:42.596091] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T17:53:43.043294] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-19T17:53:43.808367] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:53:43.843217] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-19T17:53:44.643271] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-19T17:53:45.065173] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T17:53:45.443267] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-19T17:53:45.815547] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T17:53:46.243280] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-19T17:53:46.352798] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T17:53:46.361509] [INFO ] [REMOTE ] CBZ: Full fetch complete (44497 records). [2025-09-19T17:53:46.361707] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-19T17:53:46.762542] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-19T17:53:46.762689] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-19T17:53:46.763278] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-19T17:53:46.763340] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-19T17:53:46.765519] [DEBUG] [LOCAL ] CBZ: Trimmed 44497 records to 33900 (keeping 200 days of data) [2025-09-19T17:53:46.975831] [DEBUG] [LOCAL ] CBZ: Primary data saved (33900 records). [2025-09-19T17:53:46.975997] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-19T17:53:46.976087] [INFO ] [MAIN ] Update Progress: 409/2372 symbols completed. CBZ took 37.3s. Estimated remaining: 4h 17m 47s. Rate: 7.6 symbols/min [2025-09-19T17:53:47.048756] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-19T17:53:47.159092] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:47.175839] [DEBUG] [LOCAL ] CCIF: Loaded 15358 existing records from primary storage. [2025-09-19T17:53:47.176028] [INFO ] [MAIN ] CCIF: Loaded 15358 existing records. [2025-09-19T17:53:47.378413] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:47.378955] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-19T17:53:47.379111] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-19T17:53:47.380079] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-19T17:53:47.380156] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-19T17:53:47.508415] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-19T17:53:47.834619] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:47.839751] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-19T17:53:47.851352] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-19T17:53:47.952595] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T17:53:48.643366] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-19T17:53:48.773494] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T17:53:49.053800] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T17:53:49.443300] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-19T17:53:50.243315] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-19T17:53:50.888764] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T17:53:51.043288] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-19T17:53:51.843302] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-19T17:53:52.416107] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:53:52.580960] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T17:53:52.643241] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-19T17:53:53.243149] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T17:53:53.304510] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T17:53:53.443298] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-19T17:53:53.932268] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-19T17:53:54.243290] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-19T17:53:55.043288] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-19T17:53:55.373929] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T17:53:55.843524] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-19T17:53:56.643294] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-19T17:53:57.037800] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:53:57.443303] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-19T17:53:57.490049] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T17:53:57.956673] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-19T17:53:58.243336] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-19T17:53:58.721883] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T17:53:59.043310] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-19T17:53:59.852805] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-19T17:53:59.877846] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T17:54:00.493475] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-19T17:54:00.643321] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-19T17:54:00.788836] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T17:54:00.797004] [INFO ] [REMOTE ] CC: Full fetch complete (75416 records). [2025-09-19T17:54:00.797192] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-19T17:54:01.125165] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-19T17:54:01.256230] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-19T17:54:01.256346] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-19T17:54:01.257242] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-19T17:54:01.257325] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-19T17:54:01.259001] [DEBUG] [LOCAL ] CC: Trimmed 75416 records to 53812 (keeping 200 days of data) [2025-09-19T17:54:01.444767] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-19T17:54:01.612070] [DEBUG] [LOCAL ] CC: Primary data saved (53812 records). [2025-09-19T17:54:01.612273] [INFO ] [MAIN ] CC: Full history saved. [2025-09-19T17:54:01.612378] [INFO ] [MAIN ] Update Progress: 410/2372 symbols completed. CC took 28.6s. Estimated remaining: 4h 18m 12s. Rate: 7.6 symbols/min [2025-09-19T17:54:01.791974] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:01.847559] [DEBUG] [LOCAL ] CCJ: Loaded 54065 existing records from primary storage. [2025-09-19T17:54:01.847798] [INFO ] [MAIN ] CCJ: Loaded 54065 existing records. [2025-09-19T17:54:02.033068] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:02.033365] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-19T17:54:02.033418] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-19T17:54:02.034784] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-19T17:54:02.034847] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-19T17:54:02.249783] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-19T17:54:02.425830] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:03.043304] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-19T17:54:03.843290] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-19T17:54:04.409568] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-09-19T17:54:04.433200] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T17:54:04.643281] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-19T17:54:05.160603] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T17:54:05.443287] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-19T17:54:05.771443] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-19T17:54:05.798171] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T17:54:05.995379] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T17:54:06.243269] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-19T17:54:06.661441] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-19T17:54:06.663026] [INFO ] [REMOTE ] CCIA: Full fetch complete (2022 records). [2025-09-19T17:54:06.663141] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-19T17:54:06.860739] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T17:54:06.860957] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:54:06.861032] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:54:06.861082] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-19T17:54:06.861144] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-19T17:54:06.861180] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-19T17:54:06.861244] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-19T17:54:06.861329] [INFO ] [MAIN ] Update Progress: 411/2372 symbols completed. CCIA took 26.4s. Estimated remaining: 4h 17m 51s. Rate: 7.6 symbols/min [2025-09-19T17:54:07.055618] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:07.048469] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-19T17:54:07.056021] [DEBUG] [LOCAL ] CCK: No existing data file found in primary storage. [2025-09-19T17:54:07.056986] [WARN ] [MAIN ] CCK: No existing data found, performing full refresh instead. [2025-09-19T17:54:07.057185] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-19T17:54:07.057239] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-19T17:54:07.057283] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-09-19T17:54:07.057316] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-19T17:54:07.426978] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:07.843268] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-19T17:54:08.643316] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-19T17:54:09.310740] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T17:54:09.443266] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-19T17:54:09.770420] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T17:54:10.243321] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-19T17:54:10.399183] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:54:10.812615] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:54:10.914849] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T17:54:11.043272] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-19T17:54:11.843273] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-19T17:54:12.643250] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-19T17:54:13.121601] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T17:54:13.148348] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:54:13.156802] [INFO ] [REMOTE ] CCI: Full fetch complete (76995 records). [2025-09-19T17:54:13.156943] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-19T17:54:13.452698] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-19T17:54:13.561693] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-19T17:54:13.561783] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-19T17:54:13.562733] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-19T17:54:13.562800] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-19T17:54:13.564331] [DEBUG] [LOCAL ] CCI: Trimmed 76995 records to 53934 (keeping 200 days of data) [2025-09-19T17:54:13.937361] [DEBUG] [LOCAL ] CCI: Primary data saved (53934 records). [2025-09-19T17:54:13.937528] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-19T17:54:13.937627] [INFO ] [MAIN ] Update Progress: 412/2372 symbols completed. CCI took 35.3s. Estimated remaining: 4h 17m 40s. Rate: 7.6 symbols/min [2025-09-19T17:54:14.108097] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:14.163859] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-09-19T17:54:14.164011] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-09-19T17:54:14.256715] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-19T17:54:14.357317] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:14.357582] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-19T17:54:14.357632] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-19T17:54:14.359019] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-19T17:54:14.359078] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-19T17:54:14.731083] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:15.043230] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-19T17:54:15.336630] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T17:54:15.339463] [INFO ] [REMOTE ] CCIF: Full fetch complete (21443 records). [2025-09-19T17:54:15.339541] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-19T17:54:15.710009] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-19T17:54:15.710114] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-19T17:54:15.710449] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-19T17:54:15.710523] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-19T17:54:15.711371] [DEBUG] [LOCAL ] CCIF: Trimmed 21443 records to 15474 (keeping 200 days of data) [2025-09-19T17:54:15.811934] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (3.17 seconds). [2025-09-19T17:54:15.840884] [DEBUG] [LOCAL ] CCIF: Primary data saved (15474 records). [2025-09-19T17:54:15.841031] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-19T17:54:15.841132] [INFO ] [MAIN ] Update Progress: 413/2372 symbols completed. CCIF took 28.9s. Estimated remaining: 4h 17m 3s. Rate: 7.6 symbols/min [2025-09-19T17:54:15.873374] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-19T17:54:16.021030] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:16.068202] [DEBUG] [LOCAL ] CCO: Loaded 47879 existing records from primary storage. [2025-09-19T17:54:16.068354] [INFO ] [MAIN ] CCO: Loaded 47879 existing records. [2025-09-19T17:54:16.246928] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:16.247148] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-19T17:54:16.247195] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-19T17:54:16.248567] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-19T17:54:16.248678] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-19T17:54:16.599472] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:16.643226] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-19T17:54:17.038364] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-19T17:54:17.443280] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-19T17:54:17.989249] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T17:54:18.074083] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:54:18.243270] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-19T17:54:18.570886] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (3.53 seconds). [2025-09-19T17:54:19.043280] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-19T17:54:19.423226] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:54:19.843262] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-19T17:54:20.037070] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:54:20.643269] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-19T17:54:21.443278] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-19T17:54:21.624442] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-19T17:54:21.735792] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T17:54:21.787357] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T17:54:22.243279] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-19T17:54:23.043309] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-19T17:54:23.141251] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T17:54:23.654229] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T17:54:23.843270] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-19T17:54:24.643263] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-19T17:54:25.211957] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T17:54:25.443263] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-19T17:54:26.243247] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-19T17:54:26.279128] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T17:54:26.392760] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:54:27.043326] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-19T17:54:27.843243] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-19T17:54:27.986437] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T17:54:28.119422] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-19T17:54:28.294111] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T17:54:28.643302] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-19T17:54:29.443324] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-19T17:54:30.243315] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-19T17:54:30.315866] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T17:54:30.581838] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:54:31.043268] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-19T17:54:31.227470] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T17:54:31.843289] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-19T17:54:32.643276] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-19T17:54:32.793542] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T17:54:32.985843] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-19T17:54:33.353821] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T17:54:33.443513] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-19T17:54:34.243312] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-19T17:54:35.043270] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-19T17:54:35.180079] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-19T17:54:35.309445] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T17:54:35.843277] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-19T17:54:36.020994] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-19T17:54:36.643265] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-19T17:54:37.443308] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-19T17:54:37.622883] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-19T17:54:37.675858] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T17:54:38.243290] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-19T17:54:38.547456] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T17:54:39.043268] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-19T17:54:39.449407] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T17:54:39.457061] [INFO ] [REMOTE ] CCK: Full fetch complete (67800 records). [2025-09-19T17:54:39.457202] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-19T17:54:39.852375] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-19T17:54:39.897854] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-19T17:54:39.897950] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-19T17:54:39.899019] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-19T17:54:39.899083] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-19T17:54:39.900811] [DEBUG] [LOCAL ] CCK: Trimmed 67800 records to 47277 (keeping 200 days of data) [2025-09-19T17:54:40.222265] [DEBUG] [LOCAL ] CCK: Primary data saved (47277 records). [2025-09-19T17:54:40.222424] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-19T17:54:40.222537] [INFO ] [MAIN ] Update Progress: 414/2372 symbols completed. CCK took 33.4s. Estimated remaining: 4h 18m 14s. Rate: 7.6 symbols/min [2025-09-19T17:54:40.411320] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:40.422509] [DEBUG] [LOCAL ] CCRD: Loaded 9003 existing records from primary storage. [2025-09-19T17:54:40.422688] [INFO ] [MAIN ] CCRD: Loaded 9003 existing records. [2025-09-19T17:54:40.606706] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:40.607150] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-19T17:54:40.607362] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-19T17:54:40.607853] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-19T17:54:40.608057] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-19T17:54:41.061634] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:41.062335] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-19T17:54:41.066125] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-19T17:54:41.219188] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T17:54:41.227944] [INFO ] [REMOTE ] CCJ: Full fetch complete (77680 records). [2025-09-19T17:54:41.228109] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-19T17:54:41.464473] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-19T17:54:41.666584] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-19T17:54:41.666722] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-19T17:54:41.667634] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-19T17:54:41.667731] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-19T17:54:41.669470] [DEBUG] [LOCAL ] CCJ: Trimmed 77680 records to 54455 (keeping 200 days of data) [2025-09-19T17:54:41.946950] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T17:54:41.958108] [INFO ] [REMOTE ] CCO: Full fetch complete (65980 records). [2025-09-19T17:54:41.959082] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-19T17:54:41.976580] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T17:54:42.259990] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-19T17:54:42.742158] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-19T17:54:42.743571] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-19T17:54:42.749681] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-19T17:54:42.756222] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-19T17:54:42.756112] [DEBUG] [LOCAL ] CCJ: Primary data saved (54455 records). [2025-09-19T17:54:42.756401] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-19T17:54:42.756881] [INFO ] [MAIN ] Update Progress: 415/2372 symbols completed. CCJ took 41.1s. Estimated remaining: 4h 17m 40s. Rate: 7.6 symbols/min [2025-09-19T17:54:42.884594] [DEBUG] [LOCAL ] CCO: Trimmed 65980 records to 48252 (keeping 200 days of data) [2025-09-19T17:54:43.095407] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:43.146568] [DEBUG] [LOCAL ] CCS: Loaded 30923 existing records from primary storage. [2025-09-19T17:54:43.147297] [INFO ] [MAIN ] CCS: Loaded 30923 existing records. [2025-09-19T17:54:43.351164] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:54:43.365625] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-19T17:54:43.430481] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:43.432339] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-19T17:54:43.432755] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-19T17:54:43.434260] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-19T17:54:43.435176] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-19T17:54:43.861685] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:43.862876] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-19T17:54:43.876788] [DEBUG] [LOCAL ] CCO: Primary data saved (48252 records). [2025-09-19T17:54:43.876899] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-19T17:54:43.877005] [INFO ] [MAIN ] Update Progress: 416/2372 symbols completed. CCO took 28.0s. Estimated remaining: 4h 17m 1s. Rate: 7.6 symbols/min [2025-09-19T17:54:44.047944] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:44.071830] [DEBUG] [LOCAL ] CCU: Loaded 24155 existing records from primary storage. [2025-09-19T17:54:44.072019] [INFO ] [MAIN ] CCU: Loaded 24155 existing records. [2025-09-19T17:54:44.256373] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T17:54:44.256486] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:44.258573] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-19T17:54:44.258634] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-19T17:54:44.259392] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-19T17:54:44.259452] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-19T17:54:44.629254] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:44.649204] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-19T17:54:44.665122] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (3.20 seconds). [2025-09-19T17:54:45.275908] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T17:54:45.443283] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-19T17:54:46.117756] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:54:46.243275] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-19T17:54:47.043269] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-19T17:54:47.123974] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T17:54:47.301723] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T17:54:47.843271] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-19T17:54:48.137129] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:54:48.643250] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-19T17:54:49.145336] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T17:54:49.443274] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-19T17:54:50.243313] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-19T17:54:50.768566] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T17:54:51.007976] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T17:54:51.043265] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-19T17:54:51.276253] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-19T17:54:51.284253] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-19T17:54:51.284385] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-19T17:54:51.682398] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-19T17:54:51.682508] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-19T17:54:51.683819] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-19T17:54:51.683942] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-19T17:54:51.686198] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54580 (keeping 200 days of data) [2025-09-19T17:54:51.871400] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-19T17:54:52.047189] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-09-19T17:54:52.047352] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-19T17:54:52.047507] [INFO ] [MAIN ] Update Progress: 417/2372 symbols completed. CCL took 38.1s. Estimated remaining: 4h 16m 54s. Rate: 7.6 symbols/min [2025-09-19T17:54:52.239755] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:52.239958] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-19T17:54:52.240011] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-19T17:54:52.240162] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-19T17:54:52.240205] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-19T17:54:52.240246] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-19T17:54:52.240290] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-19T17:54:52.645667] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:52.645791] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-19T17:54:52.681005] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T17:54:53.309551] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T17:54:53.443298] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-19T17:54:53.480878] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T17:54:53.874815] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-19T17:54:54.243322] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-19T17:54:54.513542] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-19T17:54:55.043283] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-19T17:54:55.843350] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-19T17:54:56.194970] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T17:54:56.643264] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-19T17:54:57.443276] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-19T17:54:57.562109] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T17:54:57.578886] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T17:54:58.243294] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-19T17:54:59.043268] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-19T17:54:59.137916] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T17:54:59.283692] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T17:54:59.843286] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-19T17:55:00.252444] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T17:55:00.643308] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-19T17:55:00.689036] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T17:55:01.443297] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-19T17:55:02.194753] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:55:02.243255] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-19T17:55:02.423507] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T17:55:03.043292] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-19T17:55:03.269670] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T17:55:03.271631] [INFO ] [REMOTE ] CCRD: Full fetch complete (12101 records). [2025-09-19T17:55:03.271807] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-19T17:55:03.337357] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-19T17:55:03.645339] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-19T17:55:03.645444] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-19T17:55:03.645770] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-19T17:55:03.645842] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-19T17:55:03.646490] [DEBUG] [LOCAL ] CCRD: Trimmed 12101 records to 9103 (keeping 200 days of data) [2025-09-19T17:55:03.706361] [DEBUG] [LOCAL ] CCRD: Primary data saved (9103 records). [2025-09-19T17:55:03.706521] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-19T17:55:03.706637] [INFO ] [MAIN ] Update Progress: 418/2372 symbols completed. CCRD took 23.5s. Estimated remaining: 4h 17m 4s. Rate: 7.6 symbols/min [2025-09-19T17:55:03.852683] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-19T17:55:03.881089] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:03.945323] [DEBUG] [LOCAL ] CDE: Loaded 54031 existing records from primary storage. [2025-09-19T17:55:03.945491] [INFO ] [MAIN ] CDE: Loaded 54031 existing records. [2025-09-19T17:55:04.132321] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:04.132755] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-19T17:55:04.132840] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-19T17:55:04.134597] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-19T17:55:04.134706] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-19T17:55:04.248074] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T17:55:04.501130] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:04.643306] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-19T17:55:05.443288] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-19T17:55:06.243276] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-19T17:55:06.945630] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T17:55:07.051879] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-19T17:55:07.059327] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:55:07.416337] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-19T17:55:07.502726] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T17:55:07.843372] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-19T17:55:08.643287] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-19T17:55:09.044003] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T17:55:09.047375] [INFO ] [REMOTE ] CCU: Full fetch complete (33333 records). [2025-09-19T17:55:09.047489] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-19T17:55:09.446676] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-19T17:55:09.456565] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-19T17:55:09.456666] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-19T17:55:09.457293] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-19T17:55:09.457426] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-19T17:55:09.458465] [DEBUG] [LOCAL ] CCU: Trimmed 33333 records to 24340 (keeping 200 days of data) [2025-09-19T17:55:09.605678] [DEBUG] [LOCAL ] CCU: Primary data saved (24340 records). [2025-09-19T17:55:09.605813] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-19T17:55:09.605921] [INFO ] [MAIN ] Update Progress: 419/2372 symbols completed. CCU took 25.7s. Estimated remaining: 4h 16m 47s. Rate: 7.6 symbols/min [2025-09-19T17:55:09.758110] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-19T17:55:09.786537] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:09.786767] [DEBUG] [LOCAL ] CDLR: No existing data file found in primary storage. [2025-09-19T17:55:09.786822] [WARN ] [MAIN ] CDLR: No existing data found, performing full refresh instead. [2025-09-19T17:55:09.786974] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-19T17:55:09.787206] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-19T17:55:09.787248] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-09-19T17:55:09.787280] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-19T17:55:10.195245] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:10.243287] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-19T17:55:10.774293] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T17:55:11.043282] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-19T17:55:11.300123] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:55:11.300443] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-19T17:55:11.843244] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-19T17:55:11.943685] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T17:55:12.643283] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-19T17:55:13.139920] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T17:55:13.443267] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-19T17:55:13.693702] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-19T17:55:14.243269] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-19T17:55:14.645347] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T17:55:15.043261] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-19T17:55:15.540628] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T17:55:15.805005] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:55:15.843374] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-19T17:55:16.643271] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-19T17:55:17.314839] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T17:55:17.406432] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T17:55:17.443414] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-19T17:55:18.159986] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T17:55:18.243219] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-19T17:55:19.043268] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-19T17:55:19.401138] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-19T17:55:19.401859] [INFO ] [REMOTE ] CCZ: Full fetch complete (142 records). [2025-09-19T17:55:19.401960] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-19T17:55:19.402390] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:55:19.402474] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:55:19.402529] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:55:19.402608] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-19T17:55:19.402725] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-19T17:55:19.402804] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-19T17:55:19.402886] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-19T17:55:19.402992] [INFO ] [MAIN ] Update Progress: 420/2372 symbols completed. CCZ took 27.4s. Estimated remaining: 4h 16m 48s. Rate: 7.6 symbols/min [2025-09-19T17:55:19.590682] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:19.591969] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T17:55:19.654983] [DEBUG] [LOCAL ] CDP: Loaded 43105 existing records from primary storage. [2025-09-19T17:55:19.655138] [INFO ] [MAIN ] CDP: Loaded 43105 existing records. [2025-09-19T17:55:19.834295] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:19.834557] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-19T17:55:19.834604] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-19T17:55:19.835612] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-19T17:55:19.835716] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-19T17:55:19.848324] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-19T17:55:20.235044] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:20.643284] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-19T17:55:21.222976] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T17:55:21.443278] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-19T17:55:22.243264] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-19T17:55:22.605911] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-19T17:55:23.043289] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-19T17:55:23.110002] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T17:55:23.117727] [INFO ] [REMOTE ] CCS: Full fetch complete (44598 records). [2025-09-19T17:55:23.117908] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-19T17:55:23.365105] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T17:55:23.539935] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-19T17:55:23.540048] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-19T17:55:23.540755] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-19T17:55:23.540819] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-19T17:55:23.544593] [DEBUG] [LOCAL ] CCS: Trimmed 44598 records to 31164 (keeping 200 days of data) [2025-09-19T17:55:23.770711] [DEBUG] [LOCAL ] CCS: Primary data saved (31164 records). [2025-09-19T17:55:23.770881] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-19T17:55:23.771007] [INFO ] [MAIN ] Update Progress: 421/2372 symbols completed. CCS took 41.0s. Estimated remaining: 4h 16m 23s. Rate: 7.6 symbols/min [2025-09-19T17:55:23.848591] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-19T17:55:24.040097] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:24.079259] [DEBUG] [LOCAL ] CDRE: Loaded 25336 existing records from primary storage. [2025-09-19T17:55:24.079435] [INFO ] [MAIN ] CDRE: Loaded 25336 existing records. [2025-09-19T17:55:24.275158] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:24.275891] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-19T17:55:24.275946] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-19T17:55:24.277083] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-19T17:55:24.277146] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-19T17:55:24.646907] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-19T17:55:24.711266] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:24.738133] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T17:55:24.858427] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T17:55:25.443309] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-19T17:55:26.243304] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-19T17:55:26.369285] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T17:55:27.043270] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-19T17:55:27.342543] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T17:55:27.751525] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T17:55:27.843270] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-19T17:55:27.924205] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T17:55:28.421450] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T17:55:28.643308] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-19T17:55:29.443265] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-19T17:55:29.666247] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T17:55:29.668046] [INFO ] [REMOTE ] CDLR: Full fetch complete (13151 records). [2025-09-19T17:55:29.668120] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-19T17:55:30.060674] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-19T17:55:30.060809] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-19T17:55:30.061193] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-19T17:55:30.061237] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-19T17:55:30.062446] [DEBUG] [LOCAL ] CDLR: Trimmed 13151 records to 10376 (keeping 200 days of data) [2025-09-19T17:55:30.127571] [DEBUG] [LOCAL ] CDLR: Primary data saved (10376 records). [2025-09-19T17:55:30.127731] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-19T17:55:30.127819] [INFO ] [MAIN ] Update Progress: 422/2372 symbols completed. CDLR took 20.5s. Estimated remaining: 4h 16m 8s. Rate: 7.6 symbols/min [2025-09-19T17:55:30.248367] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-19T17:55:30.312287] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:30.380365] [DEBUG] [LOCAL ] CE: Loaded 51968 existing records from primary storage. [2025-09-19T17:55:30.380522] [INFO ] [MAIN ] CE: Loaded 51968 existing records. [2025-09-19T17:55:30.558737] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:30.559017] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-19T17:55:30.559065] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-19T17:55:30.561366] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-19T17:55:30.561426] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-19T17:55:30.925968] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:30.942710] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T17:55:31.043224] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-19T17:55:31.843327] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-19T17:55:32.381733] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-19T17:55:32.643288] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-19T17:55:33.159731] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T17:55:33.443308] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-19T17:55:33.668217] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:55:34.248426] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-19T17:55:34.268348] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T17:55:34.835696] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T17:55:35.043232] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-19T17:55:35.349540] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T17:55:35.843289] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-19T17:55:36.643279] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-19T17:55:37.001210] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:55:37.443326] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-19T17:55:37.719872] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:55:38.243301] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-19T17:55:38.502672] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:55:39.043314] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-19T17:55:39.554348] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T17:55:39.843284] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-19T17:55:40.170713] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T17:55:40.643261] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-19T17:55:40.720994] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T17:55:41.443272] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-19T17:55:41.925104] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T17:55:42.186418] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T17:55:42.243287] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-19T17:55:42.929916] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T17:55:43.043249] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-19T17:55:43.843303] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-19T17:55:44.010001] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T17:55:44.643297] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-19T17:55:45.154228] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:55:45.164435] [INFO ] [REMOTE ] CDE: Full fetch complete (77574 records). [2025-09-19T17:55:45.164819] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-19T17:55:45.454685] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-19T17:55:45.618061] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T17:55:45.618203] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-19T17:55:45.623667] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-19T17:55:45.625067] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-19T17:55:45.625492] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-19T17:55:45.627010] [DEBUG] [LOCAL ] CDE: Trimmed 77574 records to 54421 (keeping 200 days of data) [2025-09-19T17:55:45.969601] [DEBUG] [LOCAL ] CDE: Primary data saved (54421 records). [2025-09-19T17:55:45.969878] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-19T17:55:45.971707] [INFO ] [MAIN ] Update Progress: 423/2372 symbols completed. CDE took 42.3s. Estimated remaining: 4h 16m 37s. Rate: 7.6 symbols/min [2025-09-19T17:55:46.159569] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:46.169706] [DEBUG] [LOCAL ] CEE: Loaded 7051 existing records from primary storage. [2025-09-19T17:55:46.169844] [INFO ] [MAIN ] CEE: Loaded 7051 existing records. [2025-09-19T17:55:46.249135] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-19T17:55:46.361190] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:46.361535] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-19T17:55:46.361586] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-19T17:55:46.361958] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-19T17:55:46.362020] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-19T17:55:46.747284] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:46.780606] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T17:55:46.815434] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:55:47.043265] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-19T17:55:47.217173] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T17:55:47.830121] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T17:55:47.843225] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-19T17:55:48.347186] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T17:55:48.643270] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-19T17:55:49.443268] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-19T17:55:50.243272] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-19T17:55:50.486137] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T17:55:50.861494] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T17:55:51.043265] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-19T17:55:51.279241] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T17:55:51.843298] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-19T17:55:52.643237] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-19T17:55:52.699983] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T17:55:53.003728] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T17:55:53.443455] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-19T17:55:54.091019] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T17:55:54.106288] [INFO ] [REMOTE ] CDP: Full fetch complete (61839 records). [2025-09-19T17:55:54.106590] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-19T17:55:54.251108] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-19T17:55:54.495260] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T17:55:54.726842] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-19T17:55:54.726992] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-19T17:55:54.728205] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-19T17:55:54.728297] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-19T17:55:54.730216] [DEBUG] [LOCAL ] CDP: Trimmed 61839 records to 43402 (keeping 200 days of data) [2025-09-19T17:55:55.043388] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-19T17:55:55.072277] [DEBUG] [LOCAL ] CDP: Primary data saved (43402 records). [2025-09-19T17:55:55.072433] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-19T17:55:55.072555] [INFO ] [MAIN ] Update Progress: 424/2372 symbols completed. CDP took 35.7s. Estimated remaining: 4h 16m 35s. Rate: 7.6 symbols/min [2025-09-19T17:55:55.272932] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:55.299473] [DEBUG] [LOCAL ] CEPU: Loaded 25891 existing records from primary storage. [2025-09-19T17:55:55.299673] [INFO ] [MAIN ] CEPU: Loaded 25891 existing records. [2025-09-19T17:55:55.508524] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:55.508820] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-19T17:55:55.508885] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-19T17:55:55.509609] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-19T17:55:55.509732] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-19T17:55:55.847521] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-19T17:55:55.881522] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:55.887161] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T17:55:56.323700] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T17:55:56.643308] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-19T17:55:56.823826] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T17:55:57.079829] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-19T17:55:57.443300] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-19T17:55:58.243276] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-19T17:55:58.957818] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T17:55:59.043265] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-19T17:55:59.258154] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T17:55:59.843264] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-19T17:56:00.226570] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:56:00.431885] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:56:00.643293] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-19T17:56:01.443298] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-19T17:56:01.567866] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T17:56:02.243285] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-19T17:56:02.834116] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T17:56:03.043323] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-19T17:56:03.683594] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:56:03.843341] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-19T17:56:04.630347] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T17:56:04.631764] [INFO ] [REMOTE ] CEE: Full fetch complete (10200 records). [2025-09-19T17:56:04.631868] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-19T17:56:04.648395] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-19T17:56:05.062541] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-19T17:56:05.062682] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-19T17:56:05.063087] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-19T17:56:05.063190] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-19T17:56:05.064894] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:56:05.071706] [DEBUG] [LOCAL ] CEE: Trimmed 10200 records to 7099 (keeping 200 days of data) [2025-09-19T17:56:05.072755] [INFO ] [REMOTE ] CE: Full fetch complete (74887 records). [2025-09-19T17:56:05.072844] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-19T17:56:05.218393] [DEBUG] [LOCAL ] CEE: Primary data saved (7099 records). [2025-09-19T17:56:05.229376] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-19T17:56:05.234615] [INFO ] [MAIN ] Update Progress: 425/2372 symbols completed. CEE took 19.3s. Estimated remaining: 4h 16m 37s. Rate: 7.6 symbols/min [2025-09-19T17:56:05.443678] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-19T17:56:05.634850] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:05.739131] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-19T17:56:05.739215] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-19T17:56:05.740746] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-19T17:56:05.740811] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-19T17:56:05.742664] [DEBUG] [LOCAL ] CE: Trimmed 74887 records to 52344 (keeping 200 days of data) [2025-09-19T17:56:05.875605] [DEBUG] [LOCAL ] CF: Loaded 52631 existing records from primary storage. [2025-09-19T17:56:05.877042] [INFO ] [MAIN ] CF: Loaded 52631 existing records. [2025-09-19T17:56:06.079692] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:06.082365] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-19T17:56:06.082973] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-19T17:56:06.085106] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-19T17:56:06.085219] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-19T17:56:06.525981] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:56:06.601986] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:06.602686] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-19T17:56:06.617623] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T17:56:06.623213] [INFO ] [REMOTE ] CDRE: Full fetch complete (35647 records). [2025-09-19T17:56:06.624209] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-19T17:56:07.040520] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-19T17:56:07.040939] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-19T17:56:07.041873] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-19T17:56:07.042254] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-19T17:56:07.043537] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-19T17:56:07.047125] [DEBUG] [LOCAL ] CDRE: Trimmed 35647 records to 25538 (keeping 200 days of data) [2025-09-19T17:56:07.259523] [DEBUG] [LOCAL ] CE: Primary data saved (52344 records). [2025-09-19T17:56:07.260218] [INFO ] [MAIN ] CE: Full history saved. [2025-09-19T17:56:07.260620] [INFO ] [MAIN ] Update Progress: 426/2372 symbols completed. CE took 37.1s. Estimated remaining: 4h 16m 2s. Rate: 7.6 symbols/min [2025-09-19T17:56:07.472185] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:07.473236] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-09-19T17:56:07.473304] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-09-19T17:56:07.473544] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-19T17:56:07.479028] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-19T17:56:07.480334] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-09-19T17:56:07.480474] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-19T17:56:07.480410] [DEBUG] [LOCAL ] CDRE: Primary data saved (25538 records). [2025-09-19T17:56:07.485734] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-19T17:56:07.529355] [INFO ] [MAIN ] Update Progress: 427/2372 symbols completed. CDRE took 43.8s. Estimated remaining: 4h 15m 20s. Rate: 7.6 symbols/min [2025-09-19T17:56:07.916043] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:07.945996] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-19T17:56:07.957600] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-19T17:56:07.981384] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-19T17:56:07.981502] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-19T17:56:07.992283] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-19T17:56:08.002831] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-19T17:56:08.117481] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:08.167408] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-19T17:56:08.281577] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T17:56:08.502791] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:08.535769] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T17:56:08.643258] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-19T17:56:08.850793] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:08.851198] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-19T17:56:09.443282] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-19T17:56:09.680876] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:09.681217] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-19T17:56:09.892153] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T17:56:10.243267] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-19T17:56:11.043264] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-19T17:56:11.344946] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T17:56:11.843272] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-19T17:56:12.073949] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:12.074318] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-19T17:56:12.643261] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-19T17:56:12.986337] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T17:56:13.409609] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T17:56:13.443242] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-19T17:56:14.243266] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-19T17:56:15.043272] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-19T17:56:15.620434] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:15.620789] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-19T17:56:15.646315] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T17:56:15.700518] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T17:56:15.843246] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-19T17:56:16.069939] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:16.070363] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-19T17:56:16.643273] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-19T17:56:17.443260] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-19T17:56:18.243262] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-19T17:56:18.628480] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:18.628851] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-19T17:56:18.679175] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T17:56:19.043259] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-19T17:56:19.348745] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:56:19.843256] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-19T17:56:20.643307] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-19T17:56:20.896534] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:20.896905] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-19T17:56:20.986244] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T17:56:21.443254] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-19T17:56:21.682973] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:21.683290] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-19T17:56:22.248516] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-19T17:56:22.280064] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T17:56:23.043274] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-19T17:56:23.792869] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:56:23.843314] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-19T17:56:23.989937] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T17:56:24.643291] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-19T17:56:25.419933] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:56:25.425724] [INFO ] [REMOTE ] CEPU: Full fetch complete (39666 records). [2025-09-19T17:56:25.426077] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-19T17:56:25.449188] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-19T17:56:25.616609] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T17:56:25.664509] [INFO ] [REMOTE ] CFND: Full fetch complete (2457 records). [2025-09-19T17:56:25.675407] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-19T17:56:26.042050] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-19T17:56:26.042270] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-19T17:56:26.043275] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-19T17:56:26.041763] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 31 unique days, need 200 days [2025-09-19T17:56:26.043545] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-19T17:56:26.043453] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:56:26.043962] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:56:26.044086] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-19T17:56:26.044514] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-19T17:56:26.044591] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-19T17:56:26.044768] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-19T17:56:26.044887] [INFO ] [MAIN ] Update Progress: 428/2372 symbols completed. CFND took 18.5s. Estimated remaining: 4h 16m 0s. Rate: 7.6 symbols/min [2025-09-19T17:56:26.142785] [DEBUG] [LOCAL ] CEPU: Trimmed 39666 records to 26208 (keeping 200 days of data) [2025-09-19T17:56:26.257754] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-19T17:56:26.338019] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:26.400703] [DEBUG] [LOCAL ] CFR: Loaded 33951 existing records from primary storage. [2025-09-19T17:56:26.401397] [INFO ] [MAIN ] CFR: Loaded 33951 existing records. [2025-09-19T17:56:26.629311] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:26.631857] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-19T17:56:26.633230] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-19T17:56:26.634891] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-19T17:56:26.635601] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-19T17:56:26.702817] [DEBUG] [LOCAL ] CEPU: Primary data saved (26208 records). [2025-09-19T17:56:26.714314] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-19T17:56:26.730286] [INFO ] [MAIN ] Update Progress: 429/2372 symbols completed. CEPU took 31.7s. Estimated remaining: 4h 15m 20s. Rate: 7.6 symbols/min [2025-09-19T17:56:27.109232] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:27.199340] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:27.200106] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-19T17:56:27.240845] [DEBUG] [LOCAL ] CGAU: Loaded 42806 existing records from primary storage. [2025-09-19T17:56:27.240995] [INFO ] [MAIN ] CGAU: Loaded 42806 existing records. [2025-09-19T17:56:27.477231] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:27.477700] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-19T17:56:27.477863] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-19T17:56:27.479016] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-19T17:56:27.479082] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-19T17:56:27.892346] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T17:56:27.890242] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:27.903204] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-19T17:56:28.020875] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:56:28.349223] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T17:56:28.643284] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-19T17:56:29.196462] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T17:56:29.443263] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-19T17:56:30.190820] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T17:56:30.243263] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-19T17:56:31.043269] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-19T17:56:31.100718] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T17:56:31.843281] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-19T17:56:31.925821] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T17:56:32.643280] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-19T17:56:32.981181] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:56:33.443251] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-19T17:56:33.550092] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T17:56:34.243260] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-19T17:56:34.656735] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:56:35.043266] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-19T17:56:35.623630] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:56:35.837999] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T17:56:35.850072] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-19T17:56:36.643270] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-19T17:56:37.108564] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T17:56:37.443258] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-19T17:56:37.643132] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T17:56:37.895084] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T17:56:38.243264] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-19T17:56:38.543007] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T17:56:39.043275] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-19T17:56:39.400115] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T17:56:39.843261] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-19T17:56:40.643236] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-19T17:56:41.192191] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T17:56:41.200558] [INFO ] [REMOTE ] CF: Full fetch complete (75115 records). [2025-09-19T17:56:41.200723] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-19T17:56:41.449119] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-19T17:56:41.615386] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-19T17:56:41.615477] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-19T17:56:41.616361] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-19T17:56:41.616448] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-19T17:56:41.618078] [DEBUG] [LOCAL ] CF: Trimmed 75115 records to 53014 (keeping 200 days of data) [2025-09-19T17:56:41.886453] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T17:56:41.987358] [DEBUG] [LOCAL ] CF: Primary data saved (53014 records). [2025-09-19T17:56:41.987496] [INFO ] [MAIN ] CF: Full history saved. [2025-09-19T17:56:41.987581] [INFO ] [MAIN ] Update Progress: 430/2372 symbols completed. CF took 36.7s. Estimated remaining: 4h 15m 45s. Rate: 7.6 symbols/min [2025-09-19T17:56:42.161221] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:42.164792] [DEBUG] [LOCAL ] CGV: Loaded 1446 existing records from primary storage. [2025-09-19T17:56:42.164866] [INFO ] [MAIN ] CGV: Loaded 1446 existing records. [2025-09-19T17:56:42.254171] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-19T17:56:42.343918] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:42.344206] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-19T17:56:42.344256] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-19T17:56:42.344462] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-19T17:56:42.344523] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-19T17:56:42.715746] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:42.745381] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T17:56:43.043300] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-19T17:56:43.253693] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:56:43.843255] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-19T17:56:44.393180] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T17:56:44.423001] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T17:56:44.421713] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-19T17:56:44.431002] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-19T17:56:44.649955] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-19T17:56:44.862351] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-19T17:56:44.862473] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-19T17:56:44.863402] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-19T17:56:44.863473] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-19T17:56:44.865160] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54404 (keeping 200 days of data) [2025-09-19T17:56:45.210062] [DEBUG] [LOCAL ] CFG: Primary data saved (54404 records). [2025-09-19T17:56:45.210250] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-19T17:56:45.210382] [INFO ] [MAIN ] Update Progress: 431/2372 symbols completed. CFG took 37.9s. Estimated remaining: 4h 15m 16s. Rate: 7.6 symbols/min [2025-09-19T17:56:45.403381] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:45.427524] [DEBUG] [LOCAL ] CHCT: Loaded 24304 existing records from primary storage. [2025-09-19T17:56:45.427709] [INFO ] [MAIN ] CHCT: Loaded 24304 existing records. [2025-09-19T17:56:45.458540] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-19T17:56:45.619331] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:45.619585] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-19T17:56:45.619661] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-19T17:56:45.620326] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-19T17:56:45.620390] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-19T17:56:46.005437] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:46.025966] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T17:56:46.110380] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T17:56:46.243309] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-19T17:56:46.512197] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T17:56:47.043338] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-19T17:56:47.258476] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T17:56:47.843275] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-19T17:56:48.467579] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T17:56:48.643312] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-19T17:56:49.443365] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-19T17:56:49.651598] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:56:49.755279] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:56:50.243332] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-19T17:56:50.261774] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T17:56:51.043309] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-19T17:56:51.843285] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-19T17:56:52.129266] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:56:52.246560] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:56:52.643275] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-19T17:56:52.689846] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T17:56:53.155674] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-19T17:56:53.443265] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-19T17:56:54.243273] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-19T17:56:54.798668] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T17:56:55.009998] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T17:56:55.017775] [INFO ] [REMOTE ] CGAU: Full fetch complete (60353 records). [2025-09-19T17:56:55.017963] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-19T17:56:55.050782] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-19T17:56:55.444905] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-19T17:56:55.445050] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-19T17:56:55.445834] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-19T17:56:55.445899] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-19T17:56:55.447271] [DEBUG] [LOCAL ] CGAU: Trimmed 60353 records to 43183 (keeping 200 days of data) [2025-09-19T17:56:55.703236] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-19T17:56:55.709530] [DEBUG] [LOCAL ] CGAU: Primary data saved (43183 records). [2025-09-19T17:56:55.709621] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-19T17:56:55.709753] [INFO ] [MAIN ] Update Progress: 432/2372 symbols completed. CGAU took 29.0s. Estimated remaining: 4h 15m 20s. Rate: 7.6 symbols/min [2025-09-19T17:56:55.848348] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-19T17:56:55.897548] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:55.955907] [DEBUG] [LOCAL ] CHD: Loaded 52379 existing records from primary storage. [2025-09-19T17:56:55.956068] [INFO ] [MAIN ] CHD: Loaded 52379 existing records. [2025-09-19T17:56:56.146911] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:56.147338] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-19T17:56:56.147397] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-19T17:56:56.149638] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-19T17:56:56.149754] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-19T17:56:56.427365] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T17:56:56.534417] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:56.643229] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-19T17:56:57.443264] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-19T17:56:58.243272] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-19T17:56:58.414290] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T17:56:58.533149] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-19T17:56:58.680297] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T17:56:59.043283] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-19T17:56:59.843263] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-19T17:57:00.643272] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-19T17:57:00.984014] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-19T17:57:01.060557] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T17:57:01.215771] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T17:57:01.443278] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-19T17:57:02.243276] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-19T17:57:03.043272] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-19T17:57:03.611778] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T17:57:03.843267] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-19T17:57:04.643283] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-19T17:57:04.872401] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T17:57:05.443236] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-19T17:57:05.496989] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (3.25 seconds). [2025-09-19T17:57:06.026678] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T17:57:06.027464] [INFO ] [REMOTE ] CGV: Full fetch complete (2263 records). [2025-09-19T17:57:06.027544] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-19T17:57:06.027938] [FATAL] [VALIDATOR ] CGV: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:57:06.028024] [FATAL] [MAIN ] CGV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:57:06.028069] [WARN ] [MAIN ] CGV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:57:06.028136] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-19T17:57:06.028226] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-19T17:57:06.028285] [INFO ] [LOCAL ] CGV: Starting deletion of derivative data. [2025-09-19T17:57:06.028737] [DEBUG] [LOCAL ] CGV: Deleted derivative data file. [2025-09-19T17:57:06.028832] [INFO ] [MAIN ] Update Progress: 433/2372 symbols completed. CGV took 24.0s. Estimated remaining: 4h 15m 23s. Rate: 7.6 symbols/min [2025-09-19T17:57:06.212242] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:06.230258] [DEBUG] [LOCAL ] CHE: Loaded 14730 existing records from primary storage. [2025-09-19T17:57:06.230405] [INFO ] [MAIN ] CHE: Loaded 14730 existing records. [2025-09-19T17:57:06.263079] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-19T17:57:06.446053] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:06.446386] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-19T17:57:06.446693] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-19T17:57:06.448315] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-19T17:57:06.456936] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-19T17:57:06.457042] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-19T17:57:06.720462] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T17:57:06.851280] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:07.043266] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-19T17:57:07.843273] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-19T17:57:08.113827] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:57:08.643264] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-19T17:57:08.873238] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:57:08.879349] [INFO ] [REMOTE ] CFR: Full fetch complete (48463 records). [2025-09-19T17:57:08.879489] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-19T17:57:09.257695] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T17:57:09.306914] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-19T17:57:09.306998] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-19T17:57:09.307615] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-19T17:57:09.307687] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-19T17:57:09.308721] [DEBUG] [LOCAL ] CFR: Trimmed 48463 records to 34170 (keeping 200 days of data) [2025-09-19T17:57:09.445039] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-19T17:57:09.537755] [DEBUG] [LOCAL ] CFR: Primary data saved (34170 records). [2025-09-19T17:57:09.537889] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-19T17:57:09.538028] [INFO ] [MAIN ] Update Progress: 434/2372 symbols completed. CFR took 43.5s. Estimated remaining: 4h 14m 55s. Rate: 7.6 symbols/min [2025-09-19T17:57:09.710477] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:09.761019] [DEBUG] [LOCAL ] CHGG: Loaded 48206 existing records from primary storage. [2025-09-19T17:57:09.761180] [INFO ] [MAIN ] CHGG: Loaded 48206 existing records. [2025-09-19T17:57:09.940519] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:09.940810] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-19T17:57:09.940866] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-19T17:57:09.941912] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-19T17:57:09.941975] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-19T17:57:10.248407] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-19T17:57:10.308105] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:10.548088] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T17:57:10.817400] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:57:10.957507] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T17:57:11.043232] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-19T17:57:11.843261] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-19T17:57:12.643243] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-19T17:57:12.676187] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:57:13.313193] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:57:13.316908] [INFO ] [REMOTE ] CHCT: Full fetch complete (35150 records). [2025-09-19T17:57:13.317023] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-19T17:57:13.446168] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-19T17:57:13.580335] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T17:57:13.737828] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-19T17:57:13.737938] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-19T17:57:13.738492] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-19T17:57:13.738544] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-19T17:57:13.740353] [DEBUG] [LOCAL ] CHCT: Trimmed 35150 records to 24496 (keeping 200 days of data) [2025-09-19T17:57:13.891443] [DEBUG] [LOCAL ] CHCT: Primary data saved (24496 records). [2025-09-19T17:57:13.891615] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-19T17:57:13.891768] [INFO ] [MAIN ] Update Progress: 435/2372 symbols completed. CHCT took 28.7s. Estimated remaining: 4h 14m 32s. Rate: 7.6 symbols/min [2025-09-19T17:57:14.075097] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:14.075273] [DEBUG] [LOCAL ] CHH: No existing data file found in primary storage. [2025-09-19T17:57:14.075311] [WARN ] [MAIN ] CHH: No existing data found, performing full refresh instead. [2025-09-19T17:57:14.075461] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-19T17:57:14.075504] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-19T17:57:14.075546] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-09-19T17:57:14.075581] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-19T17:57:14.245208] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-19T17:57:14.466786] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:15.043241] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-19T17:57:15.140864] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T17:57:15.571291] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-19T17:57:15.843248] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-19T17:57:16.643264] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-19T17:57:17.443276] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-19T17:57:17.688207] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-19T17:57:17.992058] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T17:57:18.229619] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T17:57:18.243208] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-19T17:57:18.935844] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T17:57:19.043290] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-19T17:57:19.392732] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:57:19.843271] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-19T17:57:20.440605] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T17:57:20.643287] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-19T17:57:20.957226] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T17:57:21.443287] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-19T17:57:22.191322] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:57:22.243226] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-19T17:57:23.048753] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-19T17:57:23.063139] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T17:57:23.673417] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T17:57:23.843262] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-19T17:57:24.643244] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-19T17:57:24.677861] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:57:25.443254] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-19T17:57:25.558024] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:57:26.243380] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-19T17:57:26.577694] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T17:57:26.662424] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:57:26.670479] [INFO ] [REMOTE ] CHD: Full fetch complete (74348 records). [2025-09-19T17:57:26.670740] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-19T17:57:27.059384] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-19T17:57:27.128786] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-19T17:57:27.128985] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-19T17:57:27.131053] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-19T17:57:27.131185] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-19T17:57:27.133618] [DEBUG] [LOCAL ] CHD: Trimmed 74348 records to 52750 (keeping 200 days of data) [2025-09-19T17:57:27.479031] [DEBUG] [LOCAL ] CHD: Primary data saved (52750 records). [2025-09-19T17:57:27.479314] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-19T17:57:27.479510] [INFO ] [MAIN ] Update Progress: 436/2372 symbols completed. CHD took 31.8s. Estimated remaining: 4h 14m 49s. Rate: 7.6 symbols/min [2025-09-19T17:57:27.620543] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T17:57:27.695201] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:27.720508] [DEBUG] [LOCAL ] CHMI: Loaded 22199 existing records from primary storage. [2025-09-19T17:57:27.720679] [INFO ] [MAIN ] CHMI: Loaded 22199 existing records. [2025-09-19T17:57:27.848391] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-19T17:57:27.919377] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:27.919708] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-19T17:57:27.919776] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-19T17:57:27.920374] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-19T17:57:27.920474] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-19T17:57:28.306593] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:28.643326] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-19T17:57:28.706603] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T17:57:29.070158] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:57:29.443287] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-19T17:57:29.523387] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T17:57:30.243293] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-19T17:57:31.043278] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-19T17:57:31.177325] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T17:57:31.533735] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:57:31.843255] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-19T17:57:32.237515] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T17:57:32.643285] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-19T17:57:32.806800] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T17:57:33.443300] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-19T17:57:34.243450] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-19T17:57:34.275199] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T17:57:35.001359] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T17:57:35.043229] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-19T17:57:35.593624] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T17:57:35.843255] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-19T17:57:36.643230] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-19T17:57:36.802914] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T17:57:37.231709] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:57:37.443314] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-19T17:57:37.538261] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:57:38.243301] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-19T17:57:38.622281] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T17:57:39.043276] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-19T17:57:39.588431] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:57:39.843281] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-19T17:57:40.428759] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T17:57:40.434320] [INFO ] [REMOTE ] CHE: Full fetch complete (19418 records). [2025-09-19T17:57:40.434545] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-19T17:57:40.648555] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-19T17:57:40.921956] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-19T17:57:40.922133] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-19T17:57:40.922660] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-19T17:57:40.922729] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-19T17:57:40.923427] [DEBUG] [LOCAL ] CHE: Trimmed 19418 records to 14825 (keeping 200 days of data) [2025-09-19T17:57:41.025354] [DEBUG] [LOCAL ] CHE: Primary data saved (14825 records). [2025-09-19T17:57:41.025513] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-19T17:57:41.025631] [INFO ] [MAIN ] Update Progress: 437/2372 symbols completed. CHE took 35.0s. Estimated remaining: 4h 15m 6s. Rate: 7.6 symbols/min [2025-09-19T17:57:41.432844] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T17:57:41.443207] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-19T17:57:42.081264] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:57:42.243265] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-19T17:57:42.920872] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:57:42.928073] [INFO ] [REMOTE ] CHH: Full fetch complete (46101 records). [2025-09-19T17:57:42.928258] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-19T17:57:43.048365] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-19T17:57:43.324601] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-19T17:57:43.324731] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-19T17:57:43.325408] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-19T17:57:43.325452] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-19T17:57:43.326717] [DEBUG] [LOCAL ] CHH: Trimmed 46101 records to 32806 (keeping 200 days of data) [2025-09-19T17:57:43.553829] [DEBUG] [LOCAL ] CHH: Primary data saved (32806 records). [2025-09-19T17:57:43.554372] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-19T17:57:43.554583] [INFO ] [MAIN ] Update Progress: 438/2372 symbols completed. CHH took 29.7s. Estimated remaining: 4h 14m 35s. Rate: 7.6 symbols/min [2025-09-19T17:57:44.416798] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T17:57:44.428277] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-19T17:57:44.491695] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T17:57:44.643337] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-19T17:57:45.938380] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T17:57:45.943112] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-19T17:57:46.583047] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:57:46.594674] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-19T17:57:47.428217] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T17:57:47.432140] [INFO ] [REMOTE ] CHMI: Full fetch complete (31604 records). [2025-09-19T17:57:47.432285] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-19T17:57:47.825714] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-19T17:57:47.825846] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-19T17:57:47.826331] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-19T17:57:47.826373] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-19T17:57:47.827383] [DEBUG] [LOCAL ] CHMI: Trimmed 31604 records to 22354 (keeping 200 days of data) [2025-09-19T17:57:47.961185] [DEBUG] [LOCAL ] CHMI: Primary data saved (22354 records). [2025-09-19T17:57:47.961321] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-19T17:57:47.961423] [INFO ] [MAIN ] Update Progress: 439/2372 symbols completed. CHMI took 20.5s. Estimated remaining: 4h 14m 11s. Rate: 7.6 symbols/min [2025-09-19T17:57:48.276021] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T17:57:48.283761] [INFO ] [REMOTE ] CHGG: Full fetch complete (70726 records). [2025-09-19T17:57:48.283924] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-19T17:57:48.715533] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-19T17:57:48.715883] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-19T17:57:48.716737] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-19T17:57:48.716804] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-19T17:57:48.719827] [DEBUG] [LOCAL ] CHGG: Trimmed 70726 records to 48526 (keeping 200 days of data) [2025-09-19T17:57:49.017293] [DEBUG] [LOCAL ] CHGG: Primary data saved (48526 records). [2025-09-19T17:57:49.017541] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-19T17:57:49.017635] [INFO ] [MAIN ] Update Progress: 440/2372 symbols completed. CHGG took 39.5s. Estimated remaining: 4h 13m 33s. Rate: 7.6 symbols/min [2025-09-19T17:57:49.730247] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:49.723444] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:49.830602] [DEBUG] [LOCAL ] CHWY: No existing data file found in primary storage. [2025-09-19T17:57:49.830294] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:49.828087] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:49.831553] [WARN ] [MAIN ] CHWY: No existing data found, performing full refresh instead. [2025-09-19T17:57:49.833634] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-19T17:57:49.833898] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-19T17:57:49.833975] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-09-19T17:57:49.834019] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-19T17:57:49.932847] [DEBUG] [LOCAL ] CHN: Loaded 4842 existing records from primary storage. [2025-09-19T17:57:49.949749] [INFO ] [MAIN ] CHN: Loaded 4842 existing records. [2025-09-19T17:57:49.988816] [DEBUG] [LOCAL ] CHT: Loaded 19893 existing records from primary storage. [2025-09-19T17:57:50.006789] [INFO ] [MAIN ] CHT: Loaded 19893 existing records. [2025-09-19T17:57:50.409211] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:50.514544] [DEBUG] [LOCAL ] CHPT: Loaded 50058 existing records from primary storage. [2025-09-19T17:57:50.499794] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-19T17:57:50.558489] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-19T17:57:50.558602] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:50.579532] [INFO ] [MAIN ] CHPT: Loaded 50058 existing records. [2025-09-19T17:57:50.579819] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-19T17:57:50.620668] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-19T17:57:50.591280] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-19T17:57:50.667378] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-19T17:57:50.733904] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-19T17:57:50.787709] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-19T17:57:50.777870] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:50.825291] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-19T17:57:51.197293] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:51.314568] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-19T17:57:51.364359] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-19T17:57:51.446922] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-19T17:57:51.515974] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-19T17:57:51.649981] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:51.665248] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-19T17:57:51.777488] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:51.783576] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-19T17:57:52.036980] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:52.037347] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-19T17:57:52.763069] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T17:57:52.767331] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-19T17:57:52.826046] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T17:57:52.827992] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-19T17:57:53.256036] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-19T17:57:53.267390] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-19T17:57:53.503974] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T17:57:53.507929] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-19T17:57:53.613321] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T17:57:53.616264] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-19T17:57:54.216114] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T17:57:54.243365] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-19T17:57:54.615337] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-19T17:57:54.928326] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T17:57:54.999424] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:57:55.043224] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-19T17:57:55.132589] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:57:55.843251] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-19T17:57:56.602485] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T17:57:56.614921] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T17:57:56.643272] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-19T17:57:57.102444] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-19T17:57:57.443289] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-19T17:57:58.243278] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-19T17:57:58.914537] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T17:57:59.043232] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-19T17:57:59.620005] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T17:57:59.843264] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-19T17:58:00.637305] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T17:58:00.648477] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-19T17:58:01.308966] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:58:01.443282] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-19T17:58:02.185072] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T17:58:02.243330] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-19T17:58:03.043291] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-19T17:58:03.518671] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-19T17:58:03.542221] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:58:03.666690] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T17:58:03.843262] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-19T17:58:04.614737] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T17:58:04.643253] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-19T17:58:05.443260] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-19T17:58:05.571303] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T17:58:06.243260] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-19T17:58:07.043231] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-19T17:58:07.479004] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T17:58:07.691740] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T17:58:07.843255] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-19T17:58:07.921621] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T17:58:07.923115] [INFO ] [REMOTE ] CHN: Full fetch complete (7588 records). [2025-09-19T17:58:07.923185] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-19T17:58:08.281262] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-19T17:58:08.281346] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-19T17:58:08.281539] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-19T17:58:08.281586] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-19T17:58:08.282048] [DEBUG] [LOCAL ] CHN: Trimmed 7588 records to 4871 (keeping 200 days of data) [2025-09-19T17:58:08.311748] [DEBUG] [LOCAL ] CHN: Primary data saved (4871 records). [2025-09-19T17:58:08.311819] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-19T17:58:08.311896] [INFO ] [MAIN ] Update Progress: 441/2372 symbols completed. CHN took 19.3s. Estimated remaining: 4h 14m 16s. Rate: 7.6 symbols/min [2025-09-19T17:58:08.479305] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:08.539268] [DEBUG] [LOCAL ] CI: Loaded 50340 existing records from primary storage. [2025-09-19T17:58:08.539405] [INFO ] [MAIN ] CI: Loaded 50340 existing records. [2025-09-19T17:58:08.648453] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-19T17:58:08.725811] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:08.726022] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-19T17:58:08.726084] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-19T17:58:08.727634] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-19T17:58:08.727718] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-19T17:58:09.087959] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T17:58:09.091888] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:09.095420] [INFO ] [REMOTE ] CHT: Full fetch complete (27412 records). [2025-09-19T17:58:09.095518] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-19T17:58:09.453064] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-19T17:58:09.482781] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-19T17:58:09.482862] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-19T17:58:09.483289] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-19T17:58:09.483435] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-19T17:58:09.484214] [DEBUG] [LOCAL ] CHT: Trimmed 27412 records to 19987 (keeping 200 days of data) [2025-09-19T17:58:09.607849] [DEBUG] [LOCAL ] CHT: Primary data saved (19987 records). [2025-09-19T17:58:09.608002] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-19T17:58:09.608093] [INFO ] [MAIN ] Update Progress: 442/2372 symbols completed. CHT took 20.6s. Estimated remaining: 4h 13m 39s. Rate: 7.6 symbols/min [2025-09-19T17:58:09.803159] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:09.803346] [DEBUG] [LOCAL ] CIA: No existing data file found in primary storage. [2025-09-19T17:58:09.803405] [WARN ] [MAIN ] CIA: No existing data found, performing full refresh instead. [2025-09-19T17:58:09.803549] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-19T17:58:09.803596] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-19T17:58:09.803639] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-09-19T17:58:09.803719] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-19T17:58:10.207632] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:10.243223] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-19T17:58:11.043260] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-19T17:58:11.371613] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T17:58:11.405482] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-19T17:58:11.848310] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-19T17:58:11.866819] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-19T17:58:12.643252] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-19T17:58:13.253364] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T17:58:13.443277] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-19T17:58:14.243323] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-19T17:58:14.344431] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T17:58:14.388367] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-19T17:58:14.888960] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T17:58:14.926004] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T17:58:15.043261] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-19T17:58:15.843271] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-19T17:58:16.160776] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T17:58:16.643262] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-19T17:58:17.443267] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-19T17:58:18.236539] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-19T17:58:18.252721] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-19T17:58:18.618866] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:58:19.043279] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-19T17:58:19.435553] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T17:58:19.843287] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-19T17:58:19.904383] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-19T17:58:20.657861] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-19T17:58:20.679286] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T17:58:21.443254] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-19T17:58:21.993059] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:58:22.243291] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-19T17:58:23.043246] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-19T17:58:23.126312] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T17:58:23.843334] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-19T17:58:24.171998] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T17:58:24.181002] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-19T17:58:24.181179] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-19T17:58:24.616752] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-19T17:58:24.616581] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T17:58:24.617143] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-19T17:58:24.622829] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-19T17:58:24.623473] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-19T17:58:24.653940] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-19T17:58:24.657491] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (4.00 seconds). [2025-09-19T17:58:24.662081] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 54405 (keeping 200 days of data) [2025-09-19T17:58:25.002585] [DEBUG] [LOCAL ] CHWY: Primary data saved (54405 records). [2025-09-19T17:58:25.002790] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-19T17:58:25.002879] [INFO ] [MAIN ] Update Progress: 443/2372 symbols completed. CHWY took 36.0s. Estimated remaining: 4h 14m 4s. Rate: 7.6 symbols/min [2025-09-19T17:58:25.174786] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:25.212556] [DEBUG] [LOCAL ] CIB: Loaded 31402 existing records from primary storage. [2025-09-19T17:58:25.212760] [INFO ] [MAIN ] CIB: Loaded 31402 existing records. [2025-09-19T17:58:25.395930] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:25.396189] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-19T17:58:25.396248] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-19T17:58:25.397239] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-19T17:58:25.397300] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-19T17:58:25.460766] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-19T17:58:25.774521] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:25.784830] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T17:58:25.821391] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T17:58:26.243282] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-19T17:58:27.043276] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-19T17:58:27.677864] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T17:58:27.843261] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-19T17:58:27.988708] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T17:58:28.355670] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-19T17:58:28.643311] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-19T17:58:29.352233] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T17:58:29.443258] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-19T17:58:30.243291] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-19T17:58:31.043387] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-19T17:58:31.101338] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-19T17:58:31.127180] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T17:58:31.147615] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T17:58:31.843281] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-19T17:58:32.643385] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-19T17:58:32.748724] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T17:58:33.443333] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-19T17:58:33.503300] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:58:33.862130] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T17:58:34.243265] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-19T17:58:35.043297] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-19T17:58:35.329366] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:58:35.417364] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T17:58:35.845583] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-19T17:58:35.848803] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T17:58:35.851947] [INFO ] [REMOTE ] CIA: Full fetch complete (23172 records). [2025-09-19T17:58:35.852099] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-19T17:58:36.230203] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-19T17:58:36.230303] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-19T17:58:36.230713] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-19T17:58:36.230776] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-19T17:58:36.231520] [DEBUG] [LOCAL ] CIA: Trimmed 23172 records to 17081 (keeping 200 days of data) [2025-09-19T17:58:36.330516] [DEBUG] [LOCAL ] CIA: Primary data saved (17081 records). [2025-09-19T17:58:36.330715] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-19T17:58:36.330818] [INFO ] [MAIN ] Update Progress: 444/2372 symbols completed. CIA took 26.7s. Estimated remaining: 4h 14m 11s. Rate: 7.6 symbols/min [2025-09-19T17:58:36.507311] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:36.507510] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-19T17:58:36.507550] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-19T17:58:36.507738] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-19T17:58:36.507801] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-19T17:58:36.507859] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-19T17:58:36.507962] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-19T17:58:36.657409] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-19T17:58:36.884751] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:37.443237] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-19T17:58:38.021740] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:58:38.108461] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T17:58:38.243223] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-19T17:58:38.950017] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:58:38.960349] [INFO ] [REMOTE ] CHPT: Full fetch complete (73658 records). [2025-09-19T17:58:38.960511] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-19T17:58:39.048391] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-19T17:58:39.380340] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-19T17:58:39.380451] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-19T17:58:39.381395] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-19T17:58:39.381538] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-19T17:58:39.404741] [DEBUG] [LOCAL ] CHPT: Trimmed 73658 records to 50321 (keeping 200 days of data) [2025-09-19T17:58:39.405971] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T17:58:39.535726] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T17:58:39.717969] [DEBUG] [LOCAL ] CHPT: Primary data saved (50321 records). [2025-09-19T17:58:39.718123] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-19T17:58:39.718225] [INFO ] [MAIN ] Update Progress: 445/2372 symbols completed. CHPT took 50.7s. Estimated remaining: 4h 13m 43s. Rate: 7.6 symbols/min [2025-09-19T17:58:39.848375] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-19T17:58:39.904203] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:39.958206] [DEBUG] [LOCAL ] CIEN: Loaded 52491 existing records from primary storage. [2025-09-19T17:58:39.958354] [INFO ] [MAIN ] CIEN: Loaded 52491 existing records. [2025-09-19T17:58:40.143630] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:40.144013] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-19T17:58:40.144071] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-19T17:58:40.145556] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-19T17:58:40.145617] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-19T17:58:40.537953] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:40.643270] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-19T17:58:40.804734] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T17:58:41.443308] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-19T17:58:41.983471] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T17:58:42.173084] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T17:58:42.243264] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-19T17:58:43.043275] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-19T17:58:43.843303] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-19T17:58:43.977851] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:58:44.643462] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-19T17:58:45.189337] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:58:45.204203] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T17:58:45.443252] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-19T17:58:46.112028] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-19T17:58:46.243303] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-19T17:58:46.900757] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:58:46.905974] [INFO ] [REMOTE ] CIB: Full fetch complete (44199 records). [2025-09-19T17:58:46.906113] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-19T17:58:47.052147] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-19T17:58:47.310291] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-19T17:58:47.310377] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-19T17:58:47.311019] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-19T17:58:47.311087] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-19T17:58:47.312258] [DEBUG] [LOCAL ] CIB: Trimmed 44199 records to 31593 (keeping 200 days of data) [2025-09-19T17:58:47.512198] [DEBUG] [LOCAL ] CIB: Primary data saved (31593 records). [2025-09-19T17:58:47.512368] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-19T17:58:47.512473] [INFO ] [MAIN ] Update Progress: 446/2372 symbols completed. CIB took 22.5s. Estimated remaining: 4h 13m 35s. Rate: 7.6 symbols/min [2025-09-19T17:58:47.695441] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:47.702521] [DEBUG] [LOCAL ] CIF: Loaded 4548 existing records from primary storage. [2025-09-19T17:58:47.702630] [INFO ] [MAIN ] CIF: Loaded 4548 existing records. [2025-09-19T17:58:47.856946] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-19T17:58:47.899511] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:47.900834] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-19T17:58:47.900949] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-19T17:58:47.901361] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-19T17:58:47.901451] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-19T17:58:48.226614] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:58:48.333823] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:48.463728] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-19T17:58:48.643233] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-19T17:58:49.097537] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T17:58:49.105090] [INFO ] [REMOTE ] CI: Full fetch complete (72516 records). [2025-09-19T17:58:49.105230] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-19T17:58:49.448330] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-19T17:58:49.529028] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-19T17:58:49.529119] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-19T17:58:49.529973] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-19T17:58:49.530042] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-19T17:58:49.531538] [DEBUG] [LOCAL ] CI: Trimmed 72516 records to 50689 (keeping 200 days of data) [2025-09-19T17:58:49.861708] [DEBUG] [LOCAL ] CI: Primary data saved (50689 records). [2025-09-19T17:58:49.861892] [INFO ] [MAIN ] CI: Full history saved. [2025-09-19T17:58:49.862945] [INFO ] [MAIN ] Update Progress: 447/2372 symbols completed. CI took 41.6s. Estimated remaining: 4h 13m 3s. Rate: 7.6 symbols/min [2025-09-19T17:58:50.056048] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:50.133271] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T17:58:50.131790] [DEBUG] [LOCAL ] CIG: Loaded 44042 existing records from primary storage. [2025-09-19T17:58:50.144032] [INFO ] [MAIN ] CIG: Loaded 44042 existing records. [2025-09-19T17:58:50.246358] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-19T17:58:50.336746] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:50.337001] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-19T17:58:50.337050] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-19T17:58:50.338298] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-19T17:58:50.338361] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-19T17:58:50.455206] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T17:58:50.717501] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:50.748364] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T17:58:51.043306] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-19T17:58:51.843266] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-19T17:58:52.596323] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:58:52.643235] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-19T17:58:53.101444] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:58:53.159450] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-19T17:58:53.443280] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-19T17:58:53.854476] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-19T17:58:54.243287] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-19T17:58:55.043267] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-19T17:58:55.843284] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-19T17:58:56.163727] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T17:58:56.338926] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-19T17:58:56.643313] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-19T17:58:56.794450] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:58:57.443278] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-19T17:58:57.456828] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T17:58:58.243278] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-19T17:58:59.043275] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-19T17:58:59.074162] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T17:58:59.086117] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T17:58:59.843266] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-19T17:59:00.427275] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:59:00.643305] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-19T17:59:01.443264] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-19T17:59:01.557890] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:59:02.155058] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T17:59:02.243319] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-19T17:59:02.786745] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T17:59:03.043344] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-19T17:59:03.731870] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T17:59:03.843272] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-19T17:59:04.075594] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T17:59:04.299025] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-19T17:59:04.643264] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-19T17:59:05.154521] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T17:59:05.443235] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-19T17:59:05.733531] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-19T17:59:06.243267] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-19T17:59:07.043280] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-19T17:59:07.842772] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:59:07.846563] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-19T17:59:08.308190] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-19T17:59:08.643261] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-19T17:59:08.851566] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T17:59:09.120305] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T17:59:09.121108] [INFO ] [REMOTE ] CICB: Full fetch complete (2157 records). [2025-09-19T17:59:09.121178] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-19T17:59:09.298859] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-19T17:59:09.299047] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:59:09.299114] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:59:09.299153] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-19T17:59:09.299209] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-19T17:59:09.299244] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-19T17:59:09.299297] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-19T17:59:09.299376] [INFO ] [MAIN ] Update Progress: 448/2372 symbols completed. CICB took 33.0s. Estimated remaining: 4h 13m 45s. Rate: 7.6 symbols/min [2025-09-19T17:59:09.467629] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:09.464430] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-19T17:59:09.486797] [DEBUG] [LOCAL ] CII: Loaded 15979 existing records from primary storage. [2025-09-19T17:59:09.486919] [INFO ] [MAIN ] CII: Loaded 15979 existing records. [2025-09-19T17:59:09.669108] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:09.669367] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-19T17:59:09.669417] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-19T17:59:09.670168] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-19T17:59:09.670229] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-19T17:59:10.025440] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:10.072690] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T17:59:10.073927] [INFO ] [REMOTE ] CIF: Full fetch complete (6587 records). [2025-09-19T17:59:10.073999] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-19T17:59:10.248724] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-19T17:59:10.435149] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-19T17:59:10.435232] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-19T17:59:10.435409] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-19T17:59:10.435448] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-19T17:59:10.435872] [DEBUG] [LOCAL ] CIF: Trimmed 6587 records to 4566 (keeping 200 days of data) [2025-09-19T17:59:10.462832] [DEBUG] [LOCAL ] CIF: Primary data saved (4566 records). [2025-09-19T17:59:10.462906] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-19T17:59:10.462991] [INFO ] [MAIN ] Update Progress: 449/2372 symbols completed. CIF took 23.0s. Estimated remaining: 4h 13m 8s. Rate: 7.6 symbols/min [2025-09-19T17:59:10.628637] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:10.667557] [DEBUG] [LOCAL ] CIM: Loaded 37425 existing records from primary storage. [2025-09-19T17:59:10.667727] [INFO ] [MAIN ] CIM: Loaded 37425 existing records. [2025-09-19T17:59:10.848470] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:10.848762] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-19T17:59:10.848826] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-19T17:59:10.850025] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-19T17:59:10.850106] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-19T17:59:11.049579] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-19T17:59:11.214080] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:11.642595] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T17:59:11.843255] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-19T17:59:12.441088] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T17:59:12.643257] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-19T17:59:13.261529] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:59:13.443266] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-19T17:59:13.850484] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T17:59:14.243262] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-19T17:59:14.622853] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:59:15.043265] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-19T17:59:15.843308] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-19T17:59:16.265062] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T17:59:16.459814] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T17:59:16.468291] [INFO ] [REMOTE ] CIEN: Full fetch complete (75512 records). [2025-09-19T17:59:16.468413] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-19T17:59:16.648453] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-19T17:59:16.866764] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-19T17:59:16.866843] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-19T17:59:16.867659] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-19T17:59:16.867735] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-19T17:59:16.869328] [DEBUG] [LOCAL ] CIEN: Trimmed 75512 records to 52866 (keeping 200 days of data) [2025-09-19T17:59:17.181146] [DEBUG] [LOCAL ] CIEN: Primary data saved (52866 records). [2025-09-19T17:59:17.181281] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-19T17:59:17.181362] [INFO ] [MAIN ] Update Progress: 450/2372 symbols completed. CIEN took 37.5s. Estimated remaining: 4h 12m 55s. Rate: 7.6 symbols/min [2025-09-19T17:59:17.365608] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:17.404139] [DEBUG] [LOCAL ] CIMN: Loaded 2676 existing records from primary storage. [2025-09-19T17:59:17.403947] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T17:59:17.404285] [INFO ] [MAIN ] CIMN: Loaded 2676 existing records. [2025-09-19T17:59:17.450900] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-19T17:59:17.598023] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:17.598259] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-19T17:59:17.598309] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-19T17:59:17.598596] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-19T17:59:17.598682] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-19T17:59:17.947211] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:18.243268] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-19T17:59:18.285861] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T17:59:18.467761] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:59:19.043266] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-19T17:59:19.843380] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-19T17:59:20.185499] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T17:59:20.339583] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-19T17:59:20.368290] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T17:59:20.643402] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-19T17:59:21.319939] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T17:59:21.443279] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-19T17:59:22.243330] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-19T17:59:23.043294] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-19T17:59:23.407361] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:59:23.843307] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-19T17:59:24.007941] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:59:24.643282] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-19T17:59:24.680836] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T17:59:24.796769] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T17:59:25.204705] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-19T17:59:25.443295] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-19T17:59:26.243298] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-19T17:59:26.514103] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T17:59:27.043265] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-19T17:59:27.843343] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-19T17:59:28.048136] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T17:59:28.058496] [INFO ] [REMOTE ] CIG: Full fetch complete (60811 records). [2025-09-19T17:59:28.058775] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-19T17:59:28.435232] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-19T17:59:28.458210] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-19T17:59:28.458283] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-19T17:59:28.459021] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-19T17:59:28.459107] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-19T17:59:28.462958] [DEBUG] [LOCAL ] CIG: Trimmed 60811 records to 44306 (keeping 200 days of data) [2025-09-19T17:59:28.648169] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-19T17:59:28.732826] [DEBUG] [LOCAL ] CIG: Primary data saved (44306 records). [2025-09-19T17:59:28.732959] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-19T17:59:28.733999] [INFO ] [MAIN ] Update Progress: 451/2372 symbols completed. CIG took 38.9s. Estimated remaining: 4h 13m 3s. Rate: 7.6 symbols/min [2025-09-19T17:59:28.913138] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:28.913349] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-19T17:59:28.913404] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-19T17:59:28.913555] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-19T17:59:28.913598] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-19T17:59:28.913639] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-19T17:59:28.913733] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-19T17:59:29.315835] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:29.338377] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T17:59:29.443247] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-19T17:59:29.785767] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T17:59:30.243243] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-19T17:59:30.553345] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T17:59:30.914020] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T17:59:31.043312] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-19T17:59:31.843286] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-19T17:59:32.173071] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T17:59:32.176069] [INFO ] [REMOTE ] CII: Full fetch complete (23126 records). [2025-09-19T17:59:32.176180] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-19T17:59:32.548861] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-19T17:59:32.548946] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-19T17:59:32.549464] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-19T17:59:32.549526] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-19T17:59:32.550259] [DEBUG] [LOCAL ] CII: Trimmed 23126 records to 16086 (keeping 200 days of data) [2025-09-19T17:59:32.648767] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-19T17:59:32.664492] [DEBUG] [LOCAL ] CII: Primary data saved (16086 records). [2025-09-19T17:59:32.664634] [INFO ] [MAIN ] CII: Full history saved. [2025-09-19T17:59:32.664849] [INFO ] [MAIN ] Update Progress: 452/2372 symbols completed. CII took 23.4s. Estimated remaining: 4h 12m 38s. Rate: 7.6 symbols/min [2025-09-19T17:59:32.842575] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:32.842800] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-19T17:59:32.842855] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-19T17:59:32.843081] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-19T17:59:32.843139] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-19T17:59:32.843187] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-19T17:59:32.843218] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-19T17:59:33.291028] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:33.295338] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T17:59:33.319363] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T17:59:33.443245] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-19T17:59:34.243285] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-19T17:59:34.476086] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:34.476451] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-19T17:59:34.789604] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T17:59:35.043280] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-19T17:59:35.843274] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-19T17:59:36.643249] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-19T17:59:36.738448] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T17:59:37.001924] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T17:59:37.187392] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T17:59:37.443259] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-19T17:59:38.010269] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:59:38.243271] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-19T17:59:39.043280] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-19T17:59:39.108535] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-19T17:59:39.821780] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T17:59:39.843236] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-19T17:59:40.385225] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:59:40.643295] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-19T17:59:40.964246] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-19T17:59:41.443314] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-19T17:59:41.681331] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:41.681636] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-19T17:59:42.243284] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-19T17:59:42.877552] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T17:59:43.043275] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-19T17:59:43.450692] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T17:59:43.843261] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-19T17:59:44.643264] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-19T17:59:44.875693] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:44.876011] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-19T17:59:45.443310] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-19T17:59:45.519260] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T17:59:45.525115] [INFO ] [REMOTE ] CIM: Full fetch complete (54421 records). [2025-09-19T17:59:45.525249] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-19T17:59:45.840882] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-19T17:59:45.939530] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-19T17:59:45.939671] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-19T17:59:45.940341] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-19T17:59:45.940388] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-19T17:59:45.942979] [DEBUG] [LOCAL ] CIM: Trimmed 54421 records to 37728 (keeping 200 days of data) [2025-09-19T17:59:46.212253] [DEBUG] [LOCAL ] CIM: Primary data saved (37728 records). [2025-09-19T17:59:46.212420] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-19T17:59:46.212526] [INFO ] [MAIN ] Update Progress: 453/2372 symbols completed. CIM took 35.7s. Estimated remaining: 4h 12m 54s. Rate: 7.6 symbols/min [2025-09-19T17:59:46.248597] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-19T17:59:46.483745] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:46.515819] [DEBUG] [LOCAL ] CINT: Loaded 18294 existing records from primary storage. [2025-09-19T17:59:46.516019] [INFO ] [MAIN ] CINT: Loaded 18294 existing records. [2025-09-19T17:59:46.819620] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:46.819995] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-19T17:59:46.820068] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-19T17:59:46.820775] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-19T17:59:46.820854] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-19T17:59:47.049373] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-19T17:59:47.154329] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T17:59:47.322246] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:47.843269] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-19T17:59:47.851774] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-19T17:59:48.643279] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-19T17:59:48.666359] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-19T17:59:48.667820] [INFO ] [REMOTE ] CIMO: Full fetch complete (5480 records). [2025-09-19T17:59:48.667891] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-19T17:59:48.855242] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T17:59:48.855501] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:59:48.855549] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:59:48.855739] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-19T17:59:48.855827] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-19T17:59:48.855884] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-19T17:59:48.855942] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-19T17:59:48.856026] [INFO ] [MAIN ] Update Progress: 454/2372 symbols completed. CIMO took 20.1s. Estimated remaining: 4h 12m 24s. Rate: 7.6 symbols/min [2025-09-19T17:59:49.028193] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:49.028407] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-09-19T17:59:49.028463] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-09-19T17:59:49.028612] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-19T17:59:49.028681] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-19T17:59:49.028743] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-09-19T17:59:49.028785] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-19T17:59:49.421631] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:49.443239] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-19T17:59:49.536618] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T17:59:49.537520] [INFO ] [REMOTE ] CIMN: Full fetch complete (3902 records). [2025-09-19T17:59:49.537592] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-19T17:59:49.889216] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-19T17:59:49.889292] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-19T17:59:49.889413] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-19T17:59:49.889449] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-19T17:59:49.889833] [DEBUG] [LOCAL ] CIMN: Trimmed 3902 records to 2690 (keeping 200 days of data) [2025-09-19T17:59:49.907542] [DEBUG] [LOCAL ] CIMN: Primary data saved (2690 records). [2025-09-19T17:59:49.907608] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-19T17:59:49.907712] [INFO ] [MAIN ] Update Progress: 455/2372 symbols completed. CIMN took 32.7s. Estimated remaining: 4h 11m 47s. Rate: 7.6 symbols/min [2025-09-19T17:59:50.079819] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:50.127585] [DEBUG] [LOCAL ] CION: Loaded 29561 existing records from primary storage. [2025-09-19T17:59:50.127748] [INFO ] [MAIN ] CION: Loaded 29561 existing records. [2025-09-19T17:59:50.248392] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-19T17:59:50.311626] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:50.311848] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-19T17:59:50.311942] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-19T17:59:50.313572] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-19T17:59:50.313633] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-19T17:59:50.583701] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:50.595055] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-19T17:59:50.619756] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T17:59:50.683940] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:51.043260] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-19T17:59:51.843274] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-19T17:59:51.934590] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T17:59:52.643264] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-19T17:59:53.414687] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-19T17:59:53.443229] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-19T17:59:53.635393] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T17:59:54.243263] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-19T17:59:54.281245] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T17:59:54.494573] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:54.495114] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-19T17:59:55.043267] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-19T17:59:55.843260] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-19T17:59:56.329062] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:56.329436] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-19T17:59:56.468036] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:59:56.643268] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-19T17:59:57.443277] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-19T17:59:57.688902] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:57.689228] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-19T17:59:57.884623] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:59:58.243274] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-19T17:59:58.469085] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:58.469414] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-19T17:59:59.043267] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-19T17:59:59.843235] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-19T18:00:00.068013] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:00:00.068301] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-19T18:00:00.449050] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:00:00.643269] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-19T18:00:01.443318] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-19T18:00:02.028939] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T18:00:02.243315] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-19T18:00:03.043299] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-19T18:00:03.843310] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-19T18:00:04.453234] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-19T18:00:04.643320] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-19T18:00:05.147229] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T18:00:05.148773] [INFO ] [REMOTE ] CIMP: Full fetch complete (347 records). [2025-09-19T18:00:05.148862] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-19T18:00:05.364553] [WARN ] [VALIDATOR ] CIMP: Validation failed - insufficient historical data. Have 2 unique days, need 200 days [2025-09-19T18:00:05.364943] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:00:05.365044] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:00:05.365348] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-19T18:00:05.365548] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-19T18:00:05.365727] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-19T18:00:05.365976] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-19T18:00:05.366138] [INFO ] [MAIN ] Update Progress: 456/2372 symbols completed. CIMP took 32.7s. Estimated remaining: 4h 12m 11s. Rate: 7.6 symbols/min [2025-09-19T18:00:05.496287] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T18:00:05.523187] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-19T18:00:05.576859] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:05.642979] [DEBUG] [LOCAL ] CIVI: Loaded 52973 existing records from primary storage. [2025-09-19T18:00:05.643141] [INFO ] [MAIN ] CIVI: Loaded 52973 existing records. [2025-09-19T18:00:05.826610] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:05.826890] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-19T18:00:05.826941] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-19T18:00:05.828475] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-19T18:00:05.828540] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-19T18:00:06.146958] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (3.90 seconds). [2025-09-19T18:00:06.237186] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:06.243226] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-19T18:00:06.501538] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T18:00:07.050798] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-19T18:00:07.055554] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:00:07.843276] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-19T18:00:08.231241] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T18:00:08.513476] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T18:00:08.620234] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T18:00:08.643237] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-19T18:00:09.443254] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-19T18:00:09.881724] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T18:00:10.243271] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-19T18:00:10.684275] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T18:00:11.043265] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-19T18:00:11.822595] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T18:00:11.848361] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-19T18:00:11.870076] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T18:00:12.649602] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-19T18:00:12.655027] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T18:00:13.443284] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-19T18:00:14.046366] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T18:00:14.243245] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-19T18:00:15.043266] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-19T18:00:15.843233] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-19T18:00:16.414589] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T18:00:16.643257] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-19T18:00:17.111889] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-19T18:00:17.443328] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-19T18:00:17.728392] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T18:00:18.016715] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T18:00:18.144287] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (4.70 seconds). [2025-09-19T18:00:18.243296] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-19T18:00:18.353817] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T18:00:18.358308] [INFO ] [REMOTE ] CION: Full fetch complete (41355 records). [2025-09-19T18:00:18.358422] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-19T18:00:18.742421] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-19T18:00:18.742521] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-19T18:00:18.743103] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-19T18:00:18.743176] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-19T18:00:18.744563] [DEBUG] [LOCAL ] CION: Trimmed 41355 records to 29804 (keeping 200 days of data) [2025-09-19T18:00:18.924947] [DEBUG] [LOCAL ] CION: Primary data saved (29804 records). [2025-09-19T18:00:18.925094] [INFO ] [MAIN ] CION: Full history saved. [2025-09-19T18:00:18.925192] [INFO ] [MAIN ] Update Progress: 457/2372 symbols completed. CION took 29.0s. Estimated remaining: 4h 12m 27s. Rate: 7.6 symbols/min [2025-09-19T18:00:19.048353] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-19T18:00:19.098402] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:19.150252] [DEBUG] [LOCAL ] CL: Loaded 54034 existing records from primary storage. [2025-09-19T18:00:19.150418] [INFO ] [MAIN ] CL: Loaded 54034 existing records. [2025-09-19T18:00:19.330496] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:19.330784] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-19T18:00:19.330849] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-19T18:00:19.332220] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-19T18:00:19.332283] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-19T18:00:19.695887] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:19.843267] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-19T18:00:20.022596] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T18:00:20.326811] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T18:00:20.643268] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-19T18:00:21.443303] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-19T18:00:22.234245] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T18:00:22.244934] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-19T18:00:22.703924] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T18:00:22.870763] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T18:00:22.874455] [INFO ] [REMOTE ] CIO: Full fetch complete (29032 records). [2025-09-19T18:00:22.874530] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-19T18:00:23.055461] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-19T18:00:23.246465] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-19T18:00:23.246563] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-19T18:00:23.247024] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-19T18:00:23.247085] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-19T18:00:23.247851] [DEBUG] [LOCAL ] CIO: Trimmed 29032 records to 20269 (keeping 200 days of data) [2025-09-19T18:00:23.367007] [DEBUG] [LOCAL ] CIO: Primary data saved (20269 records). [2025-09-19T18:00:23.367151] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-19T18:00:23.367232] [INFO ] [MAIN ] Update Progress: 458/2372 symbols completed. CIO took 34.5s. Estimated remaining: 4h 12m 4s. Rate: 7.6 symbols/min [2025-09-19T18:00:23.536912] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:23.577730] [DEBUG] [LOCAL ] CLB: Loaded 33545 existing records from primary storage. [2025-09-19T18:00:23.577872] [INFO ] [MAIN ] CLB: Loaded 33545 existing records. [2025-09-19T18:00:23.756220] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:23.756878] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-19T18:00:23.756956] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-19T18:00:23.763839] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-19T18:00:23.774752] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-19T18:00:23.782867] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T18:00:23.846454] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-19T18:00:24.166943] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:24.643303] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-19T18:00:25.148364] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T18:00:25.443280] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-19T18:00:25.928523] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T18:00:26.243306] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-19T18:00:26.288634] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T18:00:26.292588] [INFO ] [REMOTE ] CINT: Full fetch complete (25827 records). [2025-09-19T18:00:26.292702] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-19T18:00:26.671503] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-19T18:00:26.671689] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-19T18:00:26.672163] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-19T18:00:26.672225] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-19T18:00:26.672961] [DEBUG] [LOCAL ] CINT: Trimmed 25827 records to 18486 (keeping 200 days of data) [2025-09-19T18:00:26.773049] [DEBUG] [LOCAL ] CINT: Primary data saved (18486 records). [2025-09-19T18:00:26.773204] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-19T18:00:26.773293] [INFO ] [MAIN ] Update Progress: 459/2372 symbols completed. CINT took 40.6s. Estimated remaining: 4h 11m 38s. Rate: 7.6 symbols/min [2025-09-19T18:00:26.949177] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:26.949380] [DEBUG] [LOCAL ] CLCO: No existing data file found in primary storage. [2025-09-19T18:00:26.949418] [WARN ] [MAIN ] CLCO: No existing data found, performing full refresh instead. [2025-09-19T18:00:26.949562] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-19T18:00:26.949617] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-19T18:00:26.949719] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-09-19T18:00:26.949771] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-19T18:00:27.051676] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-19T18:00:27.332274] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:27.365272] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T18:00:27.843310] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-19T18:00:28.542801] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-19T18:00:28.643241] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-19T18:00:28.895276] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T18:00:29.443265] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-19T18:00:29.728187] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T18:00:30.243293] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-19T18:00:30.339440] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T18:00:30.484614] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T18:00:31.043277] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-19T18:00:31.843285] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-19T18:00:32.580417] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T18:00:32.643301] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-19T18:00:33.050852] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T18:00:33.363431] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T18:00:33.443305] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-19T18:00:34.126118] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:00:34.134064] [INFO ] [REMOTE ] CIVI: Full fetch complete (75012 records). [2025-09-19T18:00:34.134248] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-19T18:00:34.135162] [FATAL] [VALIDATOR ] CIVI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:00:34.135293] [FATAL] [MAIN ] CIVI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:00:34.135345] [WARN ] [MAIN ] CIVI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:00:34.135452] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-19T18:00:34.135534] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-19T18:00:34.135584] [INFO ] [LOCAL ] CIVI: Starting deletion of derivative data. [2025-09-19T18:00:34.136148] [DEBUG] [LOCAL ] CIVI: Deleted derivative data file. [2025-09-19T18:00:34.136278] [INFO ] [MAIN ] Update Progress: 460/2372 symbols completed. CIVI took 28.8s. Estimated remaining: 4h 11m 28s. Rate: 7.6 symbols/min [2025-09-19T18:00:34.248455] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-19T18:00:34.314845] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:34.342069] [DEBUG] [LOCAL ] CLDT: Loaded 26416 existing records from primary storage. [2025-09-19T18:00:34.342247] [INFO ] [MAIN ] CLDT: Loaded 26416 existing records. [2025-09-19T18:00:34.531931] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:34.532246] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-19T18:00:34.532296] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-19T18:00:34.533723] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-19T18:00:34.533786] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-19T18:00:34.900896] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:34.983592] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T18:00:35.043247] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-19T18:00:35.613017] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:00:35.843304] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-19T18:00:36.643277] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-19T18:00:37.156670] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T18:00:37.333014] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T18:00:37.443279] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-19T18:00:37.976480] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:00:38.243293] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-19T18:00:38.718410] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T18:00:39.043343] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-19T18:00:39.803333] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T18:00:39.843281] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-19T18:00:40.643242] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-19T18:00:41.334888] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T18:00:41.375235] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:00:41.443273] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-19T18:00:41.856792] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T18:00:42.243269] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-19T18:00:43.043286] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-19T18:00:43.728990] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T18:00:43.843266] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-19T18:00:43.997102] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-19T18:00:44.643253] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-19T18:00:44.693407] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T18:00:45.058152] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T18:00:45.443261] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-19T18:00:46.243274] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-19T18:00:46.434127] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T18:00:47.043271] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-19T18:00:47.101810] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T18:00:47.109963] [INFO ] [REMOTE ] CL: Full fetch complete (77615 records). [2025-09-19T18:00:47.110134] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-19T18:00:47.553954] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-19T18:00:47.554039] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-19T18:00:47.554861] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-19T18:00:47.554926] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-19T18:00:47.556393] [DEBUG] [LOCAL ] CL: Trimmed 77615 records to 54424 (keeping 200 days of data) [2025-09-19T18:00:47.849155] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-19T18:00:47.902056] [DEBUG] [LOCAL ] CL: Primary data saved (54424 records). [2025-09-19T18:00:47.902341] [INFO ] [MAIN ] CL: Full history saved. [2025-09-19T18:00:47.902571] [INFO ] [MAIN ] Update Progress: 461/2372 symbols completed. CL took 29.0s. Estimated remaining: 4h 11m 44s. Rate: 7.6 symbols/min [2025-09-19T18:00:48.112785] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:48.108629] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T18:00:48.127690] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T18:00:48.192120] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-09-19T18:00:48.192300] [INFO ] [MAIN ] CLF: Loaded 54131 existing records. [2025-09-19T18:00:48.380432] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:48.380799] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-19T18:00:48.380867] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-19T18:00:48.382273] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-19T18:00:48.382339] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-19T18:00:48.648344] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-19T18:00:48.761388] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:49.066293] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T18:00:49.443266] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-19T18:00:49.732957] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T18:00:50.243277] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-19T18:00:51.043349] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-19T18:00:51.176888] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T18:00:51.834107] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T18:00:51.844637] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-19T18:00:52.248376] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T18:00:52.643261] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-19T18:00:52.901889] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T18:00:53.443270] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-19T18:00:53.898437] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T18:00:54.243289] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-19T18:00:55.043274] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-19T18:00:55.092565] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:00:55.843266] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-19T18:00:56.247998] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T18:00:56.253981] [INFO ] [REMOTE ] CLB: Full fetch complete (46174 records). [2025-09-19T18:00:56.254195] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-19T18:00:56.653122] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-19T18:00:56.707330] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-19T18:00:56.707508] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-19T18:00:56.708283] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-19T18:00:56.708389] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-19T18:00:56.712433] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-19T18:00:56.724519] [DEBUG] [LOCAL ] CLB: Trimmed 46174 records to 33774 (keeping 200 days of data) [2025-09-19T18:00:56.833618] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T18:00:56.838888] [INFO ] [REMOTE ] CLCO: Full fetch complete (23487 records). [2025-09-19T18:00:56.839517] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-19T18:00:57.309342] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-19T18:00:57.309765] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-19T18:00:57.310808] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-19T18:00:57.311137] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-19T18:00:57.313838] [DEBUG] [LOCAL ] CLCO: Trimmed 23487 records to 13627 (keeping 200 days of data) [2025-09-19T18:00:57.368289] [DEBUG] [LOCAL ] CLB: Primary data saved (33774 records). [2025-09-19T18:00:57.386319] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-19T18:00:57.389316] [INFO ] [MAIN ] Update Progress: 462/2372 symbols completed. CLB took 34.0s. Estimated remaining: 4h 11m 43s. Rate: 7.6 symbols/min [2025-09-19T18:00:57.454612] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-19T18:00:57.577220] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:57.593701] [DEBUG] [LOCAL ] CLCO: Primary data saved (13627 records). [2025-09-19T18:00:57.593917] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-19T18:00:57.600906] [INFO ] [MAIN ] Update Progress: 463/2372 symbols completed. CLCO took 30.8s. Estimated remaining: 4h 11m 3s. Rate: 7.6 symbols/min [2025-09-19T18:00:57.717080] [DEBUG] [LOCAL ] CLH: Loaded 28807 existing records from primary storage. [2025-09-19T18:00:57.727485] [INFO ] [MAIN ] CLH: Loaded 28807 existing records. [2025-09-19T18:00:57.862558] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:57.885678] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-09-19T18:00:57.885805] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-09-19T18:00:57.886087] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-19T18:00:57.886143] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-19T18:00:57.886530] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-09-19T18:00:57.886590] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-19T18:00:58.089417] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:58.150589] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-19T18:00:58.207731] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-19T18:00:58.233138] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-19T18:00:58.233288] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-19T18:00:58.446661] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:58.447018] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-19T18:00:58.546928] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T18:00:58.738991] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:59.043239] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-19T18:00:59.748388] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T18:00:59.836933] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T18:00:59.843203] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-19T18:01:00.260159] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T18:01:00.518925] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T18:01:00.643274] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-19T18:01:01.443293] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-19T18:01:01.606479] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T18:01:02.243285] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-19T18:01:02.443577] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T18:01:03.043283] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-19T18:01:03.843266] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-19T18:01:04.332539] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T18:01:04.643260] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-19T18:01:04.904723] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-19T18:01:04.951021] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T18:01:05.443265] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-19T18:01:05.707045] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T18:01:05.711065] [INFO ] [REMOTE ] CLDT: Full fetch complete (37117 records). [2025-09-19T18:01:05.711176] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-19T18:01:06.103894] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-19T18:01:06.103983] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-19T18:01:06.104492] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-19T18:01:06.104533] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-19T18:01:06.105471] [DEBUG] [LOCAL ] CLDT: Trimmed 37117 records to 26615 (keeping 200 days of data) [2025-09-19T18:01:06.246716] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-19T18:01:06.270964] [DEBUG] [LOCAL ] CLDT: Primary data saved (26615 records). [2025-09-19T18:01:06.271075] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-19T18:01:06.271171] [INFO ] [MAIN ] Update Progress: 464/2372 symbols completed. CLDT took 32.1s. Estimated remaining: 4h 10m 58s. Rate: 7.6 symbols/min [2025-09-19T18:01:06.442193] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:06.442364] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-09-19T18:01:06.442400] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-09-19T18:01:06.442558] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-19T18:01:06.442611] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-19T18:01:06.442682] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-09-19T18:01:06.442735] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-19T18:01:06.773985] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:01:06.817588] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:07.043287] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-19T18:01:07.843258] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-19T18:01:08.439243] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T18:01:08.643263] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-19T18:01:08.853897] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T18:01:09.241604] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T18:01:09.443280] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-19T18:01:10.243270] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-19T18:01:10.618707] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:01:10.920758] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:01:11.043278] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-19T18:01:11.731766] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T18:01:11.843283] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-19T18:01:12.514227] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T18:01:12.643265] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-19T18:01:13.443252] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-19T18:01:13.608761] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:01:14.018343] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T18:01:14.243288] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-19T18:01:15.010713] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T18:01:15.043235] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-19T18:01:15.843258] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-19T18:01:16.643254] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-19T18:01:16.671375] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T18:01:17.046329] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-19T18:01:17.443267] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-19T18:01:17.720796] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T18:01:18.243273] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-19T18:01:18.578283] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-19T18:01:18.838068] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:01:19.043256] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-19T18:01:19.243785] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T18:01:19.245431] [INFO ] [REMOTE ] CLPR: Full fetch complete (17859 records). [2025-09-19T18:01:19.245506] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-19T18:01:19.624980] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-19T18:01:19.625070] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-19T18:01:19.625465] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-19T18:01:19.625506] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-19T18:01:19.626103] [DEBUG] [LOCAL ] CLPR: Trimmed 17859 records to 11738 (keeping 200 days of data) [2025-09-19T18:01:19.696195] [DEBUG] [LOCAL ] CLPR: Primary data saved (11738 records). [2025-09-19T18:01:19.696346] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-19T18:01:19.696445] [INFO ] [MAIN ] Update Progress: 465/2372 symbols completed. CLPR took 22.1s. Estimated remaining: 4h 11m 13s. Rate: 7.6 symbols/min [2025-09-19T18:01:19.847372] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-19T18:01:19.882976] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:19.938822] [DEBUG] [LOCAL ] CLVT: Loaded 52395 existing records from primary storage. [2025-09-19T18:01:19.939000] [INFO ] [MAIN ] CLVT: Loaded 52395 existing records. [2025-09-19T18:01:20.130581] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:20.130853] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-19T18:01:20.130904] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-19T18:01:20.132289] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-19T18:01:20.132371] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-19T18:01:20.510521] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:20.533994] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:01:20.643243] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-19T18:01:21.443232] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-19T18:01:22.053995] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T18:01:22.243314] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-19T18:01:22.622165] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-19T18:01:23.043254] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-19T18:01:23.714342] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T18:01:23.843271] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-19T18:01:24.116398] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T18:01:24.492525] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T18:01:24.643293] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-19T18:01:25.443271] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-19T18:01:25.737710] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T18:01:26.243292] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-19T18:01:26.402757] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T18:01:26.589934] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T18:01:27.043297] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-19T18:01:27.843269] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-19T18:01:28.649682] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-19T18:01:28.650907] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T18:01:28.873078] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-19T18:01:29.443266] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-19T18:01:29.975337] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T18:01:30.243274] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-19T18:01:30.420289] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-19T18:01:30.428043] [INFO ] [REMOTE ] CLF: Full fetch complete (77419 records). [2025-09-19T18:01:30.428216] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-19T18:01:30.429194] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:01:30.429301] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:01:30.429373] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:01:30.429461] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-19T18:01:30.429558] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-09-19T18:01:30.429616] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-09-19T18:01:30.430114] [DEBUG] [LOCAL ] CLF: Deleted derivative data file. [2025-09-19T18:01:30.430216] [INFO ] [MAIN ] Update Progress: 466/2372 symbols completed. CLF took 42.5s. Estimated remaining: 4h 11m 17s. Rate: 7.6 symbols/min [2025-09-19T18:01:30.604700] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:30.627728] [DEBUG] [LOCAL ] CLW: Loaded 22217 existing records from primary storage. [2025-09-19T18:01:30.627878] [INFO ] [MAIN ] CLW: Loaded 22217 existing records. [2025-09-19T18:01:30.813545] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:30.813816] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-19T18:01:30.813869] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-19T18:01:30.814517] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-19T18:01:30.814579] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-19T18:01:31.048407] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-19T18:01:31.197745] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:31.601131] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T18:01:31.843289] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-19T18:01:32.066801] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T18:01:32.105603] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T18:01:32.111721] [INFO ] [REMOTE ] CLH: Full fetch complete (41599 records). [2025-09-19T18:01:32.111903] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-19T18:01:32.112846] [FATAL] [VALIDATOR ] CLH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:01:32.112966] [FATAL] [MAIN ] CLH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:01:32.113048] [WARN ] [MAIN ] CLH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:01:32.113161] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-19T18:01:32.113256] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-19T18:01:32.113319] [INFO ] [LOCAL ] CLH: Starting deletion of derivative data. [2025-09-19T18:01:32.113986] [DEBUG] [LOCAL ] CLH: Deleted derivative data file. [2025-09-19T18:01:32.114123] [INFO ] [MAIN ] Update Progress: 467/2372 symbols completed. CLH took 34.7s. Estimated remaining: 4h 10m 44s. Rate: 7.6 symbols/min [2025-09-19T18:01:32.393747] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:32.478999] [DEBUG] [LOCAL ] CLX: Loaded 51779 existing records from primary storage. [2025-09-19T18:01:32.479266] [INFO ] [MAIN ] CLX: Loaded 51779 existing records. [2025-09-19T18:01:32.649163] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-19T18:01:32.796601] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:32.797004] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-19T18:01:32.797081] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-19T18:01:32.799126] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-19T18:01:32.799219] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-19T18:01:33.284895] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:33.443298] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-19T18:01:33.522856] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:01:34.243299] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-19T18:01:35.043304] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-19T18:01:35.407823] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-19T18:01:35.459587] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T18:01:35.787165] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T18:01:35.843251] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-19T18:01:36.162798] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:01:36.643297] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-19T18:01:37.443289] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-19T18:01:37.476549] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T18:01:37.927830] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:01:38.243285] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-19T18:01:39.043264] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-19T18:01:39.586775] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T18:01:39.624392] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T18:01:39.843265] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-19T18:01:40.342576] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T18:01:40.643293] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-19T18:01:41.271545] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T18:01:41.443262] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-19T18:01:42.243282] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-19T18:01:42.752687] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:01:43.043333] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-19T18:01:43.419852] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:01:43.843287] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-19T18:01:44.603313] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-19T18:01:44.643287] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-19T18:01:45.027771] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:01:45.085772] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T18:01:45.443289] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-19T18:01:46.243287] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-19T18:01:46.815948] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T18:01:47.048457] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-19T18:01:47.059897] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-19T18:01:47.068874] [INFO ] [REMOTE ] CLS: Full fetch complete (77449 records). [2025-09-19T18:01:47.069030] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-19T18:01:47.466841] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-19T18:01:47.466921] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-19T18:01:47.467738] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-19T18:01:47.467801] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-19T18:01:47.469389] [DEBUG] [LOCAL ] CLS: Trimmed 77449 records to 54422 (keeping 200 days of data) [2025-09-19T18:01:47.830407] [DEBUG] [LOCAL ] CLS: Primary data saved (54422 records). [2025-09-19T18:01:47.830636] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-19T18:01:47.830818] [INFO ] [MAIN ] Update Progress: 468/2372 symbols completed. CLS took 41.6s. Estimated remaining: 4h 11m 8s. Rate: 7.6 symbols/min [2025-09-19T18:01:47.857423] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-19T18:01:48.030721] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:48.087057] [DEBUG] [LOCAL ] CM: Loaded 49009 existing records from primary storage. [2025-09-19T18:01:48.087239] [INFO ] [MAIN ] CM: Loaded 49009 existing records. [2025-09-19T18:01:48.275892] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:48.276196] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-19T18:01:48.276252] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-19T18:01:48.277355] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-19T18:01:48.277433] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-19T18:01:48.703701] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:48.706399] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T18:01:48.704848] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-19T18:01:48.717634] [INFO ] [REMOTE ] CLVT: Full fetch complete (75240 records). [2025-09-19T18:01:48.717859] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-19T18:01:49.170524] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-19T18:01:49.170849] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-19T18:01:49.171824] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-19T18:01:49.172097] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-19T18:01:49.175265] [DEBUG] [LOCAL ] CLVT: Trimmed 75240 records to 52761 (keeping 200 days of data) [2025-09-19T18:01:49.188967] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T18:01:49.314100] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T18:01:49.444713] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-19T18:01:49.553305] [DEBUG] [LOCAL ] CLVT: Primary data saved (52761 records). [2025-09-19T18:01:49.553554] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-19T18:01:49.553830] [INFO ] [MAIN ] Update Progress: 469/2372 symbols completed. CLVT took 29.9s. Estimated remaining: 4h 10m 35s. Rate: 7.6 symbols/min [2025-09-19T18:01:49.737468] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:49.794027] [DEBUG] [LOCAL ] CMA: Loaded 50675 existing records from primary storage. [2025-09-19T18:01:49.794184] [INFO ] [MAIN ] CMA: Loaded 50675 existing records. [2025-09-19T18:01:49.973580] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:49.973875] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-19T18:01:49.973926] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-19T18:01:49.975033] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-19T18:01:49.975108] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-19T18:01:50.249202] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-19T18:01:50.341411] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:50.799378] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T18:01:51.043303] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-19T18:01:51.527462] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:01:51.624519] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:01:51.843310] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-19T18:01:52.450866] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T18:01:52.643276] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-19T18:01:53.443319] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-19T18:01:53.489154] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:01:54.243290] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-19T18:01:54.844089] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T18:01:55.043257] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-19T18:01:55.243780] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T18:01:55.843272] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-19T18:01:56.566132] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:01:56.643220] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-19T18:01:57.281571] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T18:01:57.333028] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T18:01:57.443219] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-19T18:01:58.243277] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-19T18:01:58.757021] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:01:58.807559] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:01:59.043230] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-19T18:01:59.593145] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T18:01:59.843261] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-19T18:02:00.643268] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-19T18:02:01.443280] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-19T18:02:01.733439] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-19T18:02:01.741574] [INFO ] [REMOTE ] CLX: Full fetch complete (72784 records). [2025-09-19T18:02:01.741782] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-19T18:02:02.174746] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-19T18:02:02.175256] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-19T18:02:02.187249] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T18:02:02.186678] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-19T18:02:02.188685] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-19T18:02:02.192526] [INFO ] [REMOTE ] CLW: Full fetch complete (35057 records). [2025-09-19T18:02:02.192911] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-19T18:02:02.194150] [FATAL] [VALIDATOR ] CLW: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:02:02.194395] [FATAL] [MAIN ] CLW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:02:02.194816] [WARN ] [MAIN ] CLW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:02:02.194915] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-19T18:02:02.195015] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-09-19T18:02:02.204744] [INFO ] [LOCAL ] CLW: Starting deletion of derivative data. [2025-09-19T18:02:02.210080] [DEBUG] [LOCAL ] CLX: Trimmed 72784 records to 52158 (keeping 200 days of data) [2025-09-19T18:02:02.223055] [DEBUG] [LOCAL ] CLW: Deleted derivative data file. [2025-09-19T18:02:02.223262] [INFO ] [MAIN ] Update Progress: 470/2372 symbols completed. CLW took 31.8s. Estimated remaining: 4h 10m 46s. Rate: 7.6 symbols/min [2025-09-19T18:02:02.246881] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T18:02:02.429405] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-19T18:02:02.539291] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:02.544793] [DEBUG] [LOCAL ] CMBT: No existing data file found in primary storage. [2025-09-19T18:02:02.548780] [WARN ] [MAIN ] CMBT: No existing data found, performing full refresh instead. [2025-09-19T18:02:02.551381] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-19T18:02:02.551746] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-19T18:02:02.553271] [DEBUG] [LOCAL ] CMBT: No primary data file found to delete. [2025-09-19T18:02:02.554830] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-19T18:02:03.067791] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:03.071849] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-19T18:02:03.180568] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T18:02:03.204542] [DEBUG] [LOCAL ] CLX: Primary data saved (52158 records). [2025-09-19T18:02:03.205062] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-19T18:02:03.205946] [INFO ] [MAIN ] Update Progress: 471/2372 symbols completed. CLX took 31.1s. Estimated remaining: 4h 10m 10s. Rate: 7.6 symbols/min [2025-09-19T18:02:03.390910] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:03.443056] [DEBUG] [LOCAL ] CMC: Loaded 46140 existing records from primary storage. [2025-09-19T18:02:03.443255] [INFO ] [MAIN ] CMC: Loaded 46140 existing records. [2025-09-19T18:02:03.640023] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:03.640297] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-19T18:02:03.640351] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-19T18:02:03.641839] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-19T18:02:03.641902] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-19T18:02:03.866754] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-19T18:02:04.026798] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:04.402091] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:02:04.445087] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T18:02:04.643261] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-19T18:02:05.443261] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-19T18:02:06.090813] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:02:06.208267] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T18:02:06.243304] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-19T18:02:07.043310] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-19T18:02:07.369107] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T18:02:07.843284] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-19T18:02:08.155470] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T18:02:08.324775] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T18:02:08.643271] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-19T18:02:09.355523] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T18:02:09.443272] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-19T18:02:10.243277] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-19T18:02:10.709897] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T18:02:10.847350] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T18:02:11.043312] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-19T18:02:11.128452] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T18:02:11.843289] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-19T18:02:12.643293] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-19T18:02:12.967147] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T18:02:13.274061] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T18:02:13.443259] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-19T18:02:13.919774] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T18:02:14.243310] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-19T18:02:15.043314] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-19T18:02:15.458736] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T18:02:15.843270] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-19T18:02:16.286530] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T18:02:16.643262] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-19T18:02:16.675201] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:02:16.682725] [INFO ] [REMOTE ] CM: Full fetch complete (68998 records). [2025-09-19T18:02:16.682900] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-19T18:02:16.683821] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:02:16.683943] [FATAL] [MAIN ] CM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:02:16.683987] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:02:16.684049] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-19T18:02:16.684127] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-19T18:02:16.684182] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-09-19T18:02:16.684865] [DEBUG] [LOCAL ] CM: Deleted derivative data file. [2025-09-19T18:02:16.684983] [INFO ] [MAIN ] Update Progress: 472/2372 symbols completed. CM took 28.9s. Estimated remaining: 4h 10m 25s. Rate: 7.6 symbols/min [2025-09-19T18:02:16.875770] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:16.882880] [DEBUG] [LOCAL ] CMCM: Loaded 4678 existing records from primary storage. [2025-09-19T18:02:16.882999] [INFO ] [MAIN ] CMCM: Loaded 4678 existing records. [2025-09-19T18:02:17.069201] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:17.069489] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-19T18:02:17.069540] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-19T18:02:17.069870] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-19T18:02:17.069934] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-19T18:02:17.451103] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-19T18:02:17.458881] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:17.475447] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T18:02:17.516933] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T18:02:18.243280] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-19T18:02:19.043274] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-19T18:02:19.128168] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T18:02:19.629327] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T18:02:19.843273] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-19T18:02:20.377639] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T18:02:20.461473] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T18:02:20.643287] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-19T18:02:21.443288] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-19T18:02:22.243317] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-19T18:02:22.589829] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T18:02:23.043319] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-19T18:02:23.400506] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:02:23.488361] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T18:02:23.843264] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-19T18:02:23.918300] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T18:02:24.643269] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-19T18:02:25.443343] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-19T18:02:25.903031] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:02:25.914053] [INFO ] [REMOTE ] CMA: Full fetch complete (73392 records). [2025-09-19T18:02:25.914299] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-19T18:02:26.257990] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-19T18:02:26.526526] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-19T18:02:26.527004] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-19T18:02:26.529448] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-19T18:02:26.530100] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T18:02:26.530445] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-19T18:02:26.535597] [DEBUG] [LOCAL ] CMA: Trimmed 73392 records to 51012 (keeping 200 days of data) [2025-09-19T18:02:26.721687] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T18:02:26.996702] [DEBUG] [LOCAL ] CMA: Primary data saved (51012 records). [2025-09-19T18:02:26.996885] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-19T18:02:26.996991] [INFO ] [MAIN ] Update Progress: 473/2372 symbols completed. CMA took 37.4s. Estimated remaining: 4h 10m 26s. Rate: 7.6 symbols/min [2025-09-19T18:02:27.053888] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-19T18:02:27.177742] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:27.177952] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-19T18:02:27.177991] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-19T18:02:27.178137] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-19T18:02:27.178180] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-19T18:02:27.178222] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-19T18:02:27.178253] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-19T18:02:27.588514] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:27.599904] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T18:02:27.776510] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T18:02:27.843264] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-19T18:02:28.643286] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-19T18:02:28.870621] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:28.871011] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-19T18:02:29.443309] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-19T18:02:29.971342] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T18:02:30.062064] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-19T18:02:30.243329] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-19T18:02:31.043219] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-19T18:02:31.410706] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-19T18:02:31.843311] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-19T18:02:32.324957] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T18:02:32.331825] [INFO ] [REMOTE ] CMC: Full fetch complete (66843 records). [2025-09-19T18:02:32.331955] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-19T18:02:32.645853] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-19T18:02:32.738978] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T18:02:32.739165] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-19T18:02:32.741425] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-19T18:02:32.742233] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-19T18:02:32.742297] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-19T18:02:32.743626] [DEBUG] [LOCAL ] CMC: Trimmed 66843 records to 46515 (keeping 200 days of data) [2025-09-19T18:02:33.030659] [DEBUG] [LOCAL ] CMC: Primary data saved (46515 records). [2025-09-19T18:02:33.030812] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-19T18:02:33.031481] [INFO ] [MAIN ] Update Progress: 474/2372 symbols completed. CMC took 29.8s. Estimated remaining: 4h 10m 11s. Rate: 7.6 symbols/min [2025-09-19T18:02:33.199543] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:33.255805] [DEBUG] [LOCAL ] CMG: Loaded 54110 existing records from primary storage. [2025-09-19T18:02:33.255961] [INFO ] [MAIN ] CMG: Loaded 54110 existing records. [2025-09-19T18:02:33.434953] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:33.435229] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-19T18:02:33.435290] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-19T18:02:33.436470] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-19T18:02:33.436531] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-19T18:02:33.451910] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-19T18:02:33.802749] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:34.243277] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-19T18:02:34.343233] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T18:02:34.635622] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T18:02:35.043321] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-19T18:02:35.283471] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:35.284052] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-19T18:02:35.843262] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-19T18:02:36.643286] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-19T18:02:36.854353] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:36.854720] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-19T18:02:36.986527] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-19T18:02:37.443311] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-19T18:02:37.592437] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T18:02:37.600514] [INFO ] [REMOTE ] CMBT: Full fetch complete (28630 records). [2025-09-19T18:02:37.600692] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-19T18:02:37.678732] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:37.714257] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-19T18:02:38.016209] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-19T18:02:38.016294] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-19T18:02:38.016864] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-19T18:02:38.016943] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-19T18:02:38.017788] [DEBUG] [LOCAL ] CMBT: Trimmed 28630 records to 21759 (keeping 200 days of data) [2025-09-19T18:02:38.160288] [DEBUG] [LOCAL ] CMBT: Primary data saved (21759 records). [2025-09-19T18:02:38.160454] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-19T18:02:38.160554] [INFO ] [MAIN ] Update Progress: 475/2372 symbols completed. CMBT took 35.9s. Estimated remaining: 4h 9m 52s. Rate: 7.6 symbols/min [2025-09-19T18:02:38.248370] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-19T18:02:38.351430] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:38.408910] [DEBUG] [LOCAL ] CMI: Loaded 42298 existing records from primary storage. [2025-09-19T18:02:38.409092] [INFO ] [MAIN ] CMI: Loaded 42298 existing records. [2025-09-19T18:02:38.507831] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:38.527960] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-19T18:02:38.616270] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:38.616585] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-19T18:02:38.616664] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-19T18:02:38.617728] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-19T18:02:38.617791] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-19T18:02:39.026572] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:39.043314] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-19T18:02:39.843265] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-19T18:02:40.436842] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T18:02:40.643275] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-19T18:02:41.443268] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-19T18:02:41.677896] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T18:02:41.835598] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T18:02:42.243264] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-19T18:02:43.043280] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-19T18:02:43.535884] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T18:02:43.616011] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T18:02:43.781947] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T18:02:43.784001] [INFO ] [REMOTE ] CMCM: Full fetch complete (7014 records). [2025-09-19T18:02:43.784074] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-19T18:02:43.848337] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-19T18:02:44.156245] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-19T18:02:44.156398] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-19T18:02:44.156607] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-19T18:02:44.156668] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-19T18:02:44.157092] [DEBUG] [LOCAL ] CMCM: Trimmed 7014 records to 4718 (keeping 200 days of data) [2025-09-19T18:02:44.182884] [DEBUG] [LOCAL ] CMCM: Primary data saved (4718 records). [2025-09-19T18:02:44.182981] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-19T18:02:44.183060] [INFO ] [MAIN ] Update Progress: 476/2372 symbols completed. CMCM took 27.5s. Estimated remaining: 4h 9m 37s. Rate: 7.6 symbols/min [2025-09-19T18:02:44.354484] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:44.395757] [DEBUG] [LOCAL ] CMP: Loaded 36915 existing records from primary storage. [2025-09-19T18:02:44.395911] [INFO ] [MAIN ] CMP: Loaded 36915 existing records. [2025-09-19T18:02:44.577575] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:44.577910] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-19T18:02:44.577997] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-19T18:02:44.578940] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-19T18:02:44.579004] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-19T18:02:44.648375] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-19T18:02:44.950916] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:45.362045] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T18:02:45.443259] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-19T18:02:46.211958] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T18:02:46.243240] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-19T18:02:47.043273] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-19T18:02:47.282594] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T18:02:47.843275] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-19T18:02:48.644998] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-19T18:02:48.643463] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-19T18:02:48.891099] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T18:02:48.929692] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T18:02:49.443265] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-19T18:02:50.243255] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-19T18:02:50.627232] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:02:50.667865] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T18:02:50.670469] [INFO ] [REMOTE ] CMDB: Full fetch complete (10556 records). [2025-09-19T18:02:50.670546] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-19T18:02:50.886389] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 94 unique days, need 200 days [2025-09-19T18:02:50.886725] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:02:50.886832] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:02:50.886920] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-19T18:02:50.887045] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-19T18:02:50.887153] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-19T18:02:50.887263] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-19T18:02:50.887391] [INFO ] [MAIN ] Update Progress: 477/2372 symbols completed. CMDB took 23.9s. Estimated remaining: 4h 9m 24s. Rate: 7.6 symbols/min [2025-09-19T18:02:51.043323] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-19T18:02:51.515281] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T18:02:51.843290] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-19T18:02:52.643280] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-19T18:02:53.042561] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:02:53.443259] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-19T18:02:53.592535] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T18:02:54.243273] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-19T18:02:54.331476] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T18:02:55.043274] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-19T18:02:55.834137] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T18:02:55.852242] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-19T18:02:55.933847] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T18:02:56.067295] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T18:02:56.643270] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-19T18:02:57.443241] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-19T18:02:57.808198] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:02:58.243267] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-19T18:02:58.431391] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:02:58.463909] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T18:02:59.043256] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-19T18:02:59.843256] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-19T18:03:00.825201] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:03:00.837538] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-19T18:03:00.974162] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T18:03:01.443266] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-19T18:03:02.306296] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-19T18:03:02.315918] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-19T18:03:03.879978] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (3.04 seconds). [2025-09-19T18:03:03.892065] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-19T18:03:04.766406] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (3.32 seconds). [2025-09-19T18:03:04.775253] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-19T18:03:04.851945] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-19T18:03:04.860360] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-19T18:03:06.495189] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T18:03:06.501832] [INFO ] [REMOTE ] CMI: Full fetch complete (59821 records). [2025-09-19T18:03:06.501998] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-19T18:03:06.820453] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:03:06.860602] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-19T18:03:06.959045] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-19T18:03:06.959136] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-19T18:03:06.959833] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-19T18:03:06.959898] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-19T18:03:06.961304] [DEBUG] [LOCAL ] CMI: Trimmed 59821 records to 42606 (keeping 200 days of data) [2025-09-19T18:03:07.207711] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.32 seconds). [2025-09-19T18:03:07.221720] [INFO ] [REMOTE ] CMG: Full fetch complete (77403 records). [2025-09-19T18:03:07.222489] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-19T18:03:07.227559] [FATAL] [VALIDATOR ] CMG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:03:07.232429] [FATAL] [MAIN ] CMG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:03:07.235120] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:03:07.235697] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-19T18:03:07.237000] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-19T18:03:07.237300] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-09-19T18:03:07.239511] [DEBUG] [LOCAL ] CMG: Deleted derivative data file. [2025-09-19T18:03:07.240940] [INFO ] [MAIN ] Update Progress: 478/2372 symbols completed. CMG took 34.2s. Estimated remaining: 4h 9m 49s. Rate: 7.6 symbols/min [2025-09-19T18:03:07.270735] [DEBUG] [LOCAL ] CMI: Primary data saved (42606 records). [2025-09-19T18:03:07.270847] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-19T18:03:07.270925] [INFO ] [MAIN ] Update Progress: 479/2372 symbols completed. CMI took 29.1s. Estimated remaining: 4h 9m 10s. Rate: 7.6 symbols/min [2025-09-19T18:03:08.610752] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:03:08.618404] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-19T18:03:09.660524] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T18:03:09.665029] [INFO ] [REMOTE ] CMP: Full fetch complete (53313 records). [2025-09-19T18:03:09.665130] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-19T18:03:10.061584] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-19T18:03:10.061700] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-19T18:03:10.062397] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-19T18:03:10.062460] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-19T18:03:10.063820] [DEBUG] [LOCAL ] CMP: Trimmed 53313 records to 37120 (keeping 200 days of data) [2025-09-19T18:03:10.293997] [DEBUG] [LOCAL ] CMP: Primary data saved (37120 records). [2025-09-19T18:03:10.294154] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-19T18:03:10.294242] [INFO ] [MAIN ] Update Progress: 480/2372 symbols completed. CMP took 26.1s. Estimated remaining: 4h 8m 43s. Rate: 7.6 symbols/min [2025-09-19T18:03:10.896871] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:10.936611] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:10.976007] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:11.029598] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:11.035503] [DEBUG] [LOCAL ] CMSA: Loaded 3384 existing records from primary storage. [2025-09-19T18:03:11.035832] [INFO ] [MAIN ] CMSA: Loaded 3384 existing records. [2025-09-19T18:03:11.141802] [DEBUG] [LOCAL ] CMSC: Loaded 5156 existing records from primary storage. [2025-09-19T18:03:11.153832] [INFO ] [MAIN ] CMSC: Loaded 5156 existing records. [2025-09-19T18:03:11.376994] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:11.493720] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:11.494595] [DEBUG] [LOCAL ] CMS: Loaded 53032 existing records from primary storage. [2025-09-19T18:03:11.464415] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-19T18:03:11.495608] [DEBUG] [LOCAL ] CMRE: Loaded 35979 existing records from primary storage. [2025-09-19T18:03:11.495805] [INFO ] [MAIN ] CMS: Loaded 53032 existing records. [2025-09-19T18:03:11.495996] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-19T18:03:11.501395] [INFO ] [MAIN ] CMRE: Loaded 35979 existing records. [2025-09-19T18:03:11.496158] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-19T18:03:11.496200] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-19T18:03:11.527427] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-19T18:03:11.536847] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-19T18:03:11.566852] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-19T18:03:11.582395] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-19T18:03:12.053778] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:12.104580] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:12.154699] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-19T18:03:12.173427] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-19T18:03:12.197231] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-19T18:03:12.218403] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-19T18:03:12.218568] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-19T18:03:12.268503] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-19T18:03:12.344319] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-19T18:03:12.388567] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-19T18:03:13.098923] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:13.163344] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:13.221297] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-19T18:03:13.199579] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-19T18:03:13.379999] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:13.397524] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-19T18:03:13.446450] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:13.447002] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-19T18:03:15.150091] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T18:03:15.151874] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-19T18:03:15.299767] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:03:15.301587] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-19T18:03:15.640230] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T18:03:15.645865] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-19T18:03:15.690287] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-19T18:03:15.692153] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-19T18:03:16.130671] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T18:03:16.132295] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-19T18:03:16.294876] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T18:03:16.296399] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-19T18:03:16.501981] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-19T18:03:16.503617] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-19T18:03:16.523592] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:03:16.530607] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-19T18:03:16.712959] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T18:03:16.715073] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-19T18:03:16.868820] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-19T18:03:17.057950] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (3.66 seconds). [2025-09-19T18:03:17.443281] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-19T18:03:17.568457] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T18:03:18.047527] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T18:03:18.243273] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-19T18:03:19.043248] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-19T18:03:19.117257] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:03:19.434374] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T18:03:19.843242] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-19T18:03:19.890758] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T18:03:20.643297] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-19T18:03:20.821734] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T18:03:21.341162] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T18:03:21.443258] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-19T18:03:22.243276] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-19T18:03:22.716601] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T18:03:23.043263] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-19T18:03:23.469394] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T18:03:23.678178] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-19T18:03:23.843290] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-19T18:03:24.522950] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T18:03:24.643310] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-19T18:03:25.150443] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T18:03:25.443321] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-19T18:03:26.243261] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-19T18:03:26.251826] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T18:03:26.885507] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-19T18:03:26.886761] [INFO ] [REMOTE ] CMSC: Full fetch complete (7158 records). [2025-09-19T18:03:26.886831] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-19T18:03:27.050761] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-19T18:03:27.296581] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-19T18:03:27.296715] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-19T18:03:27.296932] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-19T18:03:27.296974] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-19T18:03:27.297381] [DEBUG] [LOCAL ] CMSC: Trimmed 7158 records to 5184 (keeping 200 days of data) [2025-09-19T18:03:27.329558] [DEBUG] [LOCAL ] CMSC: Primary data saved (5184 records). [2025-09-19T18:03:27.329695] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-19T18:03:27.329807] [INFO ] [MAIN ] Update Progress: 481/2372 symbols completed. CMSC took 17.0s. Estimated remaining: 4h 9m 11s. Rate: 7.6 symbols/min [2025-09-19T18:03:27.510972] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:27.526212] [DEBUG] [LOCAL ] CMSD: Loaded 8213 existing records from primary storage. [2025-09-19T18:03:27.526391] [INFO ] [MAIN ] CMSD: Loaded 8213 existing records. [2025-09-19T18:03:27.726560] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:27.726862] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-19T18:03:27.726913] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-19T18:03:27.727269] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-19T18:03:27.727331] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-19T18:03:27.848346] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-19T18:03:28.094198] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:28.381413] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:03:28.643273] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-19T18:03:28.662275] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T18:03:29.443276] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-19T18:03:29.640850] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T18:03:30.243298] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-19T18:03:30.636922] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T18:03:30.944481] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T18:03:30.945593] [INFO ] [REMOTE ] CMSA: Full fetch complete (5024 records). [2025-09-19T18:03:30.945692] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-19T18:03:31.048463] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-19T18:03:31.336525] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-19T18:03:31.336608] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-19T18:03:31.336822] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-19T18:03:31.336897] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-19T18:03:31.337288] [DEBUG] [LOCAL ] CMSA: Trimmed 5024 records to 3404 (keeping 200 days of data) [2025-09-19T18:03:31.359925] [DEBUG] [LOCAL ] CMSA: Primary data saved (3404 records). [2025-09-19T18:03:31.360064] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-19T18:03:31.360183] [INFO ] [MAIN ] Update Progress: 482/2372 symbols completed. CMSA took 21.1s. Estimated remaining: 4h 8m 48s. Rate: 7.6 symbols/min [2025-09-19T18:03:31.532987] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:31.572159] [DEBUG] [LOCAL ] CMTG: Loaded 38077 existing records from primary storage. [2025-09-19T18:03:31.572312] [INFO ] [MAIN ] CMTG: Loaded 38077 existing records. [2025-09-19T18:03:31.751895] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:31.752253] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-19T18:03:31.752312] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-19T18:03:31.753336] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-19T18:03:31.753400] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-19T18:03:31.852373] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-19T18:03:32.110322] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:32.643268] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-19T18:03:32.778009] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T18:03:33.170672] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-19T18:03:33.440586] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T18:03:33.450529] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-19T18:03:34.243299] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-19T18:03:35.048854] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-19T18:03:35.058906] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T18:03:35.803713] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T18:03:35.843728] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-19T18:03:35.845878] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:03:36.643279] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-19T18:03:37.266608] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T18:03:37.443309] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-19T18:03:37.875813] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T18:03:38.243295] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-19T18:03:39.043345] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-19T18:03:39.239841] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T18:03:39.282864] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T18:03:39.843266] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-19T18:03:40.523799] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T18:03:40.643265] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-19T18:03:40.886131] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T18:03:41.443276] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-19T18:03:42.243309] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-19T18:03:42.488008] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T18:03:42.584019] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T18:03:43.043267] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-19T18:03:43.162427] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T18:03:43.843271] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-19T18:03:44.643273] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-19T18:03:44.687162] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T18:03:45.443280] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-19T18:03:45.507489] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T18:03:45.512454] [INFO ] [REMOTE ] CMRE: Full fetch complete (49457 records). [2025-09-19T18:03:45.512544] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-19T18:03:45.890483] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-19T18:03:45.890569] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-19T18:03:45.891188] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-19T18:03:45.891252] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-19T18:03:45.892364] [DEBUG] [LOCAL ] CMRE: Trimmed 49457 records to 36224 (keeping 200 days of data) [2025-09-19T18:03:46.119570] [DEBUG] [LOCAL ] CMRE: Primary data saved (36224 records). [2025-09-19T18:03:46.119744] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-19T18:03:46.119874] [INFO ] [MAIN ] Update Progress: 483/2372 symbols completed. CMRE took 35.8s. Estimated remaining: 4h 9m 7s. Rate: 7.6 symbols/min [2025-09-19T18:03:46.248967] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-19T18:03:46.255547] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T18:03:46.317005] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:46.326795] [DEBUG] [LOCAL ] CMU: Loaded 7421 existing records from primary storage. [2025-09-19T18:03:46.326920] [INFO ] [MAIN ] CMU: Loaded 7421 existing records. [2025-09-19T18:03:46.504265] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:46.504497] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-19T18:03:46.504547] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-19T18:03:46.504896] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-19T18:03:46.504967] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-19T18:03:46.872296] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:46.907676] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T18:03:47.043297] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-19T18:03:47.843269] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-19T18:03:48.120731] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T18:03:48.153383] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:03:48.643291] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-19T18:03:48.702517] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T18:03:49.443267] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-19T18:03:49.498147] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T18:03:50.162866] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T18:03:50.164432] [INFO ] [REMOTE ] CMSD: Full fetch complete (12600 records). [2025-09-19T18:03:50.164548] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-19T18:03:50.248435] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-19T18:03:50.532143] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-19T18:03:50.532229] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-19T18:03:50.532538] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-19T18:03:50.532577] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-19T18:03:50.533093] [DEBUG] [LOCAL ] CMSD: Trimmed 12600 records to 8242 (keeping 200 days of data) [2025-09-19T18:03:50.586232] [DEBUG] [LOCAL ] CMSD: Primary data saved (8242 records). [2025-09-19T18:03:50.586383] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-19T18:03:50.586513] [INFO ] [MAIN ] Update Progress: 484/2372 symbols completed. CMSD took 23.3s. Estimated remaining: 4h 8m 46s. Rate: 7.6 symbols/min [2025-09-19T18:03:50.759930] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:50.796806] [DEBUG] [LOCAL ] CNA: Loaded 33018 existing records from primary storage. [2025-09-19T18:03:50.796984] [INFO ] [MAIN ] CNA: Loaded 33018 existing records. [2025-09-19T18:03:50.977909] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:50.978195] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-19T18:03:50.978253] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-19T18:03:50.979294] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-19T18:03:50.979355] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-19T18:03:51.052994] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-19T18:03:51.378260] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:51.711421] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:03:51.843224] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-19T18:03:51.899935] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T18:03:52.643276] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-19T18:03:53.360623] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T18:03:53.368786] [INFO ] [REMOTE ] CMS: Full fetch complete (76036 records). [2025-09-19T18:03:53.368937] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-19T18:03:53.448370] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-19T18:03:53.696634] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T18:03:53.791637] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-19T18:03:53.791756] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-19T18:03:53.792586] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-19T18:03:53.792688] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-19T18:03:53.797216] [DEBUG] [LOCAL ] CMS: Trimmed 76036 records to 53419 (keeping 200 days of data) [2025-09-19T18:03:54.127297] [DEBUG] [LOCAL ] CMS: Primary data saved (53419 records). [2025-09-19T18:03:54.127436] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-19T18:03:54.127555] [INFO ] [MAIN ] Update Progress: 485/2372 symbols completed. CMS took 43.8s. Estimated remaining: 4h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T18:03:54.248380] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-19T18:03:54.313292] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:54.373267] [DEBUG] [LOCAL ] CNC: Loaded 54119 existing records from primary storage. [2025-09-19T18:03:54.373442] [INFO ] [MAIN ] CNC: Loaded 54119 existing records. [2025-09-19T18:03:54.569766] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:54.570139] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-19T18:03:54.570203] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-19T18:03:54.571719] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-19T18:03:54.571792] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-19T18:03:54.952069] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:55.043286] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-19T18:03:55.254392] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:03:55.283463] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T18:03:55.843273] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-19T18:03:56.549445] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T18:03:56.643231] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-19T18:03:56.861022] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T18:03:57.035270] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-19T18:03:57.443286] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-19T18:03:58.243286] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-19T18:03:58.340484] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T18:03:59.043267] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-19T18:03:59.843267] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-19T18:04:00.376733] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T18:04:00.643277] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-19T18:04:00.726267] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:04:01.443269] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-19T18:04:01.743742] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:04:01.760251] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T18:04:02.243264] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-19T18:04:02.439862] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:04:03.043297] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-19T18:04:03.615210] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-19T18:04:03.616720] [INFO ] [REMOTE ] CMU: Full fetch complete (9661 records). [2025-09-19T18:04:03.616831] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-19T18:04:03.848972] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-19T18:04:03.980441] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-19T18:04:03.980524] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-19T18:04:03.980825] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-19T18:04:03.980910] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-19T18:04:03.982285] [DEBUG] [LOCAL ] CMU: Trimmed 9661 records to 7451 (keeping 200 days of data) [2025-09-19T18:04:04.032764] [DEBUG] [LOCAL ] CMU: Primary data saved (7451 records). [2025-09-19T18:04:04.032873] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-19T18:04:04.033036] [INFO ] [MAIN ] Update Progress: 486/2372 symbols completed. CMU took 17.9s. Estimated remaining: 4h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T18:04:04.199701] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:04.218575] [DEBUG] [LOCAL ] CNF: Loaded 10837 existing records from primary storage. [2025-09-19T18:04:04.218723] [INFO ] [MAIN ] CNF: Loaded 10837 existing records. [2025-09-19T18:04:04.393209] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:04.393485] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-19T18:04:04.393571] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-19T18:04:04.394035] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-19T18:04:04.394106] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-19T18:04:04.648341] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-19T18:04:04.752202] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:05.197528] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T18:04:05.443263] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-19T18:04:05.781607] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:04:06.243268] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-19T18:04:07.043286] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-19T18:04:07.117066] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T18:04:07.629714] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-19T18:04:07.843238] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-19T18:04:07.910995] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T18:04:08.643278] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-19T18:04:08.880972] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T18:04:09.005514] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-19T18:04:09.443306] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-19T18:04:10.243288] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-19T18:04:10.791121] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T18:04:11.043267] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-19T18:04:11.843317] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-19T18:04:12.055741] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T18:04:12.643391] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-19T18:04:12.716632] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (3.27 seconds). [2025-09-19T18:04:13.030005] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (10.79 seconds). [2025-09-19T18:04:13.426051] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T18:04:13.443275] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-19T18:04:13.471770] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:04:13.476893] [INFO ] [REMOTE ] CMTG: Full fetch complete (53064 records). [2025-09-19T18:04:13.477029] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-19T18:04:13.879490] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-19T18:04:13.879691] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-19T18:04:13.880334] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-19T18:04:13.880378] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-19T18:04:13.881597] [DEBUG] [LOCAL ] CMTG: Trimmed 53064 records to 38290 (keeping 200 days of data) [2025-09-19T18:04:14.115707] [DEBUG] [LOCAL ] CMTG: Primary data saved (38290 records). [2025-09-19T18:04:14.115853] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-19T18:04:14.116003] [INFO ] [MAIN ] Update Progress: 487/2372 symbols completed. CMTG took 42.8s. Estimated remaining: 4h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T18:04:14.258438] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-19T18:04:14.294601] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:14.296595] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-09-19T18:04:14.296712] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-09-19T18:04:14.296977] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-19T18:04:14.297057] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-19T18:04:14.297134] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-09-19T18:04:14.297175] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-19T18:04:14.702953] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:14.681127] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T18:04:15.043298] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-19T18:04:15.132462] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T18:04:15.843297] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-19T18:04:16.643267] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-19T18:04:17.007457] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T18:04:17.190720] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T18:04:17.443267] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-19T18:04:17.828224] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:04:18.243268] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-19T18:04:19.043237] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-19T18:04:19.165371] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T18:04:19.225808] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T18:04:19.843257] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-19T18:04:20.643283] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-19T18:04:20.901673] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T18:04:21.443276] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-19T18:04:22.148202] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T18:04:22.186678] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T18:04:22.243223] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-19T18:04:22.674283] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:04:23.043265] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-19T18:04:23.391172] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T18:04:23.395978] [INFO ] [REMOTE ] CNA: Full fetch complete (45400 records). [2025-09-19T18:04:23.396070] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-19T18:04:23.782150] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-19T18:04:23.782500] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-19T18:04:23.783377] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-19T18:04:23.783442] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-19T18:04:23.786048] [DEBUG] [LOCAL ] CNA: Trimmed 45400 records to 33238 (keeping 200 days of data) [2025-09-19T18:04:23.855573] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-19T18:04:24.012525] [DEBUG] [LOCAL ] CNA: Primary data saved (33238 records). [2025-09-19T18:04:24.012728] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-19T18:04:24.012848] [INFO ] [MAIN ] Update Progress: 488/2372 symbols completed. CNA took 33.4s. Estimated remaining: 4h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T18:04:24.191559] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:24.250079] [DEBUG] [LOCAL ] CNI: Loaded 52046 existing records from primary storage. [2025-09-19T18:04:24.250227] [INFO ] [MAIN ] CNI: Loaded 52046 existing records. [2025-09-19T18:04:24.446166] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:24.446476] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-19T18:04:24.446529] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-19T18:04:24.448280] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-19T18:04:24.448345] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-19T18:04:24.645420] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-19T18:04:24.846801] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:25.228127] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T18:04:25.443280] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-19T18:04:25.840193] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T18:04:25.842738] [INFO ] [REMOTE ] CNF: Full fetch complete (12610 records). [2025-09-19T18:04:25.842817] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-19T18:04:26.244908] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-19T18:04:26.254602] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-19T18:04:26.255994] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-19T18:04:26.256350] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-19T18:04:26.256512] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-19T18:04:26.257343] [DEBUG] [LOCAL ] CNF: Trimmed 12610 records to 10887 (keeping 200 days of data) [2025-09-19T18:04:26.337666] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T18:04:26.365552] [DEBUG] [LOCAL ] CNF: Primary data saved (10887 records). [2025-09-19T18:04:26.365714] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-19T18:04:26.365832] [INFO ] [MAIN ] Update Progress: 489/2372 symbols completed. CNF took 22.3s. Estimated remaining: 4h 7m 52s. Rate: 7.6 symbols/min [2025-09-19T18:04:26.540329] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:26.601541] [DEBUG] [LOCAL ] CNK: Loaded 53299 existing records from primary storage. [2025-09-19T18:04:26.601740] [INFO ] [MAIN ] CNK: Loaded 53299 existing records. [2025-09-19T18:04:26.785747] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:26.786006] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-19T18:04:26.786054] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-19T18:04:26.787488] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-19T18:04:26.787549] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-19T18:04:27.045773] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-19T18:04:27.166636] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:27.196495] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T18:04:27.843232] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-19T18:04:28.006138] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T18:04:28.643298] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-19T18:04:29.342015] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T18:04:29.443232] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-19T18:04:29.754382] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T18:04:30.243300] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-19T18:04:30.810294] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T18:04:31.043283] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-19T18:04:31.143743] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T18:04:31.770463] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T18:04:31.843321] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-19T18:04:32.643285] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-19T18:04:33.146680] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:04:33.443260] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-19T18:04:33.799436] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:04:34.243278] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-19T18:04:35.043305] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-19T18:04:35.354139] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:04:35.514553] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-19T18:04:35.717622] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T18:04:35.843264] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-19T18:04:36.565749] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T18:04:36.643278] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-19T18:04:37.216078] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T18:04:37.443276] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-19T18:04:38.020255] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:04:38.243260] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-19T18:04:39.043301] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-19T18:04:39.795775] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-19T18:04:39.843235] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-19T18:04:40.179204] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T18:04:40.643262] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-19T18:04:41.163606] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T18:04:41.302690] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:04:41.443277] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-19T18:04:42.243327] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-19T18:04:43.043288] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-19T18:04:43.159351] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-19T18:04:43.461540] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T18:04:43.575847] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:04:43.583372] [INFO ] [REMOTE ] CNH: Full fetch complete (77146 records). [2025-09-19T18:04:43.583504] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-19T18:04:43.584772] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:04:43.584866] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:04:43.584910] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:04:43.584997] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-19T18:04:43.585092] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-09-19T18:04:43.585160] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-09-19T18:04:43.585243] [DEBUG] [LOCAL ] CNH: No derivative data file found to delete. [2025-09-19T18:04:43.585326] [INFO ] [MAIN ] Update Progress: 490/2372 symbols completed. CNH took 29.5s. Estimated remaining: 4h 8m 20s. Rate: 7.6 symbols/min [2025-09-19T18:04:43.762796] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:43.816424] [DEBUG] [LOCAL ] CNM: Loaded 51337 existing records from primary storage. [2025-09-19T18:04:43.816598] [INFO ] [MAIN ] CNM: Loaded 51337 existing records. [2025-09-19T18:04:43.848980] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-19T18:04:44.010539] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:44.010836] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-19T18:04:44.010890] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-19T18:04:44.012192] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-19T18:04:44.012269] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-19T18:04:44.394862] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:44.643248] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-19T18:04:45.101514] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T18:04:45.443267] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-19T18:04:45.938832] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T18:04:45.948271] [INFO ] [REMOTE ] CNC: Full fetch complete (77279 records). [2025-09-19T18:04:45.948457] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-19T18:04:45.953552] [FATAL] [VALIDATOR ] CNC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:04:45.953716] [FATAL] [MAIN ] CNC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:04:45.953769] [WARN ] [MAIN ] CNC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:04:45.953835] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-19T18:04:45.953903] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-09-19T18:04:45.953938] [INFO ] [LOCAL ] CNC: Starting deletion of derivative data. [2025-09-19T18:04:45.954387] [DEBUG] [LOCAL ] CNC: Deleted derivative data file. [2025-09-19T18:04:45.956893] [INFO ] [MAIN ] Update Progress: 491/2372 symbols completed. CNC took 51.8s. Estimated remaining: 4h 7m 51s. Rate: 7.6 symbols/min [2025-09-19T18:04:46.136143] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:46.198193] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T18:04:46.220436] [DEBUG] [LOCAL ] CNMD: Loaded 32887 existing records from primary storage. [2025-09-19T18:04:46.220675] [INFO ] [MAIN ] CNMD: Loaded 32887 existing records. [2025-09-19T18:04:46.253480] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-19T18:04:46.406338] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:46.406606] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-19T18:04:46.406684] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-19T18:04:46.407758] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-19T18:04:46.407821] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-19T18:04:46.767918] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:47.043274] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-19T18:04:47.477956] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:04:47.843252] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-19T18:04:48.647302] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-19T18:04:48.651357] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-19T18:04:49.039838] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T18:04:49.443273] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-19T18:04:49.887283] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T18:04:50.087638] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:04:50.243265] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-19T18:04:51.043260] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-19T18:04:51.621630] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T18:04:51.843225] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-19T18:04:51.844737] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T18:04:51.853693] [INFO ] [REMOTE ] CNK: Full fetch complete (75623 records). [2025-09-19T18:04:51.853812] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-19T18:04:52.273701] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-19T18:04:52.273800] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-19T18:04:52.274691] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-19T18:04:52.274770] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-19T18:04:52.276930] [DEBUG] [LOCAL ] CNK: Trimmed 75623 records to 53688 (keeping 200 days of data) [2025-09-19T18:04:52.629888] [DEBUG] [LOCAL ] CNK: Primary data saved (53688 records). [2025-09-19T18:04:52.630036] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-19T18:04:52.630125] [INFO ] [MAIN ] Update Progress: 492/2372 symbols completed. CNK took 26.3s. Estimated remaining: 4h 7m 38s. Rate: 7.6 symbols/min [2025-09-19T18:04:52.655263] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-19T18:04:52.814942] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:52.853373] [DEBUG] [LOCAL ] CNNE: Loaded 37218 existing records from primary storage. [2025-09-19T18:04:52.853518] [INFO ] [MAIN ] CNNE: Loaded 37218 existing records. [2025-09-19T18:04:53.037549] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:53.037990] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-19T18:04:53.038209] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-19T18:04:53.039407] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-19T18:04:53.039475] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-19T18:04:53.258284] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T18:04:53.449780] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:53.446012] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-19T18:04:53.596188] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:04:54.243273] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-19T18:04:54.315944] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T18:04:55.043277] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-19T18:04:55.189767] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T18:04:55.843241] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-19T18:04:56.408599] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T18:04:56.433227] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T18:04:56.441691] [INFO ] [REMOTE ] CNI: Full fetch complete (74683 records). [2025-09-19T18:04:56.441866] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-19T18:04:56.651363] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-19T18:04:56.886421] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-19T18:04:56.886503] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-19T18:04:56.887310] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-19T18:04:56.887374] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-19T18:04:56.888810] [DEBUG] [LOCAL ] CNI: Trimmed 74683 records to 52411 (keeping 200 days of data) [2025-09-19T18:04:57.226414] [DEBUG] [LOCAL ] CNI: Primary data saved (52411 records). [2025-09-19T18:04:57.226603] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-19T18:04:57.226817] [INFO ] [MAIN ] Update Progress: 493/2372 symbols completed. CNI took 33.2s. Estimated remaining: 4h 7m 18s. Rate: 7.6 symbols/min [2025-09-19T18:04:57.415453] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T18:04:57.433218] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:57.447728] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-19T18:04:57.494417] [DEBUG] [LOCAL ] CNO: Loaded 41931 existing records from primary storage. [2025-09-19T18:04:57.494571] [INFO ] [MAIN ] CNO: Loaded 41931 existing records. [2025-09-19T18:04:57.686711] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:57.686992] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-19T18:04:57.687062] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-19T18:04:57.688970] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-19T18:04:57.689034] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-19T18:04:58.077535] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:58.099716] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:04:58.243275] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-19T18:04:59.043277] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-19T18:04:59.115343] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T18:04:59.843238] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-19T18:04:59.913452] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T18:05:00.526859] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T18:05:00.643282] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-19T18:05:01.443250] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-19T18:05:01.568618] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:05:01.666847] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T18:05:02.243334] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-19T18:05:03.043280] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-19T18:05:03.660155] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T18:05:03.843268] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-19T18:05:04.028098] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:05:04.347849] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:05:04.643304] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-19T18:05:05.058947] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T18:05:05.443305] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-19T18:05:06.243266] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-19T18:05:06.421296] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T18:05:07.043291] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-19T18:05:07.200527] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T18:05:07.843273] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-19T18:05:07.904293] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:05:08.648343] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-19T18:05:08.667335] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:05:09.443267] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-19T18:05:09.986354] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T18:05:10.116484] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T18:05:10.243282] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-19T18:05:10.840524] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:05:11.043222] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-19T18:05:11.501037] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T18:05:11.843253] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-19T18:05:12.643268] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-19T18:05:12.884531] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T18:05:13.085784] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T18:05:13.443325] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-19T18:05:14.027516] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T18:05:14.243319] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-19T18:05:14.645496] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:05:15.043287] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-19T18:05:15.843252] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-19T18:05:16.086713] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T18:05:16.231848] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:05:16.643272] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-19T18:05:17.444900] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-19T18:05:17.448434] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T18:05:17.457255] [INFO ] [REMOTE ] CNM: Full fetch complete (73628 records). [2025-09-19T18:05:17.457442] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-19T18:05:17.884460] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-19T18:05:17.884586] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-19T18:05:17.885542] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-19T18:05:17.885610] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-19T18:05:17.887357] [DEBUG] [LOCAL ] CNM: Trimmed 73628 records to 51723 (keeping 200 days of data) [2025-09-19T18:05:18.191932] [DEBUG] [LOCAL ] CNM: Primary data saved (51723 records). [2025-09-19T18:05:18.192120] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-19T18:05:18.192236] [INFO ] [MAIN ] Update Progress: 494/2372 symbols completed. CNM took 34.6s. Estimated remaining: 4h 7m 59s. Rate: 7.6 symbols/min [2025-09-19T18:05:18.256442] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-19T18:05:18.372151] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:18.400478] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T18:05:18.456590] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-09-19T18:05:18.456812] [INFO ] [MAIN ] CNP: Loaded 53859 existing records. [2025-09-19T18:05:18.639302] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:05:18.639602] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-19T18:05:18.639683] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-19T18:05:18.641213] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-19T18:05:18.641277] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-19T18:05:18.995661] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:19.043258] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-19T18:05:19.124716] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T18:05:19.835137] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T18:05:19.840196] [INFO ] [REMOTE ] CNMD: Full fetch complete (46876 records). [2025-09-19T18:05:19.840303] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-19T18:05:19.852248] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-19T18:05:20.245519] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-19T18:05:20.245611] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-19T18:05:20.246441] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-19T18:05:20.246526] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-19T18:05:20.248341] [DEBUG] [LOCAL ] CNMD: Trimmed 46876 records to 33083 (keeping 200 days of data) [2025-09-19T18:05:20.465617] [DEBUG] [LOCAL ] CNMD: Primary data saved (33083 records). [2025-09-19T18:05:20.465908] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-19T18:05:20.466175] [INFO ] [MAIN ] Update Progress: 495/2372 symbols completed. CNMD took 34.5s. Estimated remaining: 4h 7m 30s. Rate: 7.6 symbols/min [2025-09-19T18:05:20.641243] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:20.641445] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-09-19T18:05:20.641483] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-09-19T18:05:20.641682] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-19T18:05:20.641737] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-19T18:05:20.641780] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-09-19T18:05:20.641814] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-19T18:05:20.673775] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-19T18:05:21.009703] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:21.275418] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T18:05:21.443271] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-19T18:05:21.838246] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T18:05:22.243291] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-19T18:05:22.484738] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T18:05:23.043256] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-19T18:05:23.513212] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T18:05:23.843269] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-19T18:05:24.061579] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T18:05:24.643312] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-19T18:05:24.866005] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T18:05:25.282331] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T18:05:25.291540] [INFO ] [REMOTE ] CNNE: Full fetch complete (49013 records). [2025-09-19T18:05:25.291818] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-19T18:05:25.451143] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-19T18:05:25.863062] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-19T18:05:25.863188] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-19T18:05:25.863893] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-19T18:05:25.863962] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-19T18:05:25.865277] [DEBUG] [LOCAL ] CNNE: Trimmed 49013 records to 37488 (keeping 200 days of data) [2025-09-19T18:05:26.099783] [DEBUG] [LOCAL ] CNNE: Primary data saved (37488 records). [2025-09-19T18:05:26.099924] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-19T18:05:26.100020] [INFO ] [MAIN ] Update Progress: 496/2372 symbols completed. CNNE took 33.5s. Estimated remaining: 4h 7m 13s. Rate: 7.6 symbols/min [2025-09-19T18:05:26.272243] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-19T18:05:26.276734] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:26.277093] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-19T18:05:26.277203] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-19T18:05:26.277525] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-19T18:05:26.277667] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-19T18:05:26.277812] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-19T18:05:26.277923] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-19T18:05:26.413152] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T18:05:26.442267] [INFO ] [REMOTE ] CNO: Full fetch complete (60553 records). [2025-09-19T18:05:26.464260] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-19T18:05:26.867862] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:27.048377] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-19T18:05:27.124336] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-19T18:05:27.124445] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-19T18:05:27.125420] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-19T18:05:27.125743] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-19T18:05:27.127330] [DEBUG] [LOCAL ] CNO: Trimmed 60553 records to 42229 (keeping 200 days of data) [2025-09-19T18:05:27.390099] [DEBUG] [LOCAL ] CNO: Primary data saved (42229 records). [2025-09-19T18:05:27.390368] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-19T18:05:27.390513] [INFO ] [MAIN ] Update Progress: 497/2372 symbols completed. CNO took 30.2s. Estimated remaining: 4h 6m 41s. Rate: 7.6 symbols/min [2025-09-19T18:05:27.465235] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:05:27.501805] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-19T18:05:27.579224] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:27.638735] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:05:27.657621] [DEBUG] [LOCAL ] CNS: Loaded 21340 existing records from primary storage. [2025-09-19T18:05:27.657781] [INFO ] [MAIN ] CNS: Loaded 21340 existing records. [2025-09-19T18:05:27.836330] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:05:27.836623] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-19T18:05:27.836708] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-19T18:05:27.837517] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-19T18:05:27.837580] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-19T18:05:27.849303] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-19T18:05:28.223011] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:28.592049] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-19T18:05:28.643213] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-19T18:05:29.443295] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-19T18:05:29.813575] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:05:30.243264] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-19T18:05:30.859859] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:05:30.901879] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:05:31.043292] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-19T18:05:31.843287] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-19T18:05:32.572510] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-19T18:05:32.602323] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:05:32.643224] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-19T18:05:33.443272] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-19T18:05:34.145695] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T18:05:34.243235] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-19T18:05:34.540865] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T18:05:35.043256] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-19T18:05:35.781429] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T18:05:35.843263] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-19T18:05:36.218509] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:05:36.333440] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T18:05:36.643266] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-19T18:05:37.351297] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T18:05:37.443233] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-19T18:05:38.243263] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-19T18:05:38.466398] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T18:05:39.056631] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-19T18:05:39.082483] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T18:05:39.843274] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-19T18:05:39.983022] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T18:05:40.346709] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:05:40.643266] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-19T18:05:41.443259] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-19T18:05:41.918245] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T18:05:42.043558] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T18:05:42.243268] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-19T18:05:43.043279] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-19T18:05:43.471951] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T18:05:43.843219] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-19T18:05:44.488603] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T18:05:44.643264] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-19T18:05:45.360377] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T18:05:45.443277] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-19T18:05:45.626778] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T18:05:46.034733] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:05:46.243312] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-19T18:05:47.043300] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-19T18:05:47.533209] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T18:05:47.540631] [INFO ] [REMOTE ] CNP: Full fetch complete (76968 records). [2025-09-19T18:05:47.540828] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-19T18:05:47.541604] [FATAL] [VALIDATOR ] CNP: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:05:47.541760] [FATAL] [MAIN ] CNP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:05:47.541812] [WARN ] [MAIN ] CNP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:05:47.541876] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-19T18:05:47.541942] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-09-19T18:05:47.541978] [INFO ] [LOCAL ] CNP: Starting deletion of derivative data. [2025-09-19T18:05:47.542422] [DEBUG] [LOCAL ] CNP: Deleted derivative data file. [2025-09-19T18:05:47.542526] [INFO ] [MAIN ] Update Progress: 498/2372 symbols completed. CNP took 29.4s. Estimated remaining: 4h 7m 19s. Rate: 7.6 symbols/min [2025-09-19T18:05:47.732382] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:47.818083] [DEBUG] [LOCAL ] CNX: Loaded 51751 existing records from primary storage. [2025-09-19T18:05:47.816892] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:05:47.829684] [INFO ] [MAIN ] CNX: Loaded 51751 existing records. [2025-09-19T18:05:47.852077] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-19T18:05:48.026826] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:05:48.027140] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-19T18:05:48.027219] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-19T18:05:48.028629] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-19T18:05:48.028719] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-19T18:05:48.395886] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:48.593107] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T18:05:48.643264] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-19T18:05:49.266531] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T18:05:49.443289] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-19T18:05:50.243295] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-19T18:05:50.721162] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:05:51.043288] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-19T18:05:51.148280] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T18:05:51.721501] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:05:51.729806] [INFO ] [REMOTE ] CNQ: Full fetch complete (77541 records). [2025-09-19T18:05:51.729938] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-19T18:05:51.848387] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-19T18:05:52.125254] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-19T18:05:52.125342] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-19T18:05:52.126177] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-19T18:05:52.126241] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-19T18:05:52.127757] [DEBUG] [LOCAL ] CNQ: Trimmed 77541 records to 54362 (keeping 200 days of data) [2025-09-19T18:05:52.460608] [DEBUG] [LOCAL ] CNQ: Primary data saved (54362 records). [2025-09-19T18:05:52.460783] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-19T18:05:52.460867] [INFO ] [MAIN ] Update Progress: 499/2372 symbols completed. CNQ took 32.0s. Estimated remaining: 4h 6m 60s. Rate: 7.6 symbols/min [2025-09-19T18:05:52.636672] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:52.653280] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-19T18:05:52.684983] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T18:05:52.735725] [DEBUG] [LOCAL ] CODI: Loaded 39862 existing records from primary storage. [2025-09-19T18:05:52.735877] [INFO ] [MAIN ] CODI: Loaded 39862 existing records. [2025-09-19T18:05:52.925356] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:05:52.925692] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-19T18:05:52.925752] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-19T18:05:52.926723] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-19T18:05:52.926788] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-19T18:05:53.299112] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:53.443245] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-19T18:05:53.914190] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T18:05:53.921187] [INFO ] [REMOTE ] CNR: Full fetch complete (55273 records). [2025-09-19T18:05:53.921470] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-19T18:05:54.100707] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T18:05:54.150791] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 171 unique days, need 200 days [2025-09-19T18:05:54.151446] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:05:54.151522] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:05:54.151600] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-19T18:05:54.151701] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-19T18:05:54.151759] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-19T18:05:54.151803] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-19T18:05:54.151897] [INFO ] [MAIN ] Update Progress: 500/2372 symbols completed. CNR took 28.1s. Estimated remaining: 4h 6m 28s. Rate: 7.6 symbols/min [2025-09-19T18:05:54.244682] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-19T18:05:54.328014] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:54.328200] [DEBUG] [LOCAL ] COF: No existing data file found in primary storage. [2025-09-19T18:05:54.328236] [WARN ] [MAIN ] COF: No existing data found, performing full refresh instead. [2025-09-19T18:05:54.328380] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-19T18:05:54.328424] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-19T18:05:54.328465] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-09-19T18:05:54.328496] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-19T18:05:54.689509] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:54.703964] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T18:05:55.043273] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-19T18:05:55.843235] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-19T18:05:56.201181] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:05:56.222748] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:05:56.643264] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-19T18:05:57.436477] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T18:05:57.443836] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-19T18:05:57.529842] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T18:05:58.243307] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-19T18:05:58.997492] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T18:05:59.043257] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-19T18:05:59.627885] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:05:59.843260] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-19T18:06:00.643272] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-19T18:06:01.160762] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T18:06:01.224028] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T18:06:01.443271] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-19T18:06:01.620679] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:06:02.243259] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-19T18:06:03.043315] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-19T18:06:03.843294] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-19T18:06:04.336492] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-19T18:06:04.643306] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-19T18:06:05.381971] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (3.14 seconds). [2025-09-19T18:06:05.385759] [INFO ] [REMOTE ] CNS: Full fetch complete (29743 records). [2025-09-19T18:06:05.385899] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-19T18:06:05.759322] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-19T18:06:05.759416] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-19T18:06:05.759883] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-19T18:06:05.759944] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-19T18:06:05.760712] [DEBUG] [LOCAL ] CNS: Trimmed 29743 records to 21458 (keeping 200 days of data) [2025-09-19T18:06:05.896316] [DEBUG] [LOCAL ] CNS: Primary data saved (21458 records). [2025-09-19T18:06:05.896481] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-19T18:06:05.896907] [INFO ] [MAIN ] Update Progress: 501/2372 symbols completed. CNS took 38.5s. Estimated remaining: 4h 6m 35s. Rate: 7.6 symbols/min [2025-09-19T18:06:06.072379] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:06.124826] [DEBUG] [LOCAL ] COHR: Loaded 53762 existing records from primary storage. [2025-09-19T18:06:06.124975] [INFO ] [MAIN ] COHR: Loaded 53762 existing records. [2025-09-19T18:06:06.302328] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:06.302587] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-19T18:06:06.302635] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-19T18:06:06.303939] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-19T18:06:06.304007] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-19T18:06:06.677168] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:06.677704] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-19T18:06:06.793399] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (3.75 seconds). [2025-09-19T18:06:06.804527] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-19T18:06:07.503229] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (3.66 seconds). [2025-09-19T18:06:07.510485] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-19T18:06:07.674841] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (3.03 seconds). [2025-09-19T18:06:07.843324] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-19T18:06:08.595379] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:06:08.643220] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-19T18:06:09.003503] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T18:06:09.052811] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T18:06:09.220111] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:06:09.443260] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-19T18:06:10.115334] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:06:10.243345] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-19T18:06:11.043283] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-19T18:06:11.636707] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:06:11.843252] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-19T18:06:12.428219] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T18:06:12.643293] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-19T18:06:13.269958] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T18:06:13.443234] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-19T18:06:14.131780] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T18:06:14.243249] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-19T18:06:14.706703] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:06:14.714370] [INFO ] [REMOTE ] CNX: Full fetch complete (74754 records). [2025-09-19T18:06:14.714546] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-19T18:06:15.054569] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-19T18:06:15.161280] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-19T18:06:15.161378] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-19T18:06:15.162405] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-19T18:06:15.162476] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-19T18:06:15.165249] [DEBUG] [LOCAL ] CNX: Trimmed 74754 records to 52136 (keeping 200 days of data) [2025-09-19T18:06:15.462478] [DEBUG] [LOCAL ] CNX: Primary data saved (52136 records). [2025-09-19T18:06:15.462712] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-19T18:06:15.462864] [INFO ] [MAIN ] Update Progress: 502/2372 symbols completed. CNX took 27.9s. Estimated remaining: 4h 6m 33s. Rate: 7.6 symbols/min [2025-09-19T18:06:15.643439] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:15.701542] [DEBUG] [LOCAL ] COLD: Loaded 52280 existing records from primary storage. [2025-09-19T18:06:15.701724] [INFO ] [MAIN ] COLD: Loaded 52280 existing records. [2025-09-19T18:06:15.888094] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:15.888622] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-19T18:06:15.888789] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-19T18:06:15.890007] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-19T18:06:15.890282] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-19T18:06:16.132280] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-09-19T18:06:16.200671] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-19T18:06:16.321544] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:16.559469] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T18:06:16.626074] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T18:06:16.643220] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-19T18:06:17.443307] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-19T18:06:18.243269] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-19T18:06:18.577471] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T18:06:19.033364] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-19T18:06:19.050896] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-19T18:06:19.723853] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T18:06:19.843289] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-19T18:06:19.847442] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:06:20.643370] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-19T18:06:21.443229] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-19T18:06:22.086858] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:06:22.248463] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-19T18:06:22.267683] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (3.22 seconds). [2025-09-19T18:06:22.934790] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T18:06:23.043305] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-19T18:06:23.649783] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T18:06:23.659239] [INFO ] [REMOTE ] CODI: Full fetch complete (49948 records). [2025-09-19T18:06:23.659466] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-19T18:06:23.850392] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-19T18:06:24.094132] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-19T18:06:24.124296] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-19T18:06:24.124664] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-19T18:06:24.125548] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-19T18:06:24.126012] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-19T18:06:24.127354] [DEBUG] [LOCAL ] CODI: Trimmed 49948 records to 40123 (keeping 200 days of data) [2025-09-19T18:06:24.373461] [DEBUG] [LOCAL ] CODI: Primary data saved (40123 records). [2025-09-19T18:06:24.373591] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-19T18:06:24.375258] [INFO ] [MAIN ] Update Progress: 503/2372 symbols completed. CODI took 31.9s. Estimated remaining: 4h 6m 29s. Rate: 7.6 symbols/min [2025-09-19T18:06:24.551108] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:24.614739] [DEBUG] [LOCAL ] COMP: Loaded 53771 existing records from primary storage. [2025-09-19T18:06:24.614911] [INFO ] [MAIN ] COMP: Loaded 53771 existing records. [2025-09-19T18:06:24.648538] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-19T18:06:24.804905] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:24.805150] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-19T18:06:24.805198] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-19T18:06:24.806365] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-19T18:06:24.806443] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-19T18:06:25.180524] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:25.365011] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-19T18:06:25.407546] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T18:06:25.443222] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-19T18:06:26.243275] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-19T18:06:26.315875] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T18:06:27.043278] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-19T18:06:27.402158] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T18:06:27.843269] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-19T18:06:28.104214] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T18:06:28.643272] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-19T18:06:29.012680] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T18:06:29.443230] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-19T18:06:29.476816] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:06:29.485455] [INFO ] [REMOTE ] COF: Full fetch complete (77380 records). [2025-09-19T18:06:29.485687] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-19T18:06:29.899479] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-19T18:06:29.899624] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-19T18:06:29.900497] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-19T18:06:29.900570] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-19T18:06:29.902774] [DEBUG] [LOCAL ] COF: Trimmed 77380 records to 54390 (keeping 200 days of data) [2025-09-19T18:06:30.243313] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-19T18:06:30.262976] [DEBUG] [LOCAL ] COF: Primary data saved (54390 records). [2025-09-19T18:06:30.263106] [INFO ] [MAIN ] COF: Full history saved. [2025-09-19T18:06:30.263201] [INFO ] [MAIN ] Update Progress: 504/2372 symbols completed. COF took 36.1s. Estimated remaining: 4h 6m 14s. Rate: 7.6 symbols/min [2025-09-19T18:06:30.460623] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:30.501318] [DEBUG] [LOCAL ] CON: Loaded 39213 existing records from primary storage. [2025-09-19T18:06:30.501463] [INFO ] [MAIN ] CON: Loaded 39213 existing records. [2025-09-19T18:06:30.701319] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:30.701729] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-19T18:06:30.701810] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-19T18:06:30.703294] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-19T18:06:30.703363] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-19T18:06:31.067476] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:31.068071] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-19T18:06:31.109719] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-19T18:06:31.156681] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T18:06:31.696229] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T18:06:31.843282] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-19T18:06:32.288113] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T18:06:32.643291] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-19T18:06:33.443310] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-19T18:06:33.927822] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:06:34.243292] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-19T18:06:34.441948] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T18:06:35.043291] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-19T18:06:35.741717] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-19T18:06:35.843277] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-19T18:06:36.049988] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:06:36.199127] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T18:06:36.643322] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-19T18:06:37.188113] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T18:06:37.443259] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-19T18:06:38.243271] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-19T18:06:38.281548] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T18:06:39.043325] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-19T18:06:39.565454] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T18:06:39.843271] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-19T18:06:40.099138] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T18:06:40.107291] [INFO ] [REMOTE ] COHR: Full fetch complete (77080 records). [2025-09-19T18:06:40.107468] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-19T18:06:40.522974] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-19T18:06:40.523089] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-19T18:06:40.523963] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-19T18:06:40.524046] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-19T18:06:40.546363] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T18:06:40.554238] [DEBUG] [LOCAL ] COHR: Trimmed 77080 records to 54145 (keeping 200 days of data) [2025-09-19T18:06:40.657489] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-19T18:06:40.892201] [DEBUG] [LOCAL ] COHR: Primary data saved (54145 records). [2025-09-19T18:06:40.892341] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-19T18:06:40.892490] [INFO ] [MAIN ] Update Progress: 505/2372 symbols completed. COHR took 35.0s. Estimated remaining: 4h 6m 16s. Rate: 7.6 symbols/min [2025-09-19T18:06:41.069854] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:41.099352] [DEBUG] [LOCAL ] COOK: Loaded 24332 existing records from primary storage. [2025-09-19T18:06:41.099515] [INFO ] [MAIN ] COOK: Loaded 24332 existing records. [2025-09-19T18:06:41.277484] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:41.277776] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-19T18:06:41.277830] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-19T18:06:41.278488] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-19T18:06:41.278548] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-19T18:06:41.443557] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-19T18:06:41.667243] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:42.087211] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T18:06:42.243274] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-19T18:06:42.310774] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T18:06:43.048413] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-19T18:06:43.063828] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:06:43.494432] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T18:06:43.843282] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-19T18:06:44.643282] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-19T18:06:45.189947] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T18:06:45.443271] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-19T18:06:45.630178] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:06:46.154361] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T18:06:46.248419] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-19T18:06:46.262145] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T18:06:46.270779] [INFO ] [REMOTE ] COLD: Full fetch complete (74035 records). [2025-09-19T18:06:46.271002] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-19T18:06:46.681593] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-19T18:06:46.681743] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-19T18:06:46.682603] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-19T18:06:46.682694] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-19T18:06:46.684392] [DEBUG] [LOCAL ] COLD: Trimmed 74035 records to 52669 (keeping 200 days of data) [2025-09-19T18:06:47.014129] [DEBUG] [LOCAL ] COLD: Primary data saved (52669 records). [2025-09-19T18:06:47.014279] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-19T18:06:47.014364] [INFO ] [MAIN ] Update Progress: 506/2372 symbols completed. COLD took 31.6s. Estimated remaining: 4h 6m 1s. Rate: 7.6 symbols/min [2025-09-19T18:06:47.048436] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-19T18:06:47.185293] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:47.245380] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-09-19T18:06:47.245555] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-09-19T18:06:47.433327] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:47.433994] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-19T18:06:47.434130] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-19T18:06:47.435566] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-19T18:06:47.435669] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-19T18:06:47.737469] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T18:06:47.849207] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:47.845971] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-19T18:06:47.873817] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T18:06:48.643264] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-19T18:06:49.298679] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T18:06:49.443263] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-19T18:06:50.243294] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-19T18:06:51.043277] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-19T18:06:51.089709] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-19T18:06:51.211514] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T18:06:51.577291] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T18:06:51.843301] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-19T18:06:52.260066] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T18:06:52.643232] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-19T18:06:53.117491] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T18:06:53.443262] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-19T18:06:54.243243] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-19T18:06:54.279955] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T18:06:54.895737] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T18:06:55.043267] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-19T18:06:55.843276] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-19T18:06:56.274547] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T18:06:56.282899] [INFO ] [REMOTE ] CON: Full fetch complete (57371 records). [2025-09-19T18:06:56.283105] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-19T18:06:56.655053] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-19T18:06:56.692357] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-19T18:06:56.692512] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-19T18:06:56.693351] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-19T18:06:56.693429] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-19T18:06:56.694782] [DEBUG] [LOCAL ] CON: Trimmed 57371 records to 39527 (keeping 200 days of data) [2025-09-19T18:06:56.940590] [DEBUG] [LOCAL ] CON: Primary data saved (39527 records). [2025-09-19T18:06:56.940801] [INFO ] [MAIN ] CON: Full history saved. [2025-09-19T18:06:56.940924] [INFO ] [MAIN ] Update Progress: 507/2372 symbols completed. CON took 26.7s. Estimated remaining: 4h 6m 1s. Rate: 7.6 symbols/min [2025-09-19T18:06:57.131772] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:57.173619] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T18:06:57.216784] [DEBUG] [LOCAL ] COR: Loaded 47685 existing records from primary storage. [2025-09-19T18:06:57.216945] [INFO ] [MAIN ] COR: Loaded 47685 existing records. [2025-09-19T18:06:57.423870] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:57.424181] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-19T18:06:57.424237] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-19T18:06:57.425426] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-19T18:06:57.425491] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-19T18:06:57.448387] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-19T18:06:57.806213] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:57.864197] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T18:06:58.223700] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T18:06:58.243213] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-19T18:06:59.043229] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-19T18:06:59.769321] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T18:06:59.832126] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T18:06:59.843235] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-19T18:07:00.643227] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-19T18:07:00.701461] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:07:01.443305] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-19T18:07:02.014954] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T18:07:02.024983] [INFO ] [REMOTE ] COMP: Full fetch complete (76673 records). [2025-09-19T18:07:02.025299] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-19T18:07:02.028516] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:07:02.028702] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:07:02.028762] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:07:02.028854] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-19T18:07:02.028968] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-09-19T18:07:02.029040] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-09-19T18:07:02.029541] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-09-19T18:07:02.030259] [INFO ] [MAIN ] Update Progress: 508/2372 symbols completed. COMP took 37.7s. Estimated remaining: 4h 5m 42s. Rate: 7.6 symbols/min [2025-09-19T18:07:02.233429] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:02.233728] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-09-19T18:07:02.233786] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-09-19T18:07:02.233979] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-19T18:07:02.234029] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-19T18:07:02.234111] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-09-19T18:07:02.234203] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-19T18:07:02.249045] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-19T18:07:02.647393] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:02.687723] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:07:02.865397] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T18:07:03.043308] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-19T18:07:03.843334] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-19T18:07:04.458197] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T18:07:04.643325] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-19T18:07:04.843595] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T18:07:05.443866] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-19T18:07:05.847079] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T18:07:06.243305] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-19T18:07:06.926714] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T18:07:07.050217] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-19T18:07:07.071691] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T18:07:07.843273] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-19T18:07:08.529591] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-19T18:07:08.643255] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-19T18:07:08.889425] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T18:07:08.893610] [INFO ] [REMOTE ] COOK: Full fetch complete (32873 records). [2025-09-19T18:07:08.893726] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-19T18:07:09.269708] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-19T18:07:09.269792] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-19T18:07:09.270271] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-19T18:07:09.270310] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-19T18:07:09.271097] [DEBUG] [LOCAL ] COOK: Trimmed 32873 records to 24488 (keeping 200 days of data) [2025-09-19T18:07:09.405076] [DEBUG] [LOCAL ] COOK: Primary data saved (24488 records). [2025-09-19T18:07:09.405212] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-19T18:07:09.405299] [INFO ] [MAIN ] Update Progress: 509/2372 symbols completed. COOK took 28.5s. Estimated remaining: 4h 5m 33s. Rate: 7.6 symbols/min [2025-09-19T18:07:09.472494] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-19T18:07:09.583897] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:09.628405] [DEBUG] [LOCAL ] COUR: Loaded 49223 existing records from primary storage. [2025-09-19T18:07:09.628562] [INFO ] [MAIN ] COUR: Loaded 49223 existing records. [2025-09-19T18:07:09.814075] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:09.814537] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-19T18:07:09.814621] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-19T18:07:09.816014] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-19T18:07:09.816083] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-19T18:07:10.011462] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T18:07:10.224283] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:10.243267] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-19T18:07:10.940005] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T18:07:11.043229] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-19T18:07:11.631020] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T18:07:11.759098] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T18:07:11.843233] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-19T18:07:12.643239] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-19T18:07:13.421805] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T18:07:13.448335] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-19T18:07:13.465331] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T18:07:14.243277] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-19T18:07:14.701275] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T18:07:15.043287] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-19T18:07:15.547590] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T18:07:15.843271] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-19T18:07:16.162377] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T18:07:16.589491] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T18:07:16.643323] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-19T18:07:17.443536] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-19T18:07:17.825236] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:07:18.068690] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T18:07:18.243351] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-19T18:07:19.043278] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-19T18:07:19.567118] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T18:07:19.843233] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-19T18:07:20.066837] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T18:07:20.643275] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-19T18:07:20.736884] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T18:07:20.746451] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-19T18:07:20.746606] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-19T18:07:21.153665] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-19T18:07:21.153760] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-19T18:07:21.154572] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-19T18:07:21.154615] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-19T18:07:21.156167] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54507 (keeping 200 days of data) [2025-09-19T18:07:21.447437] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-19T18:07:21.492428] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-09-19T18:07:21.492582] [INFO ] [MAIN ] COP: Full history saved. [2025-09-19T18:07:21.492695] [INFO ] [MAIN ] Update Progress: 510/2372 symbols completed. COP took 34.5s. Estimated remaining: 4h 5m 40s. Rate: 7.6 symbols/min [2025-09-19T18:07:21.662588] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:21.714062] [DEBUG] [LOCAL ] CP: Loaded 53681 existing records from primary storage. [2025-09-19T18:07:21.714232] [INFO ] [MAIN ] CP: Loaded 53681 existing records. [2025-09-19T18:07:21.895511] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:21.896028] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-19T18:07:21.896117] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-19T18:07:21.905785] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-19T18:07:21.921041] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-19T18:07:21.987070] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T18:07:22.246261] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-19T18:07:22.315421] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:22.351382] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T18:07:22.966089] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T18:07:23.043231] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-19T18:07:23.843269] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-19T18:07:24.326780] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:07:24.643240] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-19T18:07:24.931512] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T18:07:25.376350] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:07:25.443234] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-19T18:07:26.017636] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T18:07:26.243279] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-19T18:07:26.949790] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T18:07:27.043281] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-19T18:07:27.848362] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-19T18:07:27.860083] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:07:28.643289] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-19T18:07:29.062729] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T18:07:29.443293] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-19T18:07:29.783470] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T18:07:29.790518] [INFO ] [REMOTE ] COR: Full fetch complete (68847 records). [2025-09-19T18:07:29.790674] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-19T18:07:30.201139] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-19T18:07:30.201243] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-19T18:07:30.202246] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-19T18:07:30.202323] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-19T18:07:30.204156] [DEBUG] [LOCAL ] COR: Trimmed 68847 records to 48035 (keeping 200 days of data) [2025-09-19T18:07:30.268828] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-19T18:07:30.619538] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T18:07:30.643192] [INFO ] [REMOTE ] COTY: Full fetch complete (77100 records). [2025-09-19T18:07:30.644634] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-19T18:07:31.213939] [DEBUG] [LOCAL ] COR: Primary data saved (48035 records). [2025-09-19T18:07:31.250242] [INFO ] [MAIN ] COR: Full history saved. [2025-09-19T18:07:31.276858] [INFO ] [MAIN ] Update Progress: 511/2372 symbols completed. COR took 34.3s. Estimated remaining: 4h 5m 39s. Rate: 7.6 symbols/min [2025-09-19T18:07:31.297109] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-19T18:07:31.332329] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-19T18:07:31.380905] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-19T18:07:31.410168] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-19T18:07:31.488099] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:31.488354] [DEBUG] [LOCAL ] COTY: Trimmed 77100 records to 54037 (keeping 200 days of data) [2025-09-19T18:07:31.627398] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T18:07:31.655515] [DEBUG] [LOCAL ] CPA: Loaded 29299 existing records from primary storage. [2025-09-19T18:07:31.655098] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-19T18:07:31.657340] [INFO ] [MAIN ] CPA: Loaded 29299 existing records. [2025-09-19T18:07:31.938279] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:31.940835] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-19T18:07:31.942030] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-19T18:07:31.944531] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-19T18:07:31.944878] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-19T18:07:32.363045] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:32.370397] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-19T18:07:32.416901] [DEBUG] [LOCAL ] COTY: Primary data saved (54037 records). [2025-09-19T18:07:32.417065] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-19T18:07:32.417148] [INFO ] [MAIN ] Update Progress: 512/2372 symbols completed. COTY took 30.4s. Estimated remaining: 4h 5m 6s. Rate: 7.6 symbols/min [2025-09-19T18:07:32.605838] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:32.624125] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-19T18:07:32.626371] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-19T18:07:32.624478] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-19T18:07:32.637374] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-19T18:07:32.637871] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-19T18:07:32.637954] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-19T18:07:32.637992] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-19T18:07:32.669797] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-19T18:07:32.994880] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:33.324323] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T18:07:33.443271] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-19T18:07:34.085698] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T18:07:34.243248] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-19T18:07:34.830583] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:07:34.911604] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:07:35.043255] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-19T18:07:35.241116] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:07:35.843311] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-19T18:07:36.643267] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-19T18:07:36.678706] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T18:07:37.250639] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:07:37.443271] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-19T18:07:38.243272] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-19T18:07:38.706112] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:07:38.717707] [INFO ] [REMOTE ] COUR: Full fetch complete (70545 records). [2025-09-19T18:07:38.717889] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-19T18:07:38.719057] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:07:38.719159] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:07:38.719203] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:07:38.719282] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-19T18:07:38.719363] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-09-19T18:07:38.719400] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-09-19T18:07:38.719782] [DEBUG] [LOCAL ] COUR: Deleted derivative data file. [2025-09-19T18:07:38.719890] [INFO ] [MAIN ] Update Progress: 513/2372 symbols completed. COUR took 29.3s. Estimated remaining: 4h 4m 53s. Rate: 7.6 symbols/min [2025-09-19T18:07:38.901223] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:38.934477] [DEBUG] [LOCAL ] CPAY: Loaded 31613 existing records from primary storage. [2025-09-19T18:07:38.934620] [INFO ] [MAIN ] CPAY: Loaded 31613 existing records. [2025-09-19T18:07:39.043700] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-19T18:07:39.130016] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:39.134975] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-19T18:07:39.135063] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-19T18:07:39.134574] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T18:07:39.162687] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-19T18:07:39.167259] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-19T18:07:39.253153] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T18:07:39.544063] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:39.843276] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-19T18:07:40.515011] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T18:07:40.643254] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-19T18:07:41.038097] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T18:07:41.443265] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-19T18:07:42.169181] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:07:42.243239] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-19T18:07:42.609512] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-19T18:07:42.863256] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T18:07:43.043272] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-19T18:07:43.392671] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-19T18:07:43.843274] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-19T18:07:44.261487] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T18:07:44.643291] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-19T18:07:45.443318] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-19T18:07:46.243333] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-19T18:07:46.410783] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T18:07:47.043336] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-19T18:07:47.066415] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T18:07:47.843321] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-19T18:07:47.909378] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T18:07:48.013729] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:07:48.266609] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T18:07:48.643279] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-19T18:07:49.161082] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T18:07:49.443270] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-19T18:07:50.243280] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-19T18:07:51.043285] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-19T18:07:51.546993] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T18:07:51.839442] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T18:07:51.844983] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-19T18:07:52.160915] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T18:07:52.643266] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-19T18:07:53.068134] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-19T18:07:53.443274] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-19T18:07:53.962850] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T18:07:53.970902] [INFO ] [REMOTE ] CP: Full fetch complete (77137 records). [2025-09-19T18:07:53.971035] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-19T18:07:54.248408] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-19T18:07:54.388937] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-19T18:07:54.389067] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-19T18:07:54.390525] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-19T18:07:54.390665] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-19T18:07:54.392591] [DEBUG] [LOCAL ] CP: Trimmed 77137 records to 54068 (keeping 200 days of data) [2025-09-19T18:07:54.733227] [DEBUG] [LOCAL ] CP: Primary data saved (54068 records). [2025-09-19T18:07:54.733452] [INFO ] [MAIN ] CP: Full history saved. [2025-09-19T18:07:54.733736] [INFO ] [MAIN ] Update Progress: 514/2372 symbols completed. CP took 33.2s. Estimated remaining: 4h 5m 14s. Rate: 7.6 symbols/min [2025-09-19T18:07:54.913479] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:54.913679] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-09-19T18:07:54.913734] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-09-19T18:07:54.913894] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-19T18:07:54.913946] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-19T18:07:54.913988] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-09-19T18:07:54.914019] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-19T18:07:55.045023] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-19T18:07:55.077806] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-19T18:07:55.311389] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:55.334696] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T18:07:55.843267] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-19T18:07:56.643250] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-19T18:07:56.739714] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:07:57.011397] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-19T18:07:57.278454] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T18:07:57.443256] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-19T18:07:58.243276] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-19T18:07:58.528597] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:07:58.698074] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-19T18:07:58.698979] [INFO ] [REMOTE ] CPAC: Full fetch complete (1909 records). [2025-09-19T18:07:58.699052] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-19T18:07:58.882961] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T18:07:58.883167] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:07:58.883212] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:07:58.883257] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-19T18:07:58.883380] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-19T18:07:58.883435] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-19T18:07:58.883477] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-19T18:07:58.883552] [INFO ] [MAIN ] Update Progress: 515/2372 symbols completed. CPAC took 26.5s. Estimated remaining: 4h 4m 52s. Rate: 7.6 symbols/min [2025-09-19T18:07:59.052025] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-19T18:07:59.056764] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:59.073028] [DEBUG] [LOCAL ] CPK: Loaded 13277 existing records from primary storage. [2025-09-19T18:07:59.073150] [INFO ] [MAIN ] CPK: Loaded 13277 existing records. [2025-09-19T18:07:59.254305] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:59.254554] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-19T18:07:59.254610] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-19T18:07:59.255127] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-19T18:07:59.255188] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-19T18:07:59.611624] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:59.843235] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-19T18:08:00.288223] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:08:00.643265] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-19T18:08:01.256054] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T18:08:01.443305] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-19T18:08:02.243314] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-19T18:08:02.497124] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T18:08:02.503529] [INFO ] [REMOTE ] CPA: Full fetch complete (42292 records). [2025-09-19T18:08:02.503734] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-19T18:08:02.905917] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-19T18:08:02.906003] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-19T18:08:02.906564] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-19T18:08:02.906607] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-19T18:08:02.907680] [DEBUG] [LOCAL ] CPA: Trimmed 42292 records to 29453 (keeping 200 days of data) [2025-09-19T18:08:03.059231] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-19T18:08:03.096334] [DEBUG] [LOCAL ] CPA: Primary data saved (29453 records). [2025-09-19T18:08:03.096507] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-19T18:08:03.096600] [INFO ] [MAIN ] Update Progress: 516/2372 symbols completed. CPA took 31.8s. Estimated remaining: 4h 4m 31s. Rate: 7.6 symbols/min [2025-09-19T18:08:03.267416] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:03.267587] [DEBUG] [LOCAL ] CPNG: No existing data file found in primary storage. [2025-09-19T18:08:03.267627] [WARN ] [MAIN ] CPNG: No existing data found, performing full refresh instead. [2025-09-19T18:08:03.267799] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-19T18:08:03.267844] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-19T18:08:03.267887] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-09-19T18:08:03.267921] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-19T18:08:03.660716] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:03.662517] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T18:08:03.686938] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T18:08:03.843267] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-19T18:08:04.424639] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:08:04.643310] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-19T18:08:05.443247] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-19T18:08:05.465417] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T18:08:05.989028] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T18:08:06.243275] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-19T18:08:07.043486] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-19T18:08:07.398688] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T18:08:07.751607] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T18:08:07.843269] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-19T18:08:08.049238] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T18:08:08.553186] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T18:08:08.643284] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-19T18:08:09.443293] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-19T18:08:10.243295] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-19T18:08:10.437803] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T18:08:10.890316] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T18:08:11.043329] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-19T18:08:11.843268] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-19T18:08:12.611573] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:08:12.653946] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-19T18:08:12.682257] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-19T18:08:12.746573] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-19T18:08:13.443263] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-19T18:08:13.792627] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T18:08:13.796949] [INFO ] [REMOTE ] CPAY: Full fetch complete (45188 records). [2025-09-19T18:08:13.797071] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-19T18:08:13.797668] [FATAL] [VALIDATOR ] CPAY: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:08:13.797756] [FATAL] [MAIN ] CPAY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:08:13.797798] [WARN ] [MAIN ] CPAY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:08:13.797835] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-19T18:08:13.797893] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-09-19T18:08:13.797927] [INFO ] [LOCAL ] CPAY: Starting deletion of derivative data. [2025-09-19T18:08:13.798310] [DEBUG] [LOCAL ] CPAY: Deleted derivative data file. [2025-09-19T18:08:13.798410] [INFO ] [MAIN ] Update Progress: 517/2372 symbols completed. CPAY took 35.1s. Estimated remaining: 4h 4m 33s. Rate: 7.6 symbols/min [2025-09-19T18:08:14.243330] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-19T18:08:15.043335] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-19T18:08:15.404168] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T18:08:15.406976] [INFO ] [REMOTE ] CPF: Full fetch complete (24325 records). [2025-09-19T18:08:15.407071] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-19T18:08:15.788049] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-19T18:08:15.788187] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-19T18:08:15.788756] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-19T18:08:15.788893] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-19T18:08:15.790338] [DEBUG] [LOCAL ] CPF: Trimmed 24325 records to 15847 (keeping 200 days of data) [2025-09-19T18:08:15.889730] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-19T18:08:15.902208] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-19T18:08:15.931512] [DEBUG] [LOCAL ] CPF: Primary data saved (15847 records). [2025-09-19T18:08:15.931622] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-19T18:08:15.931731] [INFO ] [MAIN ] Update Progress: 518/2372 symbols completed. CPF took 21.2s. Estimated remaining: 4h 4m 5s. Rate: 7.6 symbols/min [2025-09-19T18:08:16.173452] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:08:16.643277] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-19T18:08:17.503432] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:08:17.507960] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-19T18:08:18.420367] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-19T18:08:18.431664] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-19T18:08:18.855996] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T18:08:19.043320] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-19T18:08:20.086574] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T18:08:20.089825] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-19T18:08:20.911663] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T18:08:20.923091] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-19T18:08:20.995944] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T18:08:21.443275] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-19T18:08:22.653239] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T18:08:22.658935] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-19T18:08:23.659097] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-19T18:08:23.688224] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T18:08:23.693525] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-19T18:08:23.843338] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-19T18:08:24.740967] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T18:08:24.743221] [INFO ] [REMOTE ] CPK: Full fetch complete (17555 records). [2025-09-19T18:08:24.743297] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-19T18:08:25.117879] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-19T18:08:25.117964] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-19T18:08:25.118364] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-19T18:08:25.118404] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-19T18:08:25.118990] [DEBUG] [LOCAL ] CPK: Trimmed 17555 records to 13398 (keeping 200 days of data) [2025-09-19T18:08:25.204149] [DEBUG] [LOCAL ] CPK: Primary data saved (13398 records). [2025-09-19T18:08:25.204297] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-19T18:08:25.204398] [INFO ] [MAIN ] Update Progress: 519/2372 symbols completed. CPK took 26.3s. Estimated remaining: 4h 4m 2s. Rate: 7.6 symbols/min [2025-09-19T18:08:26.269508] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-19T18:08:26.281707] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-19T18:08:29.026262] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-19T18:08:29.038174] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-19T18:08:31.480574] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-19T18:08:31.492313] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-19T18:08:34.108623] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-19T18:08:34.116551] [INFO ] [REMOTE ] CPNG: Full fetch complete (77668 records). [2025-09-19T18:08:34.116731] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-19T18:08:34.509494] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-19T18:08:34.509575] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-19T18:08:34.510431] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-19T18:08:34.510507] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-19T18:08:34.512068] [DEBUG] [LOCAL ] CPNG: Trimmed 77668 records to 54451 (keeping 200 days of data) [2025-09-19T18:08:34.845285] [DEBUG] [LOCAL ] CPNG: Primary data saved (54451 records). [2025-09-19T18:08:34.845428] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-19T18:08:34.845537] [INFO ] [MAIN ] Update Progress: 520/2372 symbols completed. CPNG took 31.7s. Estimated remaining: 4h 4m 0s. Rate: 7.6 symbols/min [2025-09-19T18:08:35.405491] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:35.497305] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:35.494509] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-09-19T18:08:35.534264] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-09-19T18:08:35.570178] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-19T18:08:35.570115] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:35.535289] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:35.570409] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-19T18:08:35.570945] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-09-19T18:08:35.571111] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-19T18:08:35.744817] [DEBUG] [LOCAL ] CQP: Loaded 20205 existing records from primary storage. [2025-09-19T18:08:35.788248] [INFO ] [MAIN ] CQP: Loaded 20205 existing records. [2025-09-19T18:08:36.031163] [DEBUG] [LOCAL ] CPRI: Loaded 52972 existing records from primary storage. [2025-09-19T18:08:36.040794] [INFO ] [MAIN ] CPRI: Loaded 52972 existing records. [2025-09-19T18:08:36.041449] [DEBUG] [LOCAL ] CPT: Loaded 44714 existing records from primary storage. [2025-09-19T18:08:36.206460] [INFO ] [MAIN ] CPT: Loaded 44714 existing records. [2025-09-19T18:08:36.429205] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:36.456545] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-19T18:08:36.447703] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:08:36.484329] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-19T18:08:36.490767] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-19T18:08:36.507724] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-19T18:08:36.549292] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-19T18:08:36.683219] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:08:36.721813] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:08:36.761381] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-19T18:08:36.769634] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-19T18:08:36.773561] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-19T18:08:36.773701] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-19T18:08:36.780456] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-19T18:08:36.780576] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-19T18:08:36.785828] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-19T18:08:36.796214] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-19T18:08:37.361623] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:37.422135] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-19T18:08:37.795367] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:37.801568] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-19T18:08:37.801249] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:37.802190] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-19T18:08:38.065583] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T18:08:38.070026] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-19T18:08:38.853867] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T18:08:38.858488] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-19T18:08:39.293120] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:08:39.298119] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-19T18:08:39.759335] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T18:08:39.767401] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-19T18:08:39.817211] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T18:08:39.823354] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-19T18:08:39.921024] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T18:08:39.933418] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-19T18:08:40.289528] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T18:08:40.295030] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-19T18:08:41.023774] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T18:08:41.032717] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-19T18:08:41.241958] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T18:08:41.249974] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-19T18:08:41.360125] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T18:08:41.366510] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-19T18:08:42.047627] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T18:08:42.058315] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-19T18:08:42.097373] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-19T18:08:42.102885] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-19T18:08:42.412211] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:08:42.421351] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-19T18:08:42.778355] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T18:08:42.782827] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-19T18:08:42.959314] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T18:08:42.966814] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-19T18:08:44.032426] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T18:08:44.056824] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-19T18:08:44.058828] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T18:08:44.065359] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-19T18:08:44.500610] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:08:44.507838] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-19T18:08:44.613139] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:08:44.643221] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-19T18:08:45.065254] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:08:45.443236] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-19T18:08:45.872946] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T18:08:45.908586] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:08:46.085352] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:08:46.243222] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-19T18:08:46.263805] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T18:08:47.043264] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-19T18:08:47.843261] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-19T18:08:48.261256] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T18:08:48.370143] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-19T18:08:48.643247] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-19T18:08:49.227768] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:08:49.443261] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-19T18:08:50.243271] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-19T18:08:50.837333] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T18:08:51.043264] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-19T18:08:51.108997] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T18:08:51.255859] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:08:51.843262] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-19T18:08:52.643272] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-19T18:08:53.124618] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:08:53.283173] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T18:08:53.287842] [INFO ] [REMOTE ] CPS: Full fetch complete (36177 records). [2025-09-19T18:08:53.288133] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-19T18:08:53.448366] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-19T18:08:53.731432] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-19T18:08:53.731596] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-19T18:08:53.732953] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-19T18:08:53.733239] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-19T18:08:53.736544] [DEBUG] [LOCAL ] CPS: Trimmed 36177 records to 26671 (keeping 200 days of data) [2025-09-19T18:08:53.901506] [DEBUG] [LOCAL ] CPS: Primary data saved (26671 records). [2025-09-19T18:08:53.901681] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-19T18:08:53.901854] [INFO ] [MAIN ] Update Progress: 521/2372 symbols completed. CPS took 19.1s. Estimated remaining: 4h 4m 32s. Rate: 7.6 symbols/min [2025-09-19T18:08:54.073405] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:54.073660] [DEBUG] [LOCAL ] CR: No existing data file found in primary storage. [2025-09-19T18:08:54.073718] [WARN ] [MAIN ] CR: No existing data found, performing full refresh instead. [2025-09-19T18:08:54.073873] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-19T18:08:54.073934] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-19T18:08:54.073991] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-09-19T18:08:54.074051] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-19T18:08:54.254838] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-19T18:08:54.480014] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:54.514519] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T18:08:54.816912] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T18:08:55.045725] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-19T18:08:55.049380] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T18:08:55.053823] [INFO ] [REMOTE ] CQP: Full fetch complete (30906 records). [2025-09-19T18:08:55.053977] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-19T18:08:55.442718] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-19T18:08:55.442803] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-19T18:08:55.443268] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-19T18:08:55.443307] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-19T18:08:55.445632] [DEBUG] [LOCAL ] CQP: Trimmed 30906 records to 20282 (keeping 200 days of data) [2025-09-19T18:08:55.584057] [DEBUG] [LOCAL ] CQP: Primary data saved (20282 records). [2025-09-19T18:08:55.584181] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-19T18:08:55.584290] [INFO ] [MAIN ] Update Progress: 522/2372 symbols completed. CQP took 20.7s. Estimated remaining: 4h 4m 2s. Rate: 7.6 symbols/min [2025-09-19T18:08:55.753518] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:55.753736] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-19T18:08:55.753791] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-19T18:08:55.753930] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-19T18:08:55.753975] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-19T18:08:55.754016] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-19T18:08:55.754047] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-19T18:08:55.848405] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-19T18:08:56.116937] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:56.470534] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T18:08:56.643263] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-19T18:08:57.317794] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T18:08:57.443329] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-19T18:08:58.033477] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T18:08:58.243272] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-19T18:08:58.767171] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T18:08:59.043296] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-19T18:08:59.634674] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-19T18:08:59.843294] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-19T18:09:00.137433] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T18:09:00.144533] [INFO ] [REMOTE ] CPT: Full fetch complete (63460 records). [2025-09-19T18:09:00.144725] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-19T18:09:00.531872] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-19T18:09:00.531957] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-19T18:09:00.532783] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-19T18:09:00.532907] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-19T18:09:00.536404] [DEBUG] [LOCAL ] CPT: Trimmed 63460 records to 45047 (keeping 200 days of data) [2025-09-19T18:09:00.648380] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-19T18:09:00.839975] [DEBUG] [LOCAL ] CPT: Primary data saved (45047 records). [2025-09-19T18:09:00.840147] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-19T18:09:00.840896] [INFO ] [MAIN ] Update Progress: 523/2372 symbols completed. CPT took 26.0s. Estimated remaining: 4h 3m 44s. Rate: 7.6 symbols/min [2025-09-19T18:09:01.015624] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:01.080463] [DEBUG] [LOCAL ] CRBG: Loaded 52724 existing records from primary storage. [2025-09-19T18:09:01.080611] [INFO ] [MAIN ] CRBG: Loaded 52724 existing records. [2025-09-19T18:09:01.277130] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:01.283969] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-19T18:09:01.284842] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-19T18:09:01.287509] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-19T18:09:01.294236] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-19T18:09:01.300595] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-19T18:09:01.327042] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T18:09:01.448401] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-19T18:09:01.702590] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:02.243310] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-19T18:09:03.043267] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-19T18:09:03.843269] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-19T18:09:04.657186] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-09-19T18:09:04.663518] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-19T18:09:04.786372] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-19T18:09:05.443329] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-19T18:09:05.764940] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T18:09:06.243281] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-19T18:09:06.364934] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T18:09:06.456663] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (3.41 seconds). [2025-09-19T18:09:06.884920] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (3.04 seconds). [2025-09-19T18:09:07.043340] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-19T18:09:07.149096] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T18:09:07.843341] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-19T18:09:08.643325] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-19T18:09:08.895572] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T18:09:09.244430] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-19T18:09:09.443280] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-19T18:09:09.667390] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:09:10.243250] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-19T18:09:10.824499] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:09:11.043296] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-19T18:09:11.843282] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-19T18:09:12.188721] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T18:09:12.278011] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:09:12.643282] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-19T18:09:13.443264] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-19T18:09:13.602123] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T18:09:13.731778] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T18:09:14.243274] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-19T18:09:15.043305] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-19T18:09:15.647859] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T18:09:15.652668] [INFO ] [REMOTE ] CR: Full fetch complete (34916 records). [2025-09-19T18:09:15.652830] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-19T18:09:15.848412] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-19T18:09:16.035927] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-19T18:09:16.036021] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-19T18:09:16.036533] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-19T18:09:16.036575] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-19T18:09:16.037402] [DEBUG] [LOCAL ] CR: Trimmed 34916 records to 25083 (keeping 200 days of data) [2025-09-19T18:09:16.203502] [DEBUG] [LOCAL ] CR: Primary data saved (25083 records). [2025-09-19T18:09:16.203674] [INFO ] [MAIN ] CR: Full history saved. [2025-09-19T18:09:16.203773] [INFO ] [MAIN ] Update Progress: 524/2372 symbols completed. CR took 22.3s. Estimated remaining: 4h 4m 3s. Rate: 7.6 symbols/min [2025-09-19T18:09:16.376457] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:16.409933] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T18:09:16.467152] [DEBUG] [LOCAL ] CRC: Loaded 44876 existing records from primary storage. [2025-09-19T18:09:16.467312] [INFO ] [MAIN ] CRC: Loaded 44876 existing records. [2025-09-19T18:09:16.644862] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-19T18:09:16.644683] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T18:09:16.696672] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:16.703040] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-19T18:09:16.703137] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-19T18:09:16.704952] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-19T18:09:16.705032] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-19T18:09:17.207162] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:17.443335] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-19T18:09:18.243319] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-19T18:09:18.333963] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-19T18:09:18.341815] [INFO ] [REMOTE ] CPRI: Full fetch complete (75789 records). [2025-09-19T18:09:18.342031] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-19T18:09:18.343091] [FATAL] [VALIDATOR ] CPRI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:09:18.343324] [FATAL] [MAIN ] CPRI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:09:18.343392] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:09:18.343463] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-19T18:09:18.343546] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-09-19T18:09:18.343614] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-09-19T18:09:18.344451] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-09-19T18:09:18.344569] [INFO ] [MAIN ] Update Progress: 525/2372 symbols completed. CPRI took 43.5s. Estimated remaining: 4h 3m 34s. Rate: 7.6 symbols/min [2025-09-19T18:09:18.529835] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:18.530018] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-19T18:09:18.530058] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-19T18:09:18.530198] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-19T18:09:18.530279] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-19T18:09:18.530329] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-19T18:09:18.530362] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-19T18:09:18.834835] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-19T18:09:18.925168] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:18.959622] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T18:09:19.043274] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-19T18:09:19.225875] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T18:09:19.843278] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-19T18:09:20.643281] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-19T18:09:21.061937] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T18:09:21.177426] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:09:21.443240] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-19T18:09:21.626536] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T18:09:21.628258] [INFO ] [REMOTE ] CRBD: Full fetch complete (15319 records). [2025-09-19T18:09:21.628341] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-19T18:09:21.628971] [FATAL] [VALIDATOR ] CRBD: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:09:21.629078] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:09:21.629128] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:09:21.629169] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-19T18:09:21.629226] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-19T18:09:21.629266] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-19T18:09:21.629307] [DEBUG] [LOCAL ] CRBD: No derivative data file found to delete. [2025-09-19T18:09:21.629366] [INFO ] [MAIN ] Update Progress: 526/2372 symbols completed. CRBD took 26.0s. Estimated remaining: 4h 3m 10s. Rate: 7.6 symbols/min [2025-09-19T18:09:21.675341] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:21.710329] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-19T18:09:21.813255] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:21.873980] [DEBUG] [LOCAL ] CRGY: Loaded 52911 existing records from primary storage. [2025-09-19T18:09:21.874331] [INFO ] [MAIN ] CRGY: Loaded 52911 existing records. [2025-09-19T18:09:22.063202] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:22.063453] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-19T18:09:22.063502] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-19T18:09:22.064843] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-19T18:09:22.064906] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-19T18:09:22.251072] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-19T18:09:22.480706] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:23.043304] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-19T18:09:23.264373] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:23.264726] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-19T18:09:23.714275] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T18:09:23.843283] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-19T18:09:24.074056] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:24.074381] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-19T18:09:24.643276] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-19T18:09:25.443273] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-19T18:09:26.243231] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-19T18:09:26.474928] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T18:09:27.043234] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-19T18:09:27.297507] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:27.297843] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-19T18:09:27.724916] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T18:09:27.841367] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:09:27.848598] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-19T18:09:28.088912] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:28.089243] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-19T18:09:28.643267] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-19T18:09:28.895820] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:28.896244] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-19T18:09:29.443356] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-19T18:09:30.243263] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-19T18:09:31.043298] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-19T18:09:31.843281] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-19T18:09:32.141987] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-19T18:09:32.481853] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:09:32.588308] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T18:09:32.643237] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-19T18:09:33.357855] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T18:09:33.443286] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-19T18:09:34.243283] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-19T18:09:35.047133] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-19T18:09:35.048972] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T18:09:35.763733] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-09-19T18:09:35.843268] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-19T18:09:36.205104] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:09:36.643302] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-19T18:09:37.106835] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:09:37.114866] [INFO ] [REMOTE ] CRBG: Full fetch complete (75703 records). [2025-09-19T18:09:37.115040] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-19T18:09:37.458004] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-19T18:09:37.524009] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-19T18:09:37.524098] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-19T18:09:37.524970] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-19T18:09:37.525046] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-19T18:09:37.526585] [DEBUG] [LOCAL ] CRBG: Trimmed 75703 records to 53112 (keeping 200 days of data) [2025-09-19T18:09:37.863027] [DEBUG] [LOCAL ] CRBG: Primary data saved (53112 records). [2025-09-19T18:09:37.863195] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-19T18:09:37.863986] [INFO ] [MAIN ] Update Progress: 527/2372 symbols completed. CRBG took 37.0s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-19T18:09:38.045503] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:38.045827] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-09-19T18:09:38.045888] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-09-19T18:09:38.046196] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-19T18:09:38.046284] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-19T18:09:38.046428] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-09-19T18:09:38.046544] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-19T18:09:38.360131] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T18:09:38.393383] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-19T18:09:38.456086] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:39.027756] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (3.18 seconds). [2025-09-19T18:09:39.043560] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-19T18:09:39.648545] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:09:39.843262] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-19T18:09:40.235900] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T18:09:40.643270] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-19T18:09:41.407723] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-19T18:09:41.443231] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-19T18:09:41.556073] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:09:42.243327] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-19T18:09:42.749614] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:09:43.043334] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-19T18:09:43.467924] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T18:09:43.843353] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-19T18:09:44.643311] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-19T18:09:45.065763] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T18:09:45.209637] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-19T18:09:45.217442] [INFO ] [REMOTE ] CRCL: Full fetch complete (28659 records). [2025-09-19T18:09:45.217569] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-19T18:09:45.417291] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-19T18:09:45.417744] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:09:45.417818] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:09:45.417892] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-19T18:09:45.417969] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-19T18:09:45.418009] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-19T18:09:45.418068] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-19T18:09:45.418159] [INFO ] [MAIN ] Update Progress: 528/2372 symbols completed. CRCL took 27.1s. Estimated remaining: 4h 3m 22s. Rate: 7.6 symbols/min [2025-09-19T18:09:45.451345] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-19T18:09:45.601527] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:45.662935] [DEBUG] [LOCAL ] CRI: Loaded 50352 existing records from primary storage. [2025-09-19T18:09:45.663150] [INFO ] [MAIN ] CRI: Loaded 50352 existing records. [2025-09-19T18:09:45.860784] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:45.861328] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-19T18:09:45.861436] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-19T18:09:45.863075] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-19T18:09:45.863222] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-19T18:09:46.107325] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-19T18:09:46.249481] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-19T18:09:46.281740] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:46.340040] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T18:09:46.879310] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T18:09:46.886167] [INFO ] [REMOTE ] CRC: Full fetch complete (61742 records). [2025-09-19T18:09:46.886331] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-19T18:09:46.887138] [FATAL] [VALIDATOR ] CRC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:09:46.887239] [FATAL] [MAIN ] CRC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:09:46.887283] [WARN ] [MAIN ] CRC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:09:46.887325] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-19T18:09:46.887386] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-09-19T18:09:46.887421] [INFO ] [LOCAL ] CRC: Starting deletion of derivative data. [2025-09-19T18:09:46.887845] [DEBUG] [LOCAL ] CRC: Deleted derivative data file. [2025-09-19T18:09:46.887948] [INFO ] [MAIN ] Update Progress: 529/2372 symbols completed. CRC took 30.7s. Estimated remaining: 4h 2m 52s. Rate: 7.6 symbols/min [2025-09-19T18:09:47.046137] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-19T18:09:47.067124] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:47.119220] [DEBUG] [LOCAL ] CRK: Loaded 52520 existing records from primary storage. [2025-09-19T18:09:47.119384] [INFO ] [MAIN ] CRK: Loaded 52520 existing records. [2025-09-19T18:09:47.297810] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:47.298062] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-19T18:09:47.298109] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-19T18:09:47.299343] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-19T18:09:47.299403] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-19T18:09:47.651601] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:47.843214] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-19T18:09:48.570118] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-19T18:09:48.643244] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-19T18:09:48.965448] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T18:09:49.443255] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-19T18:09:49.535435] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:09:50.195305] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T18:09:50.243269] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-19T18:09:51.043270] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-19T18:09:51.507567] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:09:51.843299] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-19T18:09:52.374227] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T18:09:52.639789] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T18:09:52.649713] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-19T18:09:53.313480] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T18:09:53.443269] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-19T18:09:54.243278] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-19T18:09:55.043324] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-19T18:09:55.149597] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T18:09:55.383027] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T18:09:55.713528] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T18:09:55.843283] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-19T18:09:56.643268] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-19T18:09:56.797532] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T18:09:56.805464] [INFO ] [REMOTE ] CRGY: Full fetch complete (75918 records). [2025-09-19T18:09:56.805603] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-19T18:09:57.188696] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-19T18:09:57.188785] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-19T18:09:57.189602] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-19T18:09:57.189664] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-19T18:09:57.191145] [DEBUG] [LOCAL ] CRGY: Trimmed 75918 records to 53297 (keeping 200 days of data) [2025-09-19T18:09:57.468554] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-19T18:09:57.516328] [DEBUG] [LOCAL ] CRGY: Primary data saved (53297 records). [2025-09-19T18:09:57.516456] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-19T18:09:57.516592] [INFO ] [MAIN ] Update Progress: 530/2372 symbols completed. CRGY took 35.9s. Estimated remaining: 4h 2m 54s. Rate: 7.6 symbols/min [2025-09-19T18:09:57.704338] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:57.751052] [DEBUG] [LOCAL ] CRL: Loaded 43985 existing records from primary storage. [2025-09-19T18:09:57.751200] [INFO ] [MAIN ] CRL: Loaded 43985 existing records. [2025-09-19T18:09:57.951184] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:57.951512] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-19T18:09:57.951597] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-19T18:09:57.952937] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-19T18:09:57.953073] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-19T18:09:58.091611] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-19T18:09:58.269688] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-19T18:09:58.378385] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:58.412868] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T18:09:59.043322] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-19T18:09:59.441111] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T18:09:59.843242] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-19T18:09:59.957191] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T18:10:00.131622] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T18:10:00.643273] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-19T18:10:01.371300] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:10:01.443272] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-19T18:10:02.243267] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-19T18:10:02.876834] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T18:10:03.043297] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-19T18:10:03.512963] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T18:10:03.652568] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T18:10:03.843225] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-19T18:10:04.643305] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-19T18:10:05.115790] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T18:10:05.239595] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T18:10:05.443270] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-19T18:10:06.021160] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:10:06.243294] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-19T18:10:07.046363] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-19T18:10:07.053907] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T18:10:07.507610] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T18:10:07.843273] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-19T18:10:08.643246] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-19T18:10:08.776792] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:10:09.443309] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-19T18:10:09.860909] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T18:10:10.243310] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-19T18:10:10.970395] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:10:11.043237] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-19T18:10:11.087195] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-19T18:10:11.843281] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-19T18:10:12.518131] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T18:10:12.551770] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-19T18:10:12.559946] [INFO ] [REMOTE ] CRK: Full fetch complete (75492 records). [2025-09-19T18:10:12.560129] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-19T18:10:12.653530] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-19T18:10:12.970483] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-19T18:10:12.970592] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-19T18:10:12.971444] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-19T18:10:12.971508] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-19T18:10:12.973412] [DEBUG] [LOCAL ] CRK: Trimmed 75492 records to 52887 (keeping 200 days of data) [2025-09-19T18:10:13.279967] [DEBUG] [LOCAL ] CRK: Primary data saved (52887 records). [2025-09-19T18:10:13.280106] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-19T18:10:13.280249] [INFO ] [MAIN ] Update Progress: 531/2372 symbols completed. CRK took 26.4s. Estimated remaining: 4h 3m 13s. Rate: 7.6 symbols/min [2025-09-19T18:10:13.445588] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-19T18:10:13.447107] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:13.506177] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-09-19T18:10:13.506352] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-09-19T18:10:13.682113] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:13.682360] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-19T18:10:13.682436] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-19T18:10:13.683808] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-19T18:10:13.683868] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-19T18:10:14.040534] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:14.075032] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T18:10:14.243249] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-19T18:10:14.758284] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T18:10:14.858047] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:10:14.865853] [INFO ] [REMOTE ] CRI: Full fetch complete (70792 records). [2025-09-19T18:10:14.866035] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-19T18:10:15.048479] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-19T18:10:15.270462] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-19T18:10:15.270566] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-19T18:10:15.271359] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-19T18:10:15.271423] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-19T18:10:15.272921] [DEBUG] [LOCAL ] CRI: Trimmed 70792 records to 50689 (keeping 200 days of data) [2025-09-19T18:10:15.586917] [DEBUG] [LOCAL ] CRI: Primary data saved (50689 records). [2025-09-19T18:10:15.587061] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-19T18:10:15.587170] [INFO ] [MAIN ] Update Progress: 532/2372 symbols completed. CRI took 30.2s. Estimated remaining: 4h 2m 46s. Rate: 7.6 symbols/min [2025-09-19T18:10:15.758278] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:15.805164] [DEBUG] [LOCAL ] CRS: Loaded 43895 existing records from primary storage. [2025-09-19T18:10:15.805329] [INFO ] [MAIN ] CRS: Loaded 43895 existing records. [2025-09-19T18:10:15.848862] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-19T18:10:15.992815] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:15.993060] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-19T18:10:15.993113] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-19T18:10:15.994168] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-19T18:10:15.994229] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-19T18:10:16.367326] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:16.643268] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-19T18:10:16.818811] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-19T18:10:17.443303] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-19T18:10:17.852346] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T18:10:18.243275] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-19T18:10:18.612569] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T18:10:18.737176] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (3.69 seconds). [2025-09-19T18:10:18.746257] [INFO ] [REMOTE ] CRH: Full fetch complete (77292 records). [2025-09-19T18:10:18.746407] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-19T18:10:19.080590] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-19T18:10:19.188181] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-19T18:10:19.188346] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-19T18:10:19.189221] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-19T18:10:19.189286] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-19T18:10:19.191170] [DEBUG] [LOCAL ] CRH: Trimmed 77292 records to 54250 (keeping 200 days of data) [2025-09-19T18:10:19.534022] [DEBUG] [LOCAL ] CRH: Primary data saved (54250 records). [2025-09-19T18:10:19.534182] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-19T18:10:19.534356] [INFO ] [MAIN ] Update Progress: 533/2372 symbols completed. CRH took 41.7s. Estimated remaining: 4h 2m 24s. Rate: 7.6 symbols/min [2025-09-19T18:10:19.738743] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T18:10:19.770945] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:19.779559] [DEBUG] [LOCAL ] CRT: Loaded 4920 existing records from primary storage. [2025-09-19T18:10:19.779702] [INFO ] [MAIN ] CRT: Loaded 4920 existing records. [2025-09-19T18:10:19.843420] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-19T18:10:19.972771] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:19.973297] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-19T18:10:19.973373] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-19T18:10:19.973766] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-19T18:10:19.973846] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-19T18:10:20.176501] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-19T18:10:20.380621] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:20.643270] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-19T18:10:20.897715] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T18:10:21.443249] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-19T18:10:21.506379] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T18:10:21.840035] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T18:10:22.243281] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-19T18:10:23.043332] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-19T18:10:23.290698] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:10:23.843264] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-19T18:10:24.037219] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:10:24.643330] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-19T18:10:25.138200] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T18:10:25.443307] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-19T18:10:25.867971] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T18:10:26.183778] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T18:10:26.189475] [INFO ] [REMOTE ] CRL: Full fetch complete (62473 records). [2025-09-19T18:10:26.189588] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-19T18:10:26.190382] [FATAL] [VALIDATOR ] CRL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:10:26.190473] [FATAL] [MAIN ] CRL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:10:26.190516] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:10:26.190632] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-19T18:10:26.190779] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-19T18:10:26.190855] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-09-19T18:10:26.191452] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-09-19T18:10:26.191587] [INFO ] [MAIN ] Update Progress: 534/2372 symbols completed. CRL took 28.7s. Estimated remaining: 4h 2m 12s. Rate: 7.6 symbols/min [2025-09-19T18:10:26.248687] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-19T18:10:26.371690] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:26.413729] [DEBUG] [LOCAL ] CSAN: Loaded 42325 existing records from primary storage. [2025-09-19T18:10:26.413952] [INFO ] [MAIN ] CSAN: Loaded 42325 existing records. [2025-09-19T18:10:26.609714] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:26.609975] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-19T18:10:26.610026] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-19T18:10:26.613059] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-19T18:10:26.613125] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-19T18:10:26.978755] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:27.043226] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-19T18:10:27.115185] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T18:10:27.843397] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-19T18:10:28.035301] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-19T18:10:28.643291] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-19T18:10:28.825458] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T18:10:28.841344] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:10:29.443269] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-19T18:10:30.184538] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T18:10:30.243314] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-19T18:10:31.043289] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-19T18:10:31.249815] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-19T18:10:31.429580] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:10:31.843286] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-19T18:10:32.643289] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-19T18:10:33.243538] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-19T18:10:33.443271] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-19T18:10:33.548301] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T18:10:34.243275] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-19T18:10:34.443216] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-19T18:10:34.706721] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-19T18:10:35.043270] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-19T18:10:35.345053] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:10:35.843270] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-19T18:10:36.643270] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-19T18:10:37.078780] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T18:10:37.443268] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-19T18:10:37.805704] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:10:37.871532] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T18:10:38.243313] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-19T18:10:39.043265] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-19T18:10:39.799459] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T18:10:39.843251] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-19T18:10:39.893429] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T18:10:40.222061] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T18:10:40.643273] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-19T18:10:41.443308] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-19T18:10:41.942174] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T18:10:42.243274] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-19T18:10:42.987961] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T18:10:43.043252] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-19T18:10:43.426537] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:10:43.508417] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-19T18:10:43.831726] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T18:10:43.833557] [INFO ] [REMOTE ] CRT: Full fetch complete (7565 records). [2025-09-19T18:10:43.833684] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-19T18:10:43.848383] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-19T18:10:44.215203] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-19T18:10:44.215290] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-19T18:10:44.215514] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-19T18:10:44.215588] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-19T18:10:44.216073] [DEBUG] [LOCAL ] CRT: Trimmed 7565 records to 4969 (keeping 200 days of data) [2025-09-19T18:10:44.246601] [DEBUG] [LOCAL ] CRT: Primary data saved (4969 records). [2025-09-19T18:10:44.246750] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-19T18:10:44.246882] [INFO ] [MAIN ] Update Progress: 535/2372 symbols completed. CRT took 24.7s. Estimated remaining: 4h 2m 39s. Rate: 7.6 symbols/min [2025-09-19T18:10:44.418787] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:44.460747] [DEBUG] [LOCAL ] CSL: Loaded 31709 existing records from primary storage. [2025-09-19T18:10:44.460902] [INFO ] [MAIN ] CSL: Loaded 31709 existing records. [2025-09-19T18:10:44.648866] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-19T18:10:44.654252] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:44.655485] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-19T18:10:44.655542] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-19T18:10:44.656467] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-19T18:10:44.656542] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-19T18:10:45.039243] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:45.443280] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-19T18:10:45.840227] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T18:10:45.848133] [INFO ] [REMOTE ] CRS: Full fetch complete (62467 records). [2025-09-19T18:10:45.848284] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-19T18:10:46.245852] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-19T18:10:46.268502] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-19T18:10:46.268611] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-19T18:10:46.269536] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-19T18:10:46.269605] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-19T18:10:46.271246] [DEBUG] [LOCAL ] CRS: Trimmed 62467 records to 44213 (keeping 200 days of data) [2025-09-19T18:10:46.562792] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T18:10:46.624485] [DEBUG] [LOCAL ] CRS: Primary data saved (44213 records). [2025-09-19T18:10:46.624679] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-19T18:10:46.624843] [INFO ] [MAIN ] Update Progress: 536/2372 symbols completed. CRS took 31.0s. Estimated remaining: 4h 2m 12s. Rate: 7.6 symbols/min [2025-09-19T18:10:46.814740] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:46.831976] [DEBUG] [LOCAL ] CSR: Loaded 12508 existing records from primary storage. [2025-09-19T18:10:46.832124] [INFO ] [MAIN ] CSR: Loaded 12508 existing records. [2025-09-19T18:10:47.029596] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:47.029948] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-19T18:10:47.030020] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-19T18:10:47.030490] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-19T18:10:47.030572] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-19T18:10:47.064565] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-19T18:10:47.431244] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:47.681176] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T18:10:47.843275] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-19T18:10:48.011599] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T18:10:48.022987] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-19T18:10:48.023200] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-19T18:10:48.428698] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-19T18:10:48.428823] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-19T18:10:48.429712] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-19T18:10:48.429795] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-19T18:10:48.432212] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54550 (keeping 200 days of data) [2025-09-19T18:10:48.661427] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-19T18:10:48.792353] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-09-19T18:10:48.792510] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-19T18:10:48.792671] [INFO ] [MAIN ] Update Progress: 537/2372 symbols completed. CRM took 35.5s. Estimated remaining: 4h 1m 44s. Rate: 7.6 symbols/min [2025-09-19T18:10:48.987788] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:49.008748] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T18:10:49.046853] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:10:49.096802] [DEBUG] [LOCAL ] CSTM: Loaded 48163 existing records from primary storage. [2025-09-19T18:10:49.096977] [INFO ] [MAIN ] CSTM: Loaded 48163 existing records. [2025-09-19T18:10:49.274297] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:49.274536] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-19T18:10:49.274584] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-19T18:10:49.275679] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-19T18:10:49.275751] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-19T18:10:49.449035] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-19T18:10:49.594192] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T18:10:49.655735] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:50.243264] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-19T18:10:51.043252] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-19T18:10:51.249479] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T18:10:51.317477] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T18:10:51.843297] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-19T18:10:52.643275] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-19T18:10:52.883826] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T18:10:53.443275] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-19T18:10:53.675329] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:10:54.243318] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-19T18:10:54.362144] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T18:10:55.043262] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-19T18:10:55.369017] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T18:10:55.843266] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-19T18:10:55.930949] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T18:10:56.643306] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-19T18:10:56.800785] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T18:10:56.929100] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:10:57.443298] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-19T18:10:58.243262] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-19T18:10:58.515577] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T18:10:58.964148] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T18:10:59.043288] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-19T18:10:59.189352] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T18:10:59.843376] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-19T18:11:00.643286] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-19T18:11:01.162281] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T18:11:01.443313] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-19T18:11:01.878046] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:11:01.887070] [INFO ] [REMOTE ] CSAN: Full fetch complete (60741 records). [2025-09-19T18:11:01.887386] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-19T18:11:02.029800] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:11:02.248365] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-19T18:11:02.345408] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-19T18:11:02.345527] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-19T18:11:02.346357] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-19T18:11:02.346433] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-19T18:11:02.348049] [DEBUG] [LOCAL ] CSAN: Trimmed 60741 records to 42602 (keeping 200 days of data) [2025-09-19T18:11:02.619118] [DEBUG] [LOCAL ] CSAN: Primary data saved (42602 records). [2025-09-19T18:11:02.619330] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-19T18:11:02.619503] [INFO ] [MAIN ] Update Progress: 538/2372 symbols completed. CSAN took 36.4s. Estimated remaining: 4h 1m 56s. Rate: 7.6 symbols/min [2025-09-19T18:11:02.792345] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:02.811019] [DEBUG] [LOCAL ] CSV: Loaded 13238 existing records from primary storage. [2025-09-19T18:11:02.811184] [INFO ] [MAIN ] CSV: Loaded 13238 existing records. [2025-09-19T18:11:03.008710] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:11:03.009140] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-19T18:11:03.009213] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-19T18:11:03.015692] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-19T18:11:03.025260] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-19T18:11:03.065252] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-19T18:11:03.060037] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T18:11:03.416808] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:03.736478] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:11:03.843276] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-19T18:11:04.603937] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T18:11:04.643222] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-19T18:11:05.370394] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T18:11:05.390980] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T18:11:05.443226] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-19T18:11:06.243258] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-19T18:11:06.541211] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T18:11:07.043227] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-19T18:11:07.155543] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T18:11:07.843287] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-19T18:11:08.100286] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T18:11:08.643300] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-19T18:11:09.443275] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-19T18:11:09.659129] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:11:09.855445] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T18:11:10.243323] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-19T18:11:10.620917] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T18:11:11.043319] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-19T18:11:11.843305] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-19T18:11:12.051045] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:11:12.140864] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T18:11:12.643327] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-19T18:11:13.255028] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:11:13.443290] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-19T18:11:13.896467] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T18:11:13.899034] [INFO ] [REMOTE ] CSR: Full fetch complete (17373 records). [2025-09-19T18:11:13.899115] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-19T18:11:14.252674] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-19T18:11:14.279550] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-19T18:11:14.279630] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-19T18:11:14.280135] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-19T18:11:14.280199] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-19T18:11:14.281331] [DEBUG] [LOCAL ] CSR: Trimmed 17373 records to 12588 (keeping 200 days of data) [2025-09-19T18:11:14.366487] [DEBUG] [LOCAL ] CSR: Primary data saved (12588 records). [2025-09-19T18:11:14.366635] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-19T18:11:14.366765] [INFO ] [MAIN ] Update Progress: 539/2372 symbols completed. CSR took 27.7s. Estimated remaining: 4h 2m 2s. Rate: 7.6 symbols/min [2025-09-19T18:11:14.544232] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:14.544420] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-19T18:11:14.544486] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-19T18:11:14.544701] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-19T18:11:14.544753] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-19T18:11:14.544798] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-19T18:11:14.544832] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-19T18:11:14.911718] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:15.043274] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-19T18:11:15.235550] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:11:15.560421] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:11:15.843306] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-19T18:11:16.643272] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-19T18:11:17.099389] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:11:17.121493] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T18:11:17.443282] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-19T18:11:17.672905] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:17.673627] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-19T18:11:17.760524] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T18:11:17.768355] [INFO ] [REMOTE ] CSL: Full fetch complete (44508 records). [2025-09-19T18:11:17.768480] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-19T18:11:17.769229] [FATAL] [VALIDATOR ] CSL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:11:17.769320] [FATAL] [MAIN ] CSL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:11:17.769377] [WARN ] [MAIN ] CSL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:11:17.769442] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-19T18:11:17.769507] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-09-19T18:11:17.769556] [INFO ] [LOCAL ] CSL: Starting deletion of derivative data. [2025-09-19T18:11:17.770044] [DEBUG] [LOCAL ] CSL: Deleted derivative data file. [2025-09-19T18:11:17.770144] [INFO ] [MAIN ] Update Progress: 540/2372 symbols completed. CSL took 33.5s. Estimated remaining: 4h 1m 38s. Rate: 7.6 symbols/min [2025-09-19T18:11:17.962070] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:17.981834] [DEBUG] [LOCAL ] CTBB: Loaded 7314 existing records from primary storage. [2025-09-19T18:11:17.981991] [INFO ] [MAIN ] CTBB: Loaded 7314 existing records. [2025-09-19T18:11:18.182009] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:11:18.182257] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-19T18:11:18.182305] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-19T18:11:18.182635] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-19T18:11:18.182732] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-19T18:11:18.248452] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-19T18:11:18.530016] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:18.563433] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-19T18:11:18.569861] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:19.043276] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-19T18:11:19.843274] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-19T18:11:20.643323] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-19T18:11:20.672772] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T18:11:21.042355] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T18:11:21.443732] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-19T18:11:21.470435] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T18:11:21.663452] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:21.663908] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-19T18:11:22.243280] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-19T18:11:23.043302] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-19T18:11:23.112836] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T18:11:23.843330] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-19T18:11:24.060350] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T18:11:24.091526] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:24.092043] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-19T18:11:24.643363] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-19T18:11:25.443283] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-19T18:11:26.185889] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:11:26.243331] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-19T18:11:26.474987] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:26.475458] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-19T18:11:26.585842] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T18:11:26.593082] [INFO ] [REMOTE ] CSTM: Full fetch complete (68925 records). [2025-09-19T18:11:26.593265] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-19T18:11:27.000099] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-19T18:11:27.000228] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-19T18:11:27.001215] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-19T18:11:27.001294] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-19T18:11:27.004166] [DEBUG] [LOCAL ] CSTM: Trimmed 68925 records to 48510 (keeping 200 days of data) [2025-09-19T18:11:27.057113] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-19T18:11:27.302947] [DEBUG] [LOCAL ] CSTM: Primary data saved (48510 records). [2025-09-19T18:11:27.303101] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-19T18:11:27.303239] [INFO ] [MAIN ] Update Progress: 541/2372 symbols completed. CSTM took 38.5s. Estimated remaining: 4h 1m 36s. Rate: 7.6 symbols/min [2025-09-19T18:11:27.492060] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:27.492255] [DEBUG] [LOCAL ] CTDD: No existing data file found in primary storage. [2025-09-19T18:11:27.492313] [WARN ] [MAIN ] CTDD: No existing data found, performing full refresh instead. [2025-09-19T18:11:27.492470] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-19T18:11:27.492532] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-19T18:11:27.492582] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-09-19T18:11:27.492616] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-19T18:11:27.838819] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T18:11:27.852845] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-19T18:11:27.896975] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:28.532918] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T18:11:28.643336] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-19T18:11:29.443328] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-19T18:11:29.649687] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:11:29.666012] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:29.666361] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-19T18:11:30.243301] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-19T18:11:30.968306] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-19T18:11:31.043319] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-19T18:11:31.797623] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T18:11:31.843287] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-19T18:11:32.643277] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-19T18:11:32.781165] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T18:11:33.443271] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-19T18:11:33.508819] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T18:11:34.243331] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-19T18:11:34.598843] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T18:11:34.601391] [INFO ] [REMOTE ] CSV: Full fetch complete (19377 records). [2025-09-19T18:11:34.601471] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-19T18:11:34.979129] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-19T18:11:34.979243] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-19T18:11:34.983106] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-19T18:11:34.983187] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-19T18:11:34.983877] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:11:34.986231] [DEBUG] [LOCAL ] CSV: Trimmed 19377 records to 13335 (keeping 200 days of data) [2025-09-19T18:11:35.044418] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-19T18:11:35.069984] [DEBUG] [LOCAL ] CSV: Primary data saved (13335 records). [2025-09-19T18:11:35.070085] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-19T18:11:35.070166] [INFO ] [MAIN ] Update Progress: 542/2372 symbols completed. CSV took 32.5s. Estimated remaining: 4h 1m 27s. Rate: 7.6 symbols/min [2025-09-19T18:11:35.238774] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:35.238948] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-19T18:11:35.239003] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-19T18:11:35.239143] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-19T18:11:35.239198] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-19T18:11:35.239266] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-19T18:11:35.239301] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-19T18:11:35.588983] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:35.843239] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-19T18:11:35.950608] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T18:11:36.497181] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-19T18:11:36.643272] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-19T18:11:37.443284] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-19T18:11:37.810115] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T18:11:38.214727] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T18:11:38.243235] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-19T18:11:39.043327] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-19T18:11:39.116575] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T18:11:39.843270] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-19T18:11:39.994781] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T18:11:40.643352] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-19T18:11:40.994133] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:11:41.443278] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-19T18:11:41.503743] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T18:11:41.505291] [INFO ] [REMOTE ] CTBB: Full fetch complete (11127 records). [2025-09-19T18:11:41.505361] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-19T18:11:41.872576] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-19T18:11:41.872688] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-19T18:11:41.872962] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-19T18:11:41.873002] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-19T18:11:41.873451] [DEBUG] [LOCAL ] CTBB: Trimmed 11127 records to 7337 (keeping 200 days of data) [2025-09-19T18:11:41.921480] [DEBUG] [LOCAL ] CTBB: Primary data saved (7337 records). [2025-09-19T18:11:41.921669] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-19T18:11:41.921777] [INFO ] [MAIN ] Update Progress: 543/2372 symbols completed. CTBB took 24.2s. Estimated remaining: 4h 1m 16s. Rate: 7.6 symbols/min [2025-09-19T18:11:42.099757] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:42.099937] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-19T18:11:42.100024] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-19T18:11:42.100139] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-19T18:11:42.100179] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-19T18:11:42.100219] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-19T18:11:42.100249] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-19T18:11:42.188585] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T18:11:42.253214] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-19T18:11:42.480398] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:43.035841] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T18:11:43.043261] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-19T18:11:43.260463] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:43.260812] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-19T18:11:43.843275] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-19T18:11:44.643276] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-19T18:11:44.860087] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:44.860412] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-19T18:11:45.021800] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T18:11:45.443298] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-19T18:11:45.789515] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:45.789890] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-19T18:11:46.243262] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-19T18:11:46.726903] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T18:11:47.043275] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-19T18:11:47.843270] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-19T18:11:48.294404] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T18:11:48.297398] [INFO ] [REMOTE ] CSW: Full fetch complete (7776 records). [2025-09-19T18:11:48.297471] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-19T18:11:48.483218] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-19T18:11:48.483460] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:11:48.483535] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:11:48.483589] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-19T18:11:48.483677] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-19T18:11:48.483736] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-19T18:11:48.483786] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-19T18:11:48.483849] [INFO ] [MAIN ] Update Progress: 544/2372 symbols completed. CSW took 34.1s. Estimated remaining: 4h 1m 3s. Rate: 7.6 symbols/min [2025-09-19T18:11:48.660133] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-19T18:11:48.663932] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:48.703313] [DEBUG] [LOCAL ] CTO: Loaded 28716 existing records from primary storage. [2025-09-19T18:11:48.703460] [INFO ] [MAIN ] CTO: Loaded 28716 existing records. [2025-09-19T18:11:48.938324] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:48.944132] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:11:48.944831] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-19T18:11:48.945875] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-19T18:11:48.946067] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-19T18:11:48.954356] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-19T18:11:48.954508] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-19T18:11:48.987885] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T18:11:49.323727] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:49.443267] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-19T18:11:49.698627] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:49.699009] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-19T18:11:50.243323] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-19T18:11:50.907519] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T18:11:51.043303] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-19T18:11:51.843312] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-19T18:11:52.073775] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:52.074100] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-19T18:11:52.147083] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T18:11:52.643261] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-19T18:11:53.443247] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-19T18:11:53.789959] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T18:11:54.243294] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-19T18:11:54.746269] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:54.746611] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-19T18:11:55.048420] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-19T18:11:55.053518] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T18:11:55.662894] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-19T18:11:55.843277] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-19T18:11:56.269090] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-19T18:11:56.643324] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-19T18:11:57.427835] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T18:11:57.443234] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-19T18:11:58.216324] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T18:11:58.243267] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-19T18:11:58.822202] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T18:11:58.823706] [INFO ] [REMOTE ] CTDD: Full fetch complete (8610 records). [2025-09-19T18:11:58.823782] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-19T18:11:59.048516] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-19T18:11:59.208876] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-19T18:11:59.209089] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-19T18:11:59.209498] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-19T18:11:59.209586] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-19T18:11:59.210576] [DEBUG] [LOCAL ] CTDD: Trimmed 8610 records to 5937 (keeping 200 days of data) [2025-09-19T18:11:59.255256] [DEBUG] [LOCAL ] CTDD: Primary data saved (5937 records). [2025-09-19T18:11:59.255438] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-19T18:11:59.255530] [INFO ] [MAIN ] Update Progress: 545/2372 symbols completed. CTDD took 32.0s. Estimated remaining: 4h 1m 5s. Rate: 7.6 symbols/min [2025-09-19T18:11:59.367401] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-19T18:11:59.438504] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:59.438738] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-09-19T18:11:59.438787] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-09-19T18:11:59.438928] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-19T18:11:59.438970] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-19T18:11:59.439067] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-09-19T18:11:59.439115] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-19T18:11:59.798419] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:59.843230] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-19T18:12:00.643284] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-19T18:12:00.901282] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:12:00.901594] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-19T18:12:01.443316] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-19T18:12:01.612618] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T18:12:02.243299] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-19T18:12:03.027874] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T18:12:03.043246] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-19T18:12:03.843272] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-19T18:12:04.643268] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-19T18:12:05.004157] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T18:12:05.245844] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (3.00 seconds). [2025-09-19T18:12:05.443291] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-19T18:12:05.548709] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:12:05.549068] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-19T18:12:05.549185] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-19T18:12:05.549255] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-19T18:12:05.549920] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:12:05.549999] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:12:05.550069] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:12:05.550152] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-19T18:12:05.550233] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-19T18:12:05.550270] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-19T18:12:05.550326] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-19T18:12:05.550404] [INFO ] [MAIN ] Update Progress: 546/2372 symbols completed. CTEST took 30.5s. Estimated remaining: 4h 0m 52s. Rate: 7.6 symbols/min [2025-09-19T18:12:05.727126] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:05.743712] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T18:12:05.801769] [DEBUG] [LOCAL ] CTRA: Loaded 54039 existing records from primary storage. [2025-09-19T18:12:05.801916] [INFO ] [MAIN ] CTRA: Loaded 54039 existing records. [2025-09-19T18:12:05.974918] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:12:05.975153] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-19T18:12:05.975200] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-19T18:12:05.976829] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-19T18:12:05.976889] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-19T18:12:06.247785] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-19T18:12:06.327706] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:06.628040] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T18:12:06.630422] [INFO ] [REMOTE ] CTEV: Full fetch complete (13285 records). [2025-09-19T18:12:06.630495] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-19T18:12:06.810565] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 141 unique days, need 200 days [2025-09-19T18:12:06.810853] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:12:06.810921] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:12:06.810970] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-19T18:12:06.811026] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-19T18:12:06.811070] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-19T18:12:06.811107] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-19T18:12:06.811163] [INFO ] [MAIN ] Update Progress: 547/2372 symbols completed. CTEV took 24.9s. Estimated remaining: 4h 0m 22s. Rate: 7.6 symbols/min [2025-09-19T18:12:06.976912] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:07.036270] [DEBUG] [LOCAL ] CTRE: Loaded 49577 existing records from primary storage. [2025-09-19T18:12:07.036415] [INFO ] [MAIN ] CTRE: Loaded 49577 existing records. [2025-09-19T18:12:07.049180] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-19T18:12:07.217563] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:12:07.217806] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-19T18:12:07.217863] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-19T18:12:07.219158] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-19T18:12:07.219217] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-19T18:12:07.581472] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:07.845477] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-19T18:12:07.847690] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:12:08.643265] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-19T18:12:08.778980] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T18:12:09.443291] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-19T18:12:10.091481] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-19T18:12:10.249042] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-19T18:12:10.259826] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T18:12:11.043247] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-19T18:12:11.257277] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:12:11.843254] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-19T18:12:11.947949] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T18:12:12.039082] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T18:12:12.643293] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-19T18:12:13.443273] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-19T18:12:14.243355] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-19T18:12:14.573748] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-19T18:12:15.043494] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-19T18:12:15.392959] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-19T18:12:15.843243] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-19T18:12:16.435761] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T18:12:16.652383] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-19T18:12:16.657516] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (3.21 seconds). [2025-09-19T18:12:16.981584] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:12:17.443263] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-19T18:12:18.059854] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:12:18.087212] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:12:18.243261] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-19T18:12:18.882506] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T18:12:19.043258] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-19T18:12:19.843296] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-19T18:12:20.083145] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T18:12:20.113411] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T18:12:20.643281] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-19T18:12:21.176768] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T18:12:21.443277] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-19T18:12:22.243316] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-19T18:12:22.746151] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:12:23.043246] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-19T18:12:23.068070] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T18:12:23.810301] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T18:12:23.843256] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-19T18:12:24.643299] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-19T18:12:25.443268] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-19T18:12:25.576078] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-19T18:12:25.780884] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T18:12:25.992786] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T18:12:26.243292] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-19T18:12:27.043276] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-19T18:12:27.099419] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T18:12:27.843268] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-19T18:12:27.944636] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T18:12:28.643269] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-19T18:12:29.024010] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:12:29.229355] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T18:12:29.443262] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-19T18:12:30.243280] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-19T18:12:30.563376] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T18:12:30.568318] [INFO ] [REMOTE ] CTOS: Full fetch complete (53188 records). [2025-09-19T18:12:30.568426] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-19T18:12:30.569343] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:12:30.569450] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:12:30.569492] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:12:30.569531] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-19T18:12:30.569589] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-09-19T18:12:30.569623] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-09-19T18:12:30.569708] [DEBUG] [LOCAL ] CTOS: No derivative data file found to delete. [2025-09-19T18:12:30.569784] [INFO ] [MAIN ] Update Progress: 548/2372 symbols completed. CTOS took 31.3s. Estimated remaining: 4h 1m 7s. Rate: 7.6 symbols/min [2025-09-19T18:12:30.741399] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:30.777793] [DEBUG] [LOCAL ] CTRI: Loaded 37668 existing records from primary storage. [2025-09-19T18:12:30.777945] [INFO ] [MAIN ] CTRI: Loaded 37668 existing records. [2025-09-19T18:12:30.970176] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:12:30.970429] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-19T18:12:30.970479] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-19T18:12:30.971548] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-19T18:12:30.971611] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-19T18:12:31.056312] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-19T18:12:31.213076] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T18:12:31.286018] [INFO ] [REMOTE ] CTO: Full fetch complete (41920 records). [2025-09-19T18:12:31.305509] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-19T18:12:31.545237] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:31.817900] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-19T18:12:31.817995] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-19T18:12:31.818675] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-19T18:12:31.818740] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-19T18:12:31.819868] [DEBUG] [LOCAL ] CTO: Trimmed 41920 records to 28928 (keeping 200 days of data) [2025-09-19T18:12:31.875424] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-19T18:12:32.007122] [DEBUG] [LOCAL ] CTO: Primary data saved (28928 records). [2025-09-19T18:12:32.007290] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-19T18:12:32.007428] [INFO ] [MAIN ] Update Progress: 549/2372 symbols completed. CTO took 43.5s. Estimated remaining: 4h 0m 37s. Rate: 7.6 symbols/min [2025-09-19T18:12:32.192784] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:32.212931] [DEBUG] [LOCAL ] CTS: Loaded 19514 existing records from primary storage. [2025-09-19T18:12:32.213103] [INFO ] [MAIN ] CTS: Loaded 19514 existing records. [2025-09-19T18:12:32.413865] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:12:32.414150] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-19T18:12:32.414210] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-19T18:12:32.414967] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-19T18:12:32.415044] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-19T18:12:32.831625] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:32.832193] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-19T18:12:32.865345] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-19T18:12:33.359688] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-19T18:12:33.443257] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-19T18:12:33.554274] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:12:33.684007] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T18:12:34.243313] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-19T18:12:35.043260] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-19T18:12:35.492548] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T18:12:35.651520] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T18:12:35.843234] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-19T18:12:35.864769] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T18:12:35.876122] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-19T18:12:35.876280] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-19T18:12:36.265909] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-19T18:12:36.265998] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-19T18:12:36.266850] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-19T18:12:36.266916] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-19T18:12:36.268468] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 54429 (keeping 200 days of data) [2025-09-19T18:12:36.603266] [DEBUG] [LOCAL ] CTRA: Primary data saved (54429 records). [2025-09-19T18:12:36.603404] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-19T18:12:36.603499] [INFO ] [MAIN ] Update Progress: 550/2372 symbols completed. CTRA took 31.1s. Estimated remaining: 4h 0m 18s. Rate: 7.6 symbols/min [2025-09-19T18:12:36.648369] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-19T18:12:36.782667] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:36.782858] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-09-19T18:12:36.782912] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-09-19T18:12:36.783053] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-19T18:12:36.783120] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-19T18:12:36.783189] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-19T18:12:36.783235] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-19T18:12:37.140903] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:12:37.160805] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:37.443253] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-19T18:12:37.922510] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T18:12:38.243241] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-19T18:12:38.852162] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:12:39.043276] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-19T18:12:39.744632] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T18:12:39.843269] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-19T18:12:40.363591] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T18:12:40.643271] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-19T18:12:41.443275] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-19T18:12:41.919442] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:12:42.243250] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-19T18:12:42.356122] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T18:12:42.867884] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T18:12:42.875875] [INFO ] [REMOTE ] CTRE: Full fetch complete (71078 records). [2025-09-19T18:12:42.876039] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-19T18:12:43.049112] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-19T18:12:43.301843] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-19T18:12:43.302003] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-19T18:12:43.302900] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-19T18:12:43.302965] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-19T18:12:43.304948] [DEBUG] [LOCAL ] CTRE: Trimmed 71078 records to 49948 (keeping 200 days of data) [2025-09-19T18:12:43.622357] [DEBUG] [LOCAL ] CTRE: Primary data saved (49948 records). [2025-09-19T18:12:43.622499] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-19T18:12:43.623327] [INFO ] [MAIN ] Update Progress: 551/2372 symbols completed. CTRE took 36.8s. Estimated remaining: 4h 0m 7s. Rate: 7.6 symbols/min [2025-09-19T18:12:43.804005] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:43.804182] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-19T18:12:43.804238] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-19T18:12:43.804381] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-19T18:12:43.804425] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-19T18:12:43.804467] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-19T18:12:43.804499] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-19T18:12:43.868132] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-19T18:12:44.168704] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:44.198159] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:12:44.457623] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T18:12:44.643280] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-19T18:12:45.384857] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T18:12:45.443297] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-19T18:12:45.866747] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-19T18:12:45.912173] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T18:12:46.243249] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-19T18:12:47.043269] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-19T18:12:47.769580] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T18:12:47.844427] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-19T18:12:47.849220] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T18:12:48.643333] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-19T18:12:49.027080] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T18:12:49.443274] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-19T18:12:49.670168] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:12:49.885619] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-19T18:12:50.243261] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-19T18:12:50.665695] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T18:12:51.043253] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-19T18:12:51.843310] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-19T18:12:52.279619] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T18:12:52.643253] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-19T18:12:53.249452] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T18:12:53.320358] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T18:12:53.443237] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-19T18:12:53.701872] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-19T18:12:54.243262] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-19T18:12:55.043269] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-19T18:12:55.371760] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:12:55.843266] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-19T18:12:56.643246] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-19T18:12:56.708891] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T18:12:57.443235] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-19T18:12:57.925131] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:12:57.947723] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T18:12:58.243270] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-19T18:12:59.043302] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-19T18:12:59.213030] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T18:12:59.488138] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T18:12:59.491320] [INFO ] [REMOTE ] CTS: Full fetch complete (26524 records). [2025-09-19T18:12:59.491409] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-19T18:12:59.848362] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-19T18:12:59.860321] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-19T18:12:59.860401] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-19T18:12:59.860917] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-19T18:12:59.860983] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-19T18:12:59.862071] [DEBUG] [LOCAL ] CTS: Trimmed 26524 records to 19657 (keeping 200 days of data) [2025-09-19T18:12:59.985518] [DEBUG] [LOCAL ] CTS: Primary data saved (19657 records). [2025-09-19T18:12:59.985730] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-19T18:12:59.985879] [INFO ] [MAIN ] Update Progress: 552/2372 symbols completed. CTS took 28.0s. Estimated remaining: 4h 0m 27s. Rate: 7.6 symbols/min [2025-09-19T18:13:00.159622] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:00.212796] [DEBUG] [LOCAL ] CUBE: Loaded 51124 existing records from primary storage. [2025-09-19T18:13:00.212963] [INFO ] [MAIN ] CUBE: Loaded 51124 existing records. [2025-09-19T18:13:00.389541] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:00.389849] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-19T18:13:00.389925] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-19T18:13:00.391895] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-19T18:13:00.391985] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-19T18:13:00.547585] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T18:13:00.650153] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-19T18:13:00.761888] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:01.431562] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T18:13:01.443217] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-19T18:13:01.989814] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T18:13:02.243327] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-19T18:13:03.043289] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-19T18:13:03.464867] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T18:13:03.565999] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T18:13:03.843257] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-19T18:13:04.490476] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T18:13:04.498312] [INFO ] [REMOTE ] CTRI: Full fetch complete (50610 records). [2025-09-19T18:13:04.498482] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-19T18:13:04.651085] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-19T18:13:04.897143] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-19T18:13:04.897234] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-19T18:13:04.897985] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-19T18:13:04.898051] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-19T18:13:04.899284] [DEBUG] [LOCAL ] CTRI: Trimmed 50610 records to 38053 (keeping 200 days of data) [2025-09-19T18:13:05.127602] [DEBUG] [LOCAL ] CTRI: Primary data saved (38053 records). [2025-09-19T18:13:05.127827] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-19T18:13:05.128008] [INFO ] [MAIN ] Update Progress: 553/2372 symbols completed. CTRI took 34.6s. Estimated remaining: 4h 0m 10s. Rate: 7.6 symbols/min [2025-09-19T18:13:05.261048] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T18:13:05.290213] [INFO ] [REMOTE ] CUBB: Full fetch complete (929 records). [2025-09-19T18:13:05.305723] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-19T18:13:05.309148] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:05.452159] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-19T18:13:05.552082] [DEBUG] [LOCAL ] CUBI: Loaded 27519 existing records from primary storage. [2025-09-19T18:13:05.550824] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-19T18:13:05.552480] [INFO ] [MAIN ] CUBI: Loaded 27519 existing records. [2025-09-19T18:13:05.552373] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:13:05.598446] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:13:05.621046] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-19T18:13:05.650777] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-19T18:13:05.659346] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-19T18:13:05.662165] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-19T18:13:05.662612] [INFO ] [MAIN ] Update Progress: 554/2372 symbols completed. CUBB took 22.0s. Estimated remaining: 3h 59m 38s. Rate: 7.6 symbols/min [2025-09-19T18:13:05.816513] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:05.852440] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-19T18:13:05.852963] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-19T18:13:05.863702] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-19T18:13:05.892959] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-19T18:13:05.954313] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:06.329037] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-19T18:13:06.374102] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:06.387137] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-19T18:13:06.390757] [DEBUG] [LOCAL ] CUK: Loaded 51410 existing records from primary storage. [2025-09-19T18:13:06.391007] [INFO ] [MAIN ] CUK: Loaded 51410 existing records. [2025-09-19T18:13:06.649372] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:06.649701] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-19T18:13:06.649760] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-19T18:13:06.650862] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-19T18:13:06.650925] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-19T18:13:07.048716] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-19T18:13:07.169801] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:07.611496] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:13:07.697827] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T18:13:07.843320] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-19T18:13:08.643270] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-19T18:13:09.191970] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T18:13:09.443279] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-19T18:13:09.853877] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T18:13:10.243274] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-19T18:13:10.569792] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T18:13:11.017561] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T18:13:11.043214] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-19T18:13:11.843274] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-19T18:13:11.991677] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T18:13:12.124965] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T18:13:12.643271] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-19T18:13:13.443258] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-19T18:13:14.038385] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T18:13:14.048898] [INFO ] [REMOTE ] CTVA: Full fetch complete (76543 records). [2025-09-19T18:13:14.049073] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-19T18:13:14.049993] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:13:14.050095] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:13:14.050139] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:13:14.050205] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-19T18:13:14.050310] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-19T18:13:14.050400] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-09-19T18:13:14.050469] [DEBUG] [LOCAL ] CTVA: No derivative data file found to delete. [2025-09-19T18:13:14.050565] [INFO ] [MAIN ] Update Progress: 555/2372 symbols completed. CTVA took 37.4s. Estimated remaining: 3h 59m 32s. Rate: 7.6 symbols/min [2025-09-19T18:13:14.237415] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:14.246149] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-19T18:13:14.259899] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T18:13:14.262683] [DEBUG] [LOCAL ] CULP: Loaded 3147 existing records from primary storage. [2025-09-19T18:13:14.268723] [INFO ] [MAIN ] CULP: Loaded 3147 existing records. [2025-09-19T18:13:14.463200] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:14.463455] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-19T18:13:14.463506] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-19T18:13:14.463818] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-19T18:13:14.463878] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-19T18:13:14.841179] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:15.043271] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-19T18:13:15.354515] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:13:15.524102] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-19T18:13:15.842776] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:13:15.851773] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-19T18:13:16.643315] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-19T18:13:17.443294] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-19T18:13:17.814551] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T18:13:17.960732] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T18:13:17.985754] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T18:13:18.243275] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-19T18:13:19.043277] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-19T18:13:19.554019] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T18:13:19.620175] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T18:13:19.843260] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-19T18:13:20.643239] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-19T18:13:21.205217] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T18:13:21.443259] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-19T18:13:22.243234] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-19T18:13:22.368498] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T18:13:22.469403] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T18:13:23.043268] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-19T18:13:23.643297] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T18:13:23.843268] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-19T18:13:24.508288] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:13:24.643287] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-19T18:13:25.443268] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-19T18:13:26.122510] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T18:13:26.175811] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T18:13:26.178084] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T18:13:26.243224] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-19T18:13:27.043337] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-19T18:13:27.843273] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-19T18:13:28.341678] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:13:28.429490] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:13:28.435792] [INFO ] [REMOTE ] CUBI: Full fetch complete (39225 records). [2025-09-19T18:13:28.436145] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-19T18:13:28.533888] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-19T18:13:28.645044] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-19T18:13:28.855547] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-19T18:13:28.855738] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-19T18:13:28.856410] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-19T18:13:28.856485] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-19T18:13:28.857502] [DEBUG] [LOCAL ] CUBI: Trimmed 39225 records to 27721 (keeping 200 days of data) [2025-09-19T18:13:29.033744] [DEBUG] [LOCAL ] CUBI: Primary data saved (27721 records). [2025-09-19T18:13:29.033937] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-19T18:13:29.034075] [INFO ] [MAIN ] Update Progress: 556/2372 symbols completed. CUBI took 23.9s. Estimated remaining: 3h 59m 47s. Rate: 7.6 symbols/min [2025-09-19T18:13:29.220452] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:29.256492] [DEBUG] [LOCAL ] CURB: Loaded 33297 existing records from primary storage. [2025-09-19T18:13:29.256700] [INFO ] [MAIN ] CURB: Loaded 33297 existing records. [2025-09-19T18:13:29.437999] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:29.438296] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-19T18:13:29.438344] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-19T18:13:29.439352] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-19T18:13:29.439414] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-19T18:13:29.450732] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-19T18:13:29.848808] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:30.218729] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T18:13:30.243258] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-19T18:13:30.610518] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-19T18:13:30.837672] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T18:13:31.043266] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-19T18:13:31.843264] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-19T18:13:32.643330] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-19T18:13:32.818245] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T18:13:33.139248] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T18:13:33.443268] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-19T18:13:33.571211] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T18:13:34.243288] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-19T18:13:35.043263] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-19T18:13:35.098896] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T18:13:35.603575] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-19T18:13:35.604994] [INFO ] [REMOTE ] CULP: Full fetch complete (4773 records). [2025-09-19T18:13:35.605089] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-19T18:13:35.860256] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-19T18:13:35.984844] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-19T18:13:35.984951] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-19T18:13:35.985107] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-19T18:13:35.985179] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-19T18:13:35.985982] [DEBUG] [LOCAL ] CULP: Trimmed 4773 records to 3165 (keeping 200 days of data) [2025-09-19T18:13:36.033246] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:13:36.048928] [DEBUG] [LOCAL ] CULP: Primary data saved (3165 records). [2025-09-19T18:13:36.049207] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-19T18:13:36.049389] [INFO ] [MAIN ] Update Progress: 557/2372 symbols completed. CULP took 22.0s. Estimated remaining: 3h 59m 36s. Rate: 7.6 symbols/min [2025-09-19T18:13:36.643274] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-19T18:13:37.443250] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-19T18:13:37.968070] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:13:37.998974] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:13:38.243270] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-19T18:13:39.043294] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-19T18:13:39.365283] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T18:13:39.843327] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-19T18:13:40.051579] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:13:40.643286] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-19T18:13:41.159010] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T18:13:41.443269] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-19T18:13:41.834478] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T18:13:42.243329] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-19T18:13:42.381276] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T18:13:43.043362] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-19T18:13:43.157762] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T18:13:43.166558] [INFO ] [REMOTE ] CUK: Full fetch complete (73671 records). [2025-09-19T18:13:43.166724] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-19T18:13:43.567560] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-19T18:13:43.567700] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-19T18:13:43.568631] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-19T18:13:43.568739] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-19T18:13:43.570483] [DEBUG] [LOCAL ] CUK: Trimmed 73671 records to 51795 (keeping 200 days of data) [2025-09-19T18:13:43.887318] [DEBUG] [LOCAL ] CUK: Primary data saved (51795 records). [2025-09-19T18:13:43.887468] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-19T18:13:43.888339] [INFO ] [MAIN ] Update Progress: 558/2372 symbols completed. CUK took 38.2s. Estimated remaining: 3h 59m 28s. Rate: 7.6 symbols/min [2025-09-19T18:13:44.347960] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T18:13:44.355731] [INFO ] [REMOTE ] CUBE: Full fetch complete (72945 records). [2025-09-19T18:13:44.355870] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-19T18:13:44.767825] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-19T18:13:44.767955] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-19T18:13:44.768793] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-19T18:13:44.768859] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-19T18:13:44.770500] [DEBUG] [LOCAL ] CUBE: Trimmed 72945 records to 51502 (keeping 200 days of data) [2025-09-19T18:13:45.029338] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T18:13:45.042272] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-19T18:13:45.146778] [DEBUG] [LOCAL ] CUBE: Primary data saved (51502 records). [2025-09-19T18:13:45.146936] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-19T18:13:45.147074] [INFO ] [MAIN ] Update Progress: 559/2372 symbols completed. CUBE took 45.2s. Estimated remaining: 3h 58m 58s. Rate: 7.6 symbols/min [2025-09-19T18:13:46.601097] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T18:13:46.607948] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-19T18:13:48.169472] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T18:13:48.177184] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-19T18:13:49.814567] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T18:13:49.824825] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-19T18:13:51.745950] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T18:13:51.751257] [INFO ] [REMOTE ] CURB: Full fetch complete (47209 records). [2025-09-19T18:13:51.751395] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-19T18:13:52.135756] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-19T18:13:52.135867] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-19T18:13:52.136482] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-19T18:13:52.136536] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-19T18:13:52.137722] [DEBUG] [LOCAL ] CURB: Trimmed 47209 records to 33552 (keeping 200 days of data) [2025-09-19T18:13:52.331966] [DEBUG] [LOCAL ] CURB: Primary data saved (33552 records). [2025-09-19T18:13:52.332108] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-19T18:13:52.332193] [INFO ] [MAIN ] Update Progress: 560/2372 symbols completed. CURB took 23.3s. Estimated remaining: 3h 58m 48s. Rate: 7.6 symbols/min [2025-09-19T18:13:52.908471] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:53.015205] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:53.051616] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:53.080380] [DEBUG] [LOCAL ] CUZ: No existing data file found in primary storage. [2025-09-19T18:13:53.080486] [WARN ] [MAIN ] CUZ: No existing data found, performing full refresh instead. [2025-09-19T18:13:53.084255] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:53.085005] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-19T18:13:53.085499] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-19T18:13:53.085608] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-09-19T18:13:53.085734] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-19T18:13:53.247025] [DEBUG] [LOCAL ] CVEO: Loaded 15698 existing records from primary storage. [2025-09-19T18:13:53.266404] [DEBUG] [LOCAL ] CURV: Loaded 26800 existing records from primary storage. [2025-09-19T18:13:53.293468] [INFO ] [MAIN ] CURV: Loaded 26800 existing records. [2025-09-19T18:13:53.271633] [INFO ] [MAIN ] CVEO: Loaded 15698 existing records. [2025-09-19T18:13:53.709041] [DEBUG] [LOCAL ] CVE: Loaded 53947 existing records from primary storage. [2025-09-19T18:13:53.765940] [INFO ] [MAIN ] CVE: Loaded 53947 existing records. [2025-09-19T18:13:53.766164] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:53.863068] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-19T18:13:53.909362] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-19T18:13:53.935631] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:54.002943] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:54.003058] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-19T18:13:53.999764] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-19T18:13:54.016588] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-19T18:13:54.016689] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-19T18:13:54.016891] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-19T18:13:54.034072] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-19T18:13:54.059172] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-19T18:13:54.215403] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:54.294955] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-19T18:13:54.311794] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-19T18:13:54.395290] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-19T18:13:54.460971] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-19T18:13:54.866305] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:54.882154] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-19T18:13:54.999010] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:55.015056] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-19T18:13:55.196121] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:55.196419] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-19T18:13:55.588379] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T18:13:55.591148] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-19T18:13:55.814145] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T18:13:55.823894] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-19T18:13:56.538348] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T18:13:56.546452] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-19T18:13:56.552606] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T18:13:56.555156] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-19T18:13:56.938163] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T18:13:56.949384] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-19T18:13:57.329028] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T18:13:57.338309] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-19T18:13:57.576393] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T18:13:57.579530] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-19T18:13:58.055817] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T18:13:58.061606] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-19T18:13:58.358242] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T18:13:58.362143] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-19T18:13:58.477826] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T18:13:58.488540] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-19T18:13:58.733301] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T18:13:58.742373] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-19T18:13:58.773764] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T18:13:59.043340] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-19T18:13:59.438863] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-19T18:13:59.843238] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-19T18:14:00.155374] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T18:14:00.169016] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T18:14:00.197096] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T18:14:00.643338] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-19T18:14:00.676396] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T18:14:01.443322] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-19T18:14:02.179779] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T18:14:02.243279] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-19T18:14:03.043276] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-19T18:14:03.614059] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T18:14:03.766606] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T18:14:03.843271] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-19T18:14:04.103866] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T18:14:04.643267] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-19T18:14:04.979717] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T18:14:05.443285] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-19T18:14:05.966326] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T18:14:06.243275] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-19T18:14:07.043294] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-19T18:14:07.496333] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:14:07.843283] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-19T18:14:08.393440] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T18:14:08.648363] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-19T18:14:08.665311] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T18:14:09.443271] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-19T18:14:09.780568] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T18:14:09.802364] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T18:14:10.243234] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-19T18:14:10.581295] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T18:14:10.584061] [INFO ] [REMOTE ] CVEO: Full fetch complete (20176 records). [2025-09-19T18:14:10.584201] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-19T18:14:10.954263] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-19T18:14:10.954353] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-19T18:14:10.954796] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-19T18:14:10.954857] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-19T18:14:10.955511] [DEBUG] [LOCAL ] CVEO: Trimmed 20176 records to 15767 (keeping 200 days of data) [2025-09-19T18:14:11.045401] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-19T18:14:11.053429] [DEBUG] [LOCAL ] CVEO: Primary data saved (15767 records). [2025-09-19T18:14:11.053566] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-19T18:14:11.053696] [INFO ] [MAIN ] Update Progress: 561/2372 symbols completed. CVEO took 18.7s. Estimated remaining: 3h 59m 15s. Rate: 7.6 symbols/min [2025-09-19T18:14:11.237954] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:11.252702] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T18:14:11.298413] [DEBUG] [LOCAL ] CVI: Loaded 46782 existing records from primary storage. [2025-09-19T18:14:11.298556] [INFO ] [MAIN ] CVI: Loaded 46782 existing records. [2025-09-19T18:14:11.475307] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:14:11.475602] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-19T18:14:11.475682] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-19T18:14:11.476992] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-19T18:14:11.477054] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-19T18:14:11.852198] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-19T18:14:11.887253] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:12.643307] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-19T18:14:13.078188] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T18:14:13.367712] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T18:14:13.443230] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-19T18:14:14.243248] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-19T18:14:14.720998] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:14:15.043262] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-19T18:14:15.389165] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:14:15.539537] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:14:15.843266] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-19T18:14:16.325892] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T18:14:16.643305] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-19T18:14:17.443313] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-19T18:14:18.195110] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:14:18.203029] [INFO ] [REMOTE ] CUZ: Full fetch complete (70675 records). [2025-09-19T18:14:18.231597] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-19T18:14:18.237401] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-19T18:14:18.243229] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-19T18:14:18.660631] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-19T18:14:18.660744] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-19T18:14:18.661592] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-19T18:14:18.661683] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-19T18:14:18.663209] [DEBUG] [LOCAL ] CUZ: Trimmed 70675 records to 50074 (keeping 200 days of data) [2025-09-19T18:14:18.972476] [DEBUG] [LOCAL ] CUZ: Primary data saved (50074 records). [2025-09-19T18:14:18.972691] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-19T18:14:18.972799] [INFO ] [MAIN ] Update Progress: 562/2372 symbols completed. CUZ took 26.6s. Estimated remaining: 3h 59m 7s. Rate: 7.6 symbols/min [2025-09-19T18:14:19.049250] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-19T18:14:19.151213] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:19.170625] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:14:19.189831] [DEBUG] [LOCAL ] CVLG: Loaded 15548 existing records from primary storage. [2025-09-19T18:14:19.189966] [INFO ] [MAIN ] CVLG: Loaded 15548 existing records. [2025-09-19T18:14:19.366877] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:14:19.367211] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-19T18:14:19.367278] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-19T18:14:19.367783] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-19T18:14:19.367858] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-19T18:14:19.728306] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:19.843255] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-19T18:14:20.104554] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T18:14:20.625592] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-19T18:14:20.643287] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-19T18:14:21.315678] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-19T18:14:21.443305] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-19T18:14:22.243300] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-19T18:14:22.386101] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T18:14:22.927566] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:14:22.935636] [INFO ] [REMOTE ] CVE: Full fetch complete (77536 records). [2025-09-19T18:14:22.935862] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-19T18:14:23.043376] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-19T18:14:23.284937] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T18:14:23.388280] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-19T18:14:23.388391] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-19T18:14:23.389341] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-19T18:14:23.389429] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-19T18:14:23.391203] [DEBUG] [LOCAL ] CVE: Trimmed 77536 records to 54337 (keeping 200 days of data) [2025-09-19T18:14:23.729508] [DEBUG] [LOCAL ] CVE: Primary data saved (54337 records). [2025-09-19T18:14:23.729705] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-19T18:14:23.729863] [INFO ] [MAIN ] Update Progress: 563/2372 symbols completed. CVE took 31.4s. Estimated remaining: 3h 58m 49s. Rate: 7.6 symbols/min [2025-09-19T18:14:23.848503] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-19T18:14:23.905587] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:23.959051] [DEBUG] [LOCAL ] CVNA: Loaded 53454 existing records from primary storage. [2025-09-19T18:14:23.959236] [INFO ] [MAIN ] CVNA: Loaded 53454 existing records. [2025-09-19T18:14:24.140790] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:14:24.141041] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-19T18:14:24.141090] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-19T18:14:24.142495] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-19T18:14:24.142559] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-19T18:14:24.509857] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:24.643344] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-19T18:14:25.443336] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-19T18:14:25.724835] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-19T18:14:25.752257] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T18:14:25.758129] [INFO ] [REMOTE ] CURV: Full fetch complete (39954 records). [2025-09-19T18:14:25.758227] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-19T18:14:26.154374] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-19T18:14:26.154464] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-19T18:14:26.155032] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-19T18:14:26.155095] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-19T18:14:26.156081] [DEBUG] [LOCAL ] CURV: Trimmed 39954 records to 27076 (keeping 200 days of data) [2025-09-19T18:14:26.248628] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-19T18:14:26.321356] [DEBUG] [LOCAL ] CURV: Primary data saved (27076 records). [2025-09-19T18:14:26.321503] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-19T18:14:26.321607] [INFO ] [MAIN ] Update Progress: 564/2372 symbols completed. CURV took 34.0s. Estimated remaining: 3h 58m 24s. Rate: 7.6 symbols/min [2025-09-19T18:14:26.517822] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:26.518266] [DEBUG] [LOCAL ] CVS: No existing data file found in primary storage. [2025-09-19T18:14:26.518330] [WARN ] [MAIN ] CVS: No existing data found, performing full refresh instead. [2025-09-19T18:14:26.518547] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-19T18:14:26.518685] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-19T18:14:26.519348] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-09-19T18:14:26.519538] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-19T18:14:26.649684] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T18:14:26.934715] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:26.977986] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T18:14:27.043239] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-19T18:14:27.843272] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-19T18:14:28.039709] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T18:14:28.501700] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T18:14:28.643277] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-19T18:14:29.443409] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-19T18:14:29.729634] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T18:14:30.243293] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-19T18:14:30.339565] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T18:14:30.386571] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:14:31.043255] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-19T18:14:31.843267] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-19T18:14:32.098261] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:14:32.643275] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-19T18:14:32.948601] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T18:14:33.040997] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T18:14:33.443273] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-19T18:14:34.243277] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-19T18:14:35.018973] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T18:14:35.043220] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-19T18:14:35.276006] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-19T18:14:35.843272] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-19T18:14:36.387314] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T18:14:36.473888] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T18:14:36.481685] [INFO ] [REMOTE ] CVI: Full fetch complete (67241 records). [2025-09-19T18:14:36.481865] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-19T18:14:36.652451] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-19T18:14:36.892151] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-19T18:14:36.892313] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-19T18:14:36.893307] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-19T18:14:36.893393] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-19T18:14:36.894942] [DEBUG] [LOCAL ] CVI: Trimmed 67241 records to 47141 (keeping 200 days of data) [2025-09-19T18:14:37.129898] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T18:14:37.208229] [DEBUG] [LOCAL ] CVI: Primary data saved (47141 records). [2025-09-19T18:14:37.208374] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-19T18:14:37.208481] [INFO ] [MAIN ] Update Progress: 565/2372 symbols completed. CVI took 26.2s. Estimated remaining: 3h 58m 26s. Rate: 7.6 symbols/min [2025-09-19T18:14:37.398794] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:37.455997] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-19T18:14:37.459448] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-09-19T18:14:37.459733] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-09-19T18:14:37.658486] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:14:37.658800] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-19T18:14:37.658860] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-19T18:14:37.660457] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-19T18:14:37.660519] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-19T18:14:38.045676] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:38.243217] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-19T18:14:38.715468] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T18:14:38.844507] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:14:39.043257] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-19T18:14:39.661347] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-19T18:14:39.843262] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-19T18:14:40.643264] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-19T18:14:40.730544] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T18:14:41.443288] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-19T18:14:41.469126] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T18:14:41.471839] [INFO ] [REMOTE ] CVLG: Full fetch complete (20488 records). [2025-09-19T18:14:41.471924] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-19T18:14:41.859557] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-19T18:14:41.859732] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-19T18:14:41.860240] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-19T18:14:41.860341] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-19T18:14:41.861414] [DEBUG] [LOCAL ] CVLG: Trimmed 20488 records to 15662 (keeping 200 days of data) [2025-09-19T18:14:41.958148] [DEBUG] [LOCAL ] CVLG: Primary data saved (15662 records). [2025-09-19T18:14:41.958332] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-19T18:14:41.958453] [INFO ] [MAIN ] Update Progress: 566/2372 symbols completed. CVLG took 23.0s. Estimated remaining: 3h 58m 8s. Rate: 7.6 symbols/min [2025-09-19T18:14:42.165349] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T18:14:42.168483] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:42.168802] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-09-19T18:14:42.179828] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-09-19T18:14:42.180091] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-19T18:14:42.180318] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-19T18:14:42.180882] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-19T18:14:42.180945] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-19T18:14:42.248371] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-19T18:14:42.546431] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:43.043266] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-19T18:14:43.343480] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T18:14:43.843274] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-19T18:14:44.643292] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-19T18:14:44.893835] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-19T18:14:45.027192] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T18:14:45.443317] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-19T18:14:45.617160] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:14:46.243503] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-19T18:14:46.243431] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:14:47.043262] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-19T18:14:47.772111] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T18:14:47.843224] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-19T18:14:48.251256] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T18:14:48.563809] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T18:14:48.643257] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-19T18:14:49.443321] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-19T18:14:50.151571] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T18:14:50.221274] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T18:14:50.243253] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-19T18:14:51.043226] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-19T18:14:51.843244] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-19T18:14:51.878171] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-19T18:14:52.264598] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T18:14:52.643240] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-19T18:14:53.251795] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T18:14:53.443302] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-19T18:14:53.528695] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-19T18:14:54.243296] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-19T18:14:54.488875] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T18:14:55.043255] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-19T18:14:55.802684] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-19T18:14:55.810345] [INFO ] [REMOTE ] CVNA: Full fetch complete (76690 records). [2025-09-19T18:14:55.810475] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-19T18:14:55.853797] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-19T18:14:56.209334] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-19T18:14:56.209416] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-19T18:14:56.210246] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-19T18:14:56.210310] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-19T18:14:56.212056] [DEBUG] [LOCAL ] CVNA: Trimmed 76690 records to 53831 (keeping 200 days of data) [2025-09-19T18:14:56.539884] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T18:14:56.555392] [DEBUG] [LOCAL ] CVNA: Primary data saved (53831 records). [2025-09-19T18:14:56.555527] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-19T18:14:56.555622] [INFO ] [MAIN ] Update Progress: 567/2372 symbols completed. CVNA took 32.8s. Estimated remaining: 3h 58m 21s. Rate: 7.6 symbols/min [2025-09-19T18:14:56.652927] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-19T18:14:56.727058] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:56.727209] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-09-19T18:14:56.727247] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-09-19T18:14:56.727385] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-19T18:14:56.727428] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-19T18:14:56.727469] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-19T18:14:56.727501] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-19T18:14:57.131478] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:57.161632] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-09-19T18:14:57.443225] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-19T18:14:57.657634] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T18:14:58.190077] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T18:14:58.243222] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-19T18:14:59.043271] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-19T18:14:59.458430] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T18:14:59.843277] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-19T18:15:00.161884] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-19T18:15:00.454359] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T18:15:00.643284] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-19T18:15:01.244344] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:15:01.443277] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-19T18:15:02.243299] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-19T18:15:03.043307] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-19T18:15:03.257227] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-19T18:15:03.843336] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-19T18:15:04.331351] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-19T18:15:04.643251] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-19T18:15:06.316274] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-19T18:15:06.325738] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-19T18:15:06.665186] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (3.62 seconds). [2025-09-19T18:15:06.684625] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-19T18:15:06.686223] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T18:15:06.689788] [INFO ] [REMOTE ] CW: Full fetch complete (33489 records). [2025-09-19T18:15:06.689867] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-19T18:15:06.690390] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:15:06.690477] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:15:06.690534] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:15:06.690618] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-19T18:15:06.690741] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-19T18:15:06.690815] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-09-19T18:15:06.690915] [DEBUG] [LOCAL ] CW: No derivative data file found to delete. [2025-09-19T18:15:06.691013] [INFO ] [MAIN ] Update Progress: 568/2372 symbols completed. CW took 24.7s. Estimated remaining: 3h 58m 20s. Rate: 7.6 symbols/min [2025-09-19T18:15:06.862495] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:06.912580] [DEBUG] [LOCAL ] CWEN: Loaded 45379 existing records from primary storage. [2025-09-19T18:15:06.912760] [INFO ] [MAIN ] CWEN: Loaded 45379 existing records. [2025-09-19T18:15:07.091094] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:07.091347] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-19T18:15:07.091394] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-19T18:15:07.092829] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-19T18:15:07.092889] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-19T18:15:07.449681] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:07.450085] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-19T18:15:07.586706] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (5.34 seconds). [2025-09-19T18:15:07.843294] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-19T18:15:07.926156] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T18:15:08.643323] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-19T18:15:09.051843] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:15:09.443290] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-19T18:15:09.713402] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T18:15:10.243283] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-19T18:15:10.426570] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:15:10.849326] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-19T18:15:11.043287] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-19T18:15:11.847267] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-19T18:15:11.936071] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T18:15:12.299110] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-19T18:15:12.312598] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-19T18:15:12.312954] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-19T18:15:12.651843] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-19T18:15:12.818600] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-19T18:15:12.818738] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-19T18:15:12.819821] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-19T18:15:12.819915] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-19T18:15:12.821721] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54540 (keeping 200 days of data) [2025-09-19T18:15:13.181718] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-09-19T18:15:13.181911] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-19T18:15:13.182054] [INFO ] [MAIN ] Update Progress: 569/2372 symbols completed. CVX took 36.0s. Estimated remaining: 3h 58m 8s. Rate: 7.6 symbols/min [2025-09-19T18:15:13.374990] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T18:15:13.402608] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:13.454199] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-19T18:15:13.457409] [DEBUG] [LOCAL ] CWH: Loaded 51794 existing records from primary storage. [2025-09-19T18:15:13.457570] [INFO ] [MAIN ] CWH: Loaded 51794 existing records. [2025-09-19T18:15:13.638784] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:13.639049] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-19T18:15:13.639102] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-19T18:15:13.640761] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-19T18:15:13.640834] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-19T18:15:13.998411] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:14.243287] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-19T18:15:15.062344] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (3.22 seconds). [2025-09-19T18:15:15.073718] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-19T18:15:16.127752] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (3.48 seconds). [2025-09-19T18:15:16.137136] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-19T18:15:16.167862] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-19T18:15:16.643315] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-19T18:15:16.798764] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-19T18:15:16.894352] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T18:15:16.901699] [INFO ] [REMOTE ] CVS: Full fetch complete (77425 records). [2025-09-19T18:15:16.901837] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-19T18:15:16.902693] [FATAL] [VALIDATOR ] CVS: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:15:16.902786] [FATAL] [MAIN ] CVS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:15:16.902852] [WARN ] [MAIN ] CVS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:15:16.902915] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-19T18:15:16.902975] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-09-19T18:15:16.903011] [INFO ] [LOCAL ] CVS: Starting deletion of derivative data. [2025-09-19T18:15:16.903049] [DEBUG] [LOCAL ] CVS: No derivative data file found to delete. [2025-09-19T18:15:16.903110] [INFO ] [MAIN ] Update Progress: 570/2372 symbols completed. CVS took 50.6s. Estimated remaining: 3h 57m 46s. Rate: 7.6 symbols/min [2025-09-19T18:15:17.077210] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:17.130351] [DEBUG] [LOCAL ] CWK: Loaded 49789 existing records from primary storage. [2025-09-19T18:15:17.130501] [INFO ] [MAIN ] CWK: Loaded 49789 existing records. [2025-09-19T18:15:17.306194] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:17.306432] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-19T18:15:17.306480] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-19T18:15:17.307632] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-19T18:15:17.307732] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-19T18:15:17.451516] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-19T18:15:17.677838] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:18.028823] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T18:15:18.243278] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-19T18:15:18.390018] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T18:15:18.930259] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T18:15:19.043286] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-19T18:15:19.705862] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:15:19.843291] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-19T18:15:20.597943] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T18:15:20.643240] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-19T18:15:21.124410] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T18:15:21.443275] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-19T18:15:22.243271] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-19T18:15:22.819800] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T18:15:22.829081] [INFO ] [REMOTE ] CWAN: Full fetch complete (75087 records). [2025-09-19T18:15:22.829233] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-19T18:15:23.048345] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-19T18:15:23.264757] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-19T18:15:23.264904] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-19T18:15:23.267366] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-19T18:15:23.267608] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-19T18:15:23.300368] [DEBUG] [LOCAL ] CWAN: Trimmed 75087 records to 53159 (keeping 200 days of data) [2025-09-19T18:15:23.303408] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T18:15:23.453274] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T18:15:23.663349] [DEBUG] [LOCAL ] CWAN: Primary data saved (53159 records). [2025-09-19T18:15:23.663494] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-19T18:15:23.663584] [INFO ] [MAIN ] Update Progress: 571/2372 symbols completed. CWAN took 27.1s. Estimated remaining: 3h 57m 35s. Rate: 7.6 symbols/min [2025-09-19T18:15:23.837480] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:23.843254] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-19T18:15:23.869287] [DEBUG] [LOCAL ] CWT: Loaded 28182 existing records from primary storage. [2025-09-19T18:15:23.869452] [INFO ] [MAIN ] CWT: Loaded 28182 existing records. [2025-09-19T18:15:24.075967] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:24.076284] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-19T18:15:24.076392] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-19T18:15:24.077259] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-19T18:15:24.077335] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-19T18:15:24.437099] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:24.643261] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-19T18:15:25.107051] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T18:15:25.443277] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-19T18:15:25.822815] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:15:25.918381] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:15:26.243277] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-19T18:15:26.716904] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T18:15:27.043277] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-19T18:15:27.843297] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-19T18:15:27.948564] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:15:28.561138] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T18:15:28.643265] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-19T18:15:29.400492] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:15:29.443234] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-19T18:15:30.243226] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-19T18:15:30.699554] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:15:30.893571] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T18:15:31.043252] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-19T18:15:31.745022] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T18:15:31.843270] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-19T18:15:32.606794] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T18:15:32.643218] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-19T18:15:33.443240] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-19T18:15:33.765234] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T18:15:33.897257] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:15:34.243294] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-19T18:15:35.043258] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-19T18:15:35.423298] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:15:35.843277] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-19T18:15:36.525155] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T18:15:36.643282] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-19T18:15:37.013426] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T18:15:37.027541] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T18:15:37.443273] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-19T18:15:38.243270] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-19T18:15:38.760537] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T18:15:39.043260] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-19T18:15:39.490876] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T18:15:39.500218] [INFO ] [REMOTE ] CWEN: Full fetch complete (64344 records). [2025-09-19T18:15:39.500407] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-19T18:15:39.861755] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-19T18:15:39.914445] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-19T18:15:39.914825] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-19T18:15:39.915802] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-19T18:15:39.943194] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-19T18:15:39.949255] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:15:39.960197] [DEBUG] [LOCAL ] CWEN: Trimmed 64344 records to 45721 (keeping 200 days of data) [2025-09-19T18:15:40.253060] [DEBUG] [LOCAL ] CWEN: Primary data saved (45721 records). [2025-09-19T18:15:40.253197] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-19T18:15:40.254469] [INFO ] [MAIN ] Update Progress: 572/2372 symbols completed. CWEN took 33.6s. Estimated remaining: 3h 57m 54s. Rate: 7.6 symbols/min [2025-09-19T18:15:40.426046] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:40.426224] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-09-19T18:15:40.426261] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-09-19T18:15:40.426419] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-19T18:15:40.426462] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-19T18:15:40.426502] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-09-19T18:15:40.426562] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-19T18:15:40.649158] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-19T18:15:40.811873] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:40.821453] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T18:15:40.834516] [INFO ] [REMOTE ] CWH: Full fetch complete (72698 records). [2025-09-19T18:15:40.834703] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-19T18:15:41.229634] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-19T18:15:41.229780] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-19T18:15:41.230601] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-19T18:15:41.230666] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-19T18:15:41.232225] [DEBUG] [LOCAL ] CWH: Trimmed 72698 records to 52176 (keeping 200 days of data) [2025-09-19T18:15:41.452008] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-19T18:15:41.454472] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T18:15:41.619748] [DEBUG] [LOCAL ] CWH: Primary data saved (52176 records). [2025-09-19T18:15:41.620021] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-19T18:15:41.620142] [INFO ] [MAIN ] Update Progress: 573/2372 symbols completed. CWH took 28.4s. Estimated remaining: 3h 57m 26s. Rate: 7.6 symbols/min [2025-09-19T18:15:41.796993] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:41.807466] [DEBUG] [LOCAL ] CXE: Loaded 7287 existing records from primary storage. [2025-09-19T18:15:41.807597] [INFO ] [MAIN ] CXE: Loaded 7287 existing records. [2025-09-19T18:15:41.996063] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:41.996460] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-19T18:15:41.996548] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-19T18:15:41.997252] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-19T18:15:41.997329] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-19T18:15:42.251674] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-19T18:15:42.398795] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:42.430670] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T18:15:43.048040] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-19T18:15:43.052972] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:15:43.849628] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-19T18:15:43.854229] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T18:15:43.949564] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T18:15:44.643265] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-19T18:15:45.393377] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:15:45.443228] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-19T18:15:45.573798] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T18:15:46.170118] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T18:15:46.243291] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-19T18:15:47.043275] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-19T18:15:47.800374] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:15:47.805190] [INFO ] [REMOTE ] CWT: Full fetch complete (40309 records). [2025-09-19T18:15:47.805302] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-19T18:15:47.852778] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-19T18:15:48.219429] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-19T18:15:48.219545] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-19T18:15:48.220121] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-19T18:15:48.220184] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-19T18:15:48.221223] [DEBUG] [LOCAL ] CWT: Trimmed 40309 records to 28363 (keeping 200 days of data) [2025-09-19T18:15:48.424631] [DEBUG] [LOCAL ] CWT: Primary data saved (28363 records). [2025-09-19T18:15:48.439903] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-19T18:15:48.443756] [INFO ] [MAIN ] Update Progress: 574/2372 symbols completed. CWT took 24.8s. Estimated remaining: 3h 57m 14s. Rate: 7.6 symbols/min [2025-09-19T18:15:48.515987] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T18:15:48.636882] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:48.637107] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-09-19T18:15:48.637163] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-09-19T18:15:48.637308] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-19T18:15:48.637361] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-19T18:15:48.637410] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-09-19T18:15:48.637451] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-19T18:15:48.648584] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-19T18:15:49.000108] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:49.385345] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:15:49.443232] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-19T18:15:49.700717] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T18:15:50.243264] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-19T18:15:50.910712] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T18:15:51.043252] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-19T18:15:51.347229] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T18:15:51.843270] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-19T18:15:51.868591] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T18:15:52.643315] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-19T18:15:53.214891] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T18:15:53.222280] [INFO ] [REMOTE ] CWK: Full fetch complete (70823 records). [2025-09-19T18:15:53.222446] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-19T18:15:53.453844] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-19T18:15:53.534144] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T18:15:53.631777] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-19T18:15:53.631885] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-19T18:15:53.632954] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-19T18:15:53.633028] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-19T18:15:53.635713] [DEBUG] [LOCAL ] CWK: Trimmed 70823 records to 50153 (keeping 200 days of data) [2025-09-19T18:15:53.978569] [DEBUG] [LOCAL ] CWK: Primary data saved (50153 records). [2025-09-19T18:15:53.978775] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-19T18:15:53.978876] [INFO ] [MAIN ] Update Progress: 575/2372 symbols completed. CWK took 37.1s. Estimated remaining: 3h 56m 59s. Rate: 7.6 symbols/min [2025-09-19T18:15:54.233402] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:54.233628] [DEBUG] [LOCAL ] CXM: No existing data file found in primary storage. [2025-09-19T18:15:54.233709] [WARN ] [MAIN ] CXM: No existing data found, performing full refresh instead. [2025-09-19T18:15:54.233914] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-19T18:15:54.233958] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-19T18:15:54.234001] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-09-19T18:15:54.234033] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-19T18:15:54.248428] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-19T18:15:54.608555] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:54.897908] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-19T18:15:55.043290] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-19T18:15:55.623690] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T18:15:55.843273] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-19T18:15:56.609694] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T18:15:56.643303] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-19T18:15:56.970639] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T18:15:57.145155] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-19T18:15:57.443276] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-19T18:15:58.063395] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T18:15:58.243282] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-19T18:15:59.043254] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-19T18:15:59.843268] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-19T18:16:00.337373] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T18:16:00.620589] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-19T18:16:00.643225] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-19T18:16:00.930749] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T18:16:01.443316] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-19T18:16:01.611227] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T18:16:01.614264] [INFO ] [REMOTE ] CXE: Full fetch complete (11865 records). [2025-09-19T18:16:01.614456] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-19T18:16:02.091275] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-19T18:16:02.091400] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-19T18:16:02.091743] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-19T18:16:02.091818] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-19T18:16:02.092567] [DEBUG] [LOCAL ] CXE: Trimmed 11865 records to 7323 (keeping 200 days of data) [2025-09-19T18:16:02.139670] [DEBUG] [LOCAL ] CXE: Primary data saved (7323 records). [2025-09-19T18:16:02.139851] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-19T18:16:02.139957] [INFO ] [MAIN ] Update Progress: 576/2372 symbols completed. CXE took 20.5s. Estimated remaining: 3h 56m 52s. Rate: 7.6 symbols/min [2025-09-19T18:16:02.251473] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-19T18:16:02.333988] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:02.366472] [DEBUG] [LOCAL ] CXT: Loaded 31312 existing records from primary storage. [2025-09-19T18:16:02.366612] [INFO ] [MAIN ] CXT: Loaded 31312 existing records. [2025-09-19T18:16:02.555294] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:02.555572] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-19T18:16:02.555684] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-19T18:16:02.556679] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-19T18:16:02.556740] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-19T18:16:02.919726] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:03.007196] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T18:16:03.032719] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T18:16:03.043225] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-19T18:16:03.843279] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-19T18:16:04.391562] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T18:16:04.425963] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T18:16:04.643326] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-19T18:16:05.062635] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T18:16:05.443337] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-19T18:16:06.243316] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-19T18:16:07.007774] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T18:16:07.043250] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-19T18:16:07.834057] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T18:16:07.843208] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-19T18:16:08.003994] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T18:16:08.552064] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T18:16:08.643219] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-19T18:16:09.443273] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-19T18:16:09.617735] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:16:10.243282] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-19T18:16:10.750580] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T18:16:11.043287] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-19T18:16:11.734475] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:16:11.843258] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-19T18:16:12.566471] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T18:16:12.643279] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-19T18:16:13.443389] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-19T18:16:13.477552] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T18:16:13.798232] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T18:16:14.115360] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T18:16:14.243284] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-19T18:16:15.043271] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-19T18:16:15.223428] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T18:16:15.225020] [INFO ] [REMOTE ] CXH: Full fetch complete (5529 records). [2025-09-19T18:16:15.225118] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-19T18:16:15.609252] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-19T18:16:15.609398] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-19T18:16:15.609639] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-19T18:16:15.609722] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-19T18:16:15.610130] [DEBUG] [LOCAL ] CXH: Trimmed 5529 records to 4458 (keeping 200 days of data) [2025-09-19T18:16:15.636588] [DEBUG] [LOCAL ] CXH: Primary data saved (4458 records). [2025-09-19T18:16:15.636754] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-19T18:16:15.636843] [INFO ] [MAIN ] Update Progress: 577/2372 symbols completed. CXH took 27.2s. Estimated remaining: 3h 57m 1s. Rate: 7.6 symbols/min [2025-09-19T18:16:15.813480] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:15.844111] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-19T18:16:15.864429] [DEBUG] [LOCAL ] CXW: Loaded 44915 existing records from primary storage. [2025-09-19T18:16:15.864596] [INFO ] [MAIN ] CXW: Loaded 44915 existing records. [2025-09-19T18:16:16.053555] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:16.053845] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-19T18:16:16.053952] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-19T18:16:16.055347] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-19T18:16:16.055420] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-19T18:16:16.447819] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:16.643281] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-19T18:16:16.902785] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T18:16:17.443320] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-19T18:16:17.737924] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T18:16:18.041264] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T18:16:18.243267] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-19T18:16:18.482924] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T18:16:19.043255] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-19T18:16:19.843291] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-19T18:16:20.445950] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T18:16:20.596436] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T18:16:20.643252] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-19T18:16:21.197960] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T18:16:21.443267] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-19T18:16:22.243299] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-19T18:16:22.731117] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T18:16:23.000511] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T18:16:23.043257] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-19T18:16:23.843288] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-19T18:16:24.055526] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:16:24.643305] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-19T18:16:24.812560] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:16:24.850197] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T18:16:25.443263] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-19T18:16:26.243288] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-19T18:16:26.281303] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T18:16:26.293726] [INFO ] [REMOTE ] CX: Full fetch complete (76356 records). [2025-09-19T18:16:26.293920] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-19T18:16:26.717873] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-19T18:16:26.717996] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-19T18:16:26.718876] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-19T18:16:26.718944] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-19T18:16:26.720588] [DEBUG] [LOCAL ] CX: Trimmed 76356 records to 53611 (keeping 200 days of data) [2025-09-19T18:16:27.043382] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-19T18:16:27.058851] [DEBUG] [LOCAL ] CX: Primary data saved (53611 records). [2025-09-19T18:16:27.058992] [INFO ] [MAIN ] CX: Full history saved. [2025-09-19T18:16:27.059128] [INFO ] [MAIN ] Update Progress: 578/2372 symbols completed. CX took 46.8s. Estimated remaining: 3h 57m 4s. Rate: 7.6 symbols/min [2025-09-19T18:16:27.240449] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:27.291520] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:16:27.302250] [DEBUG] [LOCAL ] CYD: Loaded 27150 existing records from primary storage. [2025-09-19T18:16:27.302708] [INFO ] [MAIN ] CYD: Loaded 27150 existing records. [2025-09-19T18:16:27.487203] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:27.487529] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-19T18:16:27.487589] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-19T18:16:27.488480] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-19T18:16:27.488543] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-19T18:16:27.841838] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:27.843216] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-19T18:16:28.131515] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:16:28.648373] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-19T18:16:28.667147] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:16:28.681688] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T18:16:29.443259] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-19T18:16:30.187699] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T18:16:30.243334] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-19T18:16:30.710324] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T18:16:31.043281] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-19T18:16:31.568710] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:16:31.573730] [INFO ] [REMOTE ] CXT: Full fetch complete (44788 records). [2025-09-19T18:16:31.573863] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-19T18:16:31.848443] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-19T18:16:32.058101] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-19T18:16:32.058186] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-19T18:16:32.058860] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-19T18:16:32.058975] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-19T18:16:32.060035] [DEBUG] [LOCAL ] CXT: Trimmed 44788 records to 31548 (keeping 200 days of data) [2025-09-19T18:16:32.252318] [DEBUG] [LOCAL ] CXT: Primary data saved (31548 records). [2025-09-19T18:16:32.252470] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-19T18:16:32.252569] [INFO ] [MAIN ] Update Progress: 579/2372 symbols completed. CXT took 30.1s. Estimated remaining: 3h 56m 48s. Rate: 7.6 symbols/min [2025-09-19T18:16:32.442228] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:32.486950] [DEBUG] [LOCAL ] CYH: Loaded 48382 existing records from primary storage. [2025-09-19T18:16:32.487112] [INFO ] [MAIN ] CYH: Loaded 48382 existing records. [2025-09-19T18:16:32.648410] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-19T18:16:32.689720] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:32.689984] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-19T18:16:32.690047] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-19T18:16:32.691531] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-19T18:16:32.691604] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-19T18:16:33.071722] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:33.103142] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T18:16:33.271998] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T18:16:33.443271] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-19T18:16:34.243294] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-19T18:16:34.575719] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T18:16:35.043256] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-19T18:16:35.491925] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:16:35.843268] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-19T18:16:36.264331] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T18:16:36.643256] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-19T18:16:36.819124] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T18:16:36.826499] [INFO ] [REMOTE ] CXM: Full fetch complete (69152 records). [2025-09-19T18:16:36.826688] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-19T18:16:37.237382] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-19T18:16:37.237473] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-19T18:16:37.238342] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-19T18:16:37.238408] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-19T18:16:37.239921] [DEBUG] [LOCAL ] CXM: Trimmed 69152 records to 48705 (keeping 200 days of data) [2025-09-19T18:16:37.452093] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-19T18:16:37.541247] [DEBUG] [LOCAL ] CXM: Primary data saved (48705 records). [2025-09-19T18:16:37.541400] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-19T18:16:37.541494] [INFO ] [MAIN ] Update Progress: 580/2372 symbols completed. CXM took 43.6s. Estimated remaining: 3h 56m 32s. Rate: 7.6 symbols/min [2025-09-19T18:16:37.728454] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:37.784724] [DEBUG] [LOCAL ] D: Loaded 54037 existing records from primary storage. [2025-09-19T18:16:37.784998] [INFO ] [MAIN ] D: Loaded 54037 existing records. [2025-09-19T18:16:37.940399] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T18:16:38.015434] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:38.015714] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-19T18:16:38.015770] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-19T18:16:38.017263] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-19T18:16:38.017326] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-19T18:16:38.258554] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-19T18:16:38.384555] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:38.589051] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:16:38.690723] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T18:16:39.043282] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-19T18:16:39.547338] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T18:16:39.843275] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-19T18:16:40.643272] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-19T18:16:40.691127] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:16:41.443260] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-19T18:16:41.972033] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T18:16:42.168470] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:16:42.174954] [INFO ] [REMOTE ] CXW: Full fetch complete (65052 records). [2025-09-19T18:16:42.175074] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-19T18:16:42.248418] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-19T18:16:42.583967] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-19T18:16:42.584100] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-19T18:16:42.585078] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-19T18:16:42.585429] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-19T18:16:42.601519] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T18:16:42.608149] [DEBUG] [LOCAL ] CXW: Trimmed 65052 records to 45182 (keeping 200 days of data) [2025-09-19T18:16:42.872582] [DEBUG] [LOCAL ] CXW: Primary data saved (45182 records). [2025-09-19T18:16:42.872751] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-19T18:16:42.872847] [INFO ] [MAIN ] Update Progress: 581/2372 symbols completed. CXW took 27.2s. Estimated remaining: 3h 56m 16s. Rate: 7.6 symbols/min [2025-09-19T18:16:43.057277] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-19T18:16:43.061610] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:43.061808] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-09-19T18:16:43.063277] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-09-19T18:16:43.063467] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-19T18:16:43.063534] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-19T18:16:43.063589] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-19T18:16:43.063623] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-19T18:16:43.427608] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:43.843241] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-19T18:16:44.506223] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T18:16:44.606450] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-19T18:16:44.643223] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-19T18:16:45.317598] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T18:16:45.443253] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-19T18:16:46.189315] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T18:16:46.243258] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-19T18:16:47.043276] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-19T18:16:47.436633] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T18:16:47.696329] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T18:16:47.843281] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-19T18:16:48.401885] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T18:16:48.643248] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-19T18:16:49.084825] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:16:49.443270] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-19T18:16:50.243272] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-19T18:16:50.309054] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T18:16:50.551487] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T18:16:51.043312] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-19T18:16:51.843266] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-19T18:16:52.460756] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:16:52.544698] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:16:52.643308] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-19T18:16:53.443286] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-19T18:16:53.845875] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:16:54.207717] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T18:16:54.243260] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-19T18:16:55.043298] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-19T18:16:55.301328] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T18:16:55.796184] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:16:55.800877] [INFO ] [REMOTE ] CYD: Full fetch complete (31664 records). [2025-09-19T18:16:55.800958] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-19T18:16:55.848418] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-19T18:16:56.201307] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-19T18:16:56.201391] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-19T18:16:56.201957] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-19T18:16:56.202020] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-19T18:16:56.202887] [DEBUG] [LOCAL ] CYD: Trimmed 31664 records to 27385 (keeping 200 days of data) [2025-09-19T18:16:56.367325] [DEBUG] [LOCAL ] CYD: Primary data saved (27385 records). [2025-09-19T18:16:56.367490] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-19T18:16:56.367662] [INFO ] [MAIN ] Update Progress: 582/2372 symbols completed. CYD took 29.3s. Estimated remaining: 3h 56m 25s. Rate: 7.6 symbols/min [2025-09-19T18:16:56.553610] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:56.612232] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-09-19T18:16:56.612383] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-09-19T18:16:56.656514] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-19T18:16:56.811825] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:56.812098] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-19T18:16:56.812151] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-19T18:16:56.813382] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-19T18:16:56.813447] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-19T18:16:57.231542] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:57.268108] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T18:16:57.291352] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:16:57.443348] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-19T18:16:58.243332] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-19T18:16:58.725491] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T18:16:59.043310] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-19T18:16:59.242923] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T18:16:59.843287] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-19T18:17:00.568526] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T18:17:00.643265] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-19T18:17:01.279742] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T18:17:01.443272] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-19T18:17:01.945280] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T18:17:02.243285] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-19T18:17:03.014480] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T18:17:03.043210] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-19T18:17:03.084009] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T18:17:03.317683] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-19T18:17:03.843289] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-19T18:17:04.238479] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T18:17:04.643273] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-19T18:17:05.443286] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-19T18:17:05.954871] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:17:06.061906] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-19T18:17:06.243286] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-19T18:17:06.616789] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T18:17:06.624857] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-09-19T18:17:06.624992] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-19T18:17:07.037264] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-19T18:17:07.037428] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-19T18:17:07.038480] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-19T18:17:07.038552] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-19T18:17:07.040292] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 54427 (keeping 200 days of data) [2025-09-19T18:17:07.043302] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-19T18:17:07.386776] [DEBUG] [LOCAL ] D: Primary data saved (54427 records). [2025-09-19T18:17:07.386926] [INFO ] [MAIN ] D: Full history saved. [2025-09-19T18:17:07.387024] [INFO ] [MAIN ] Update Progress: 583/2372 symbols completed. D took 29.8s. Estimated remaining: 3h 56m 27s. Rate: 7.6 symbols/min [2025-09-19T18:17:07.480382] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T18:17:07.576020] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:07.625451] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-09-19T18:17:07.625605] [INFO ] [MAIN ] DAN: Loaded 49394 existing records. [2025-09-19T18:17:07.801813] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:07.802078] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-19T18:17:07.802130] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-19T18:17:07.803658] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-19T18:17:07.803723] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-19T18:17:07.848473] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-19T18:17:08.202170] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:08.646227] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-19T18:17:08.648258] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T18:17:08.650474] [INFO ] [REMOTE ] DAC: Full fetch complete (20088 records). [2025-09-19T18:17:08.650549] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-19T18:17:09.054239] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-19T18:17:09.054332] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-19T18:17:09.054818] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-19T18:17:09.054882] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-19T18:17:09.055622] [DEBUG] [LOCAL ] DAC: Trimmed 20088 records to 12959 (keeping 200 days of data) [2025-09-19T18:17:09.142998] [DEBUG] [LOCAL ] DAC: Primary data saved (12959 records). [2025-09-19T18:17:09.143156] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-19T18:17:09.143242] [INFO ] [MAIN ] Update Progress: 584/2372 symbols completed. DAC took 26.3s. Estimated remaining: 3h 55m 60s. Rate: 7.6 symbols/min [2025-09-19T18:17:09.339069] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:09.377335] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T18:17:09.397057] [DEBUG] [LOCAL ] DAO: Loaded 21693 existing records from primary storage. [2025-09-19T18:17:09.397214] [INFO ] [MAIN ] DAO: Loaded 21693 existing records. [2025-09-19T18:17:09.453783] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-19T18:17:09.602810] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:09.603182] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-19T18:17:09.603261] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-19T18:17:09.603930] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-19T18:17:09.603999] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-19T18:17:09.990315] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:10.243280] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-19T18:17:10.645634] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:17:10.653103] [INFO ] [REMOTE ] CYH: Full fetch complete (70537 records). [2025-09-19T18:17:10.653267] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-19T18:17:11.049914] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-19T18:17:11.054750] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-19T18:17:11.054925] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-19T18:17:11.055910] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-19T18:17:11.056188] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-19T18:17:11.087353] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T18:17:11.097477] [DEBUG] [LOCAL ] CYH: Trimmed 70537 records to 48687 (keeping 200 days of data) [2025-09-19T18:17:11.210159] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T18:17:11.419842] [DEBUG] [LOCAL ] CYH: Primary data saved (48687 records). [2025-09-19T18:17:11.419992] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-19T18:17:11.420080] [INFO ] [MAIN ] Update Progress: 585/2372 symbols completed. CYH took 39.2s. Estimated remaining: 3h 55m 35s. Rate: 7.6 symbols/min [2025-09-19T18:17:11.588771] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:11.639889] [DEBUG] [LOCAL ] DAR: Loaded 52223 existing records from primary storage. [2025-09-19T18:17:11.640077] [INFO ] [MAIN ] DAR: Loaded 52223 existing records. [2025-09-19T18:17:11.817705] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:11.818066] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-19T18:17:11.818149] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-19T18:17:11.819496] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-19T18:17:11.819570] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-19T18:17:11.850325] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-19T18:17:12.175076] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:12.643252] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-19T18:17:12.664559] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-19T18:17:13.443266] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-19T18:17:13.811957] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-19T18:17:13.928957] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T18:17:14.243314] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-19T18:17:14.874066] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T18:17:15.043267] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-19T18:17:15.843252] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-19T18:17:16.189215] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T18:17:16.354475] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T18:17:16.643287] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-19T18:17:17.443274] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-19T18:17:18.243286] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-19T18:17:18.486833] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-19T18:17:18.530575] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T18:17:18.561900] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T18:17:19.043261] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-19T18:17:19.843281] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-19T18:17:20.219326] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:17:20.643276] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-19T18:17:20.848605] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:17:20.996462] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T18:17:21.443308] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-19T18:17:22.243259] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-19T18:17:22.686390] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:17:22.711901] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T18:17:23.043264] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-19T18:17:23.843255] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-19T18:17:24.149631] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:17:24.274331] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T18:17:24.643256] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-19T18:17:25.443264] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-19T18:17:25.757224] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T18:17:25.937676] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T18:17:26.243271] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-19T18:17:27.048340] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-19T18:17:27.067503] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T18:17:27.555721] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T18:17:27.843267] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-19T18:17:28.643264] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-19T18:17:29.113029] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:17:29.116631] [INFO ] [REMOTE ] DAO: Full fetch complete (32488 records). [2025-09-19T18:17:29.116762] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-19T18:17:29.447731] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-19T18:17:29.497380] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-19T18:17:29.497729] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-19T18:17:29.498341] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-19T18:17:29.498542] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-19T18:17:29.500418] [DEBUG] [LOCAL ] DAO: Trimmed 32488 records to 21932 (keeping 200 days of data) [2025-09-19T18:17:29.630315] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:17:29.675125] [DEBUG] [LOCAL ] DAO: Primary data saved (21932 records). [2025-09-19T18:17:29.675274] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-19T18:17:29.675366] [INFO ] [MAIN ] Update Progress: 586/2372 symbols completed. DAO took 20.5s. Estimated remaining: 3h 55m 58s. Rate: 7.6 symbols/min [2025-09-19T18:17:29.841504] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:29.880133] [DEBUG] [LOCAL ] DAVA: Loaded 40658 existing records from primary storage. [2025-09-19T18:17:29.880278] [INFO ] [MAIN ] DAVA: Loaded 40658 existing records. [2025-09-19T18:17:30.058978] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:30.059262] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-19T18:17:30.059338] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-19T18:17:30.060400] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-19T18:17:30.060465] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-19T18:17:30.271004] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-19T18:17:30.430456] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:30.714927] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T18:17:31.043248] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-19T18:17:31.557773] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T18:17:31.843266] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-19T18:17:32.590611] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T18:17:32.643227] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-19T18:17:32.802591] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T18:17:33.443274] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-19T18:17:33.690253] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T18:17:34.243280] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-19T18:17:34.901386] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T18:17:34.909260] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-19T18:17:34.909392] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-19T18:17:35.054360] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-19T18:17:35.317115] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-19T18:17:35.317320] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-19T18:17:35.318562] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-19T18:17:35.318684] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-19T18:17:35.352196] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T18:17:35.363130] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54533 (keeping 200 days of data) [2025-09-19T18:17:35.693261] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-09-19T18:17:35.693400] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-19T18:17:35.694871] [INFO ] [MAIN ] Update Progress: 587/2372 symbols completed. DAL took 39.3s. Estimated remaining: 3h 55m 45s. Rate: 7.6 symbols/min [2025-09-19T18:17:35.815404] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T18:17:35.848330] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-19T18:17:35.894820] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:35.943681] [DEBUG] [LOCAL ] DAY: Loaded 50388 existing records from primary storage. [2025-09-19T18:17:35.943860] [INFO ] [MAIN ] DAY: Loaded 50388 existing records. [2025-09-19T18:17:36.117744] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:36.117947] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-19T18:17:36.118081] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-19T18:17:36.119147] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-19T18:17:36.119208] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-19T18:17:36.473733] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:36.643233] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-19T18:17:37.178278] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T18:17:37.443293] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-19T18:17:37.776696] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T18:17:38.138966] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T18:17:38.243220] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-19T18:17:39.043254] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-19T18:17:39.496984] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T18:17:39.744162] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T18:17:39.843218] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-19T18:17:40.643348] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-19T18:17:41.065910] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T18:17:41.443281] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-19T18:17:41.879057] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T18:17:41.886969] [INFO ] [REMOTE ] DAN: Full fetch complete (70917 records). [2025-09-19T18:17:41.887208] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-19T18:17:42.248114] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-19T18:17:42.343678] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:17:42.358018] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-19T18:17:42.358377] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-19T18:17:42.359457] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-19T18:17:42.359564] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-19T18:17:42.361222] [DEBUG] [LOCAL ] DAN: Trimmed 70917 records to 49741 (keeping 200 days of data) [2025-09-19T18:17:42.670254] [DEBUG] [LOCAL ] DAN: Primary data saved (49741 records). [2025-09-19T18:17:42.670472] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-19T18:17:42.670628] [INFO ] [MAIN ] Update Progress: 588/2372 symbols completed. DAN took 35.3s. Estimated remaining: 3h 55m 34s. Rate: 7.6 symbols/min [2025-09-19T18:17:42.841101] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:42.841337] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-09-19T18:17:42.841392] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-09-19T18:17:42.841561] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-19T18:17:42.841604] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-19T18:17:42.841668] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-19T18:17:42.841740] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-19T18:17:43.055211] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-19T18:17:43.221108] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:43.240432] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T18:17:43.843279] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-19T18:17:44.307099] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T18:17:44.643288] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-19T18:17:45.339154] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T18:17:45.443225] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-19T18:17:45.569939] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:17:46.173988] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:17:46.183623] [INFO ] [REMOTE ] DAR: Full fetch complete (74547 records). [2025-09-19T18:17:46.183854] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-19T18:17:46.254007] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-19T18:17:46.618697] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-19T18:17:46.618818] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-19T18:17:46.619892] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-19T18:17:46.619975] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-19T18:17:46.622496] [DEBUG] [LOCAL ] DAR: Trimmed 74547 records to 52611 (keeping 200 days of data) [2025-09-19T18:17:46.947697] [DEBUG] [LOCAL ] DAR: Primary data saved (52611 records). [2025-09-19T18:17:46.947851] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-19T18:17:46.947994] [INFO ] [MAIN ] Update Progress: 589/2372 symbols completed. DAR took 35.5s. Estimated remaining: 3h 55m 15s. Rate: 7.6 symbols/min [2025-09-19T18:17:47.048340] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-19T18:17:47.136190] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:47.136408] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-19T18:17:47.136474] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-19T18:17:47.136708] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-19T18:17:47.136761] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-19T18:17:47.136807] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-19T18:17:47.136851] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-19T18:17:47.536404] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:47.569892] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T18:17:47.843272] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-19T18:17:48.253421] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:17:48.643301] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-19T18:17:49.291510] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T18:17:49.443290] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-19T18:17:50.137095] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-19T18:17:50.243341] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-19T18:17:50.459782] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:17:50.533565] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T18:17:51.043318] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-19T18:17:51.843301] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-19T18:17:52.070891] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T18:17:52.540898] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T18:17:52.643250] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-19T18:17:53.443303] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-19T18:17:53.746729] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T18:17:54.243279] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-19T18:17:54.601735] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:17:54.968714] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:17:54.992868] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T18:17:55.043292] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-19T18:17:55.843276] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-19T18:17:56.225746] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T18:17:56.643292] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-19T18:17:57.443271] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-19T18:17:57.601836] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T18:17:57.705247] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T18:17:58.243309] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-19T18:17:59.043293] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-19T18:17:59.544966] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T18:17:59.803280] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-19T18:17:59.836365] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T18:17:59.843381] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-19T18:18:00.643270] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-19T18:18:01.443289] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-19T18:18:02.243279] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-19T18:18:02.611309] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-19T18:18:03.043267] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-19T18:18:03.225311] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-19T18:18:03.683713] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T18:18:03.843296] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-19T18:18:04.643288] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-19T18:18:06.262357] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-19T18:18:06.268434] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-19T18:18:06.373328] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T18:18:06.380339] [INFO ] [REMOTE ] DAY: Full fetch complete (71789 records). [2025-09-19T18:18:06.380453] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-19T18:18:06.781844] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-19T18:18:06.782077] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-19T18:18:06.783041] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-19T18:18:06.783125] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-19T18:18:06.784790] [DEBUG] [LOCAL ] DAY: Trimmed 71789 records to 50756 (keeping 200 days of data) [2025-09-19T18:18:06.914109] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (4.67 seconds). [2025-09-19T18:18:06.924530] [INFO ] [REMOTE ] DAVA: Full fetch complete (55152 records). [2025-09-19T18:18:06.925222] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-19T18:18:07.339477] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (4.30 seconds). [2025-09-19T18:18:07.486020] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-19T18:18:07.471394] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-19T18:18:07.486146] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-19T18:18:07.488828] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-19T18:18:07.488937] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-19T18:18:07.558377] [DEBUG] [LOCAL ] DAVA: Trimmed 55152 records to 41022 (keeping 200 days of data) [2025-09-19T18:18:07.603635] [DEBUG] [LOCAL ] DAY: Primary data saved (50756 records). [2025-09-19T18:18:07.603845] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-19T18:18:07.603963] [INFO ] [MAIN ] Update Progress: 590/2372 symbols completed. DAY took 31.9s. Estimated remaining: 3h 55m 45s. Rate: 7.6 symbols/min [2025-09-19T18:18:07.940193] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:07.941004] [DEBUG] [LOCAL ] DBI: No existing data file found in primary storage. [2025-09-19T18:18:07.941753] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-09-19T18:18:07.943415] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-19T18:18:07.944682] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-19T18:18:07.946212] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-09-19T18:18:07.946588] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-19T18:18:08.045166] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T18:18:08.133209] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-19T18:18:08.482766] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:08.485966] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-19T18:18:08.498016] [DEBUG] [LOCAL ] DAVA: Primary data saved (41022 records). [2025-09-19T18:18:08.498146] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-19T18:18:08.498245] [INFO ] [MAIN ] Update Progress: 591/2372 symbols completed. DAVA took 38.8s. Estimated remaining: 3h 55m 16s. Rate: 7.6 symbols/min [2025-09-19T18:18:08.671236] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:08.684855] [DEBUG] [LOCAL ] DBL: Loaded 9122 existing records from primary storage. [2025-09-19T18:18:08.684990] [INFO ] [MAIN ] DBL: Loaded 9122 existing records. [2025-09-19T18:18:08.866548] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:08.866822] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-19T18:18:08.866874] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-19T18:18:08.867520] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-19T18:18:08.867580] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-19T18:18:09.235282] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:09.235637] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-19T18:18:09.584327] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T18:18:09.594912] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-19T18:18:09.723668] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T18:18:09.878023] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-19T18:18:10.015303] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T18:18:10.243331] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-19T18:18:10.388587] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T18:18:10.393089] [INFO ] [REMOTE ] DBD: Full fetch complete (30285 records). [2025-09-19T18:18:10.393311] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-19T18:18:10.394041] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:18:10.394149] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:18:10.394215] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:18:10.394286] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-19T18:18:10.394360] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-19T18:18:10.394413] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-19T18:18:10.394511] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-19T18:18:10.394616] [INFO ] [MAIN ] Update Progress: 592/2372 symbols completed. DBD took 23.4s. Estimated remaining: 3h 54m 50s. Rate: 7.6 symbols/min [2025-09-19T18:18:10.589295] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:10.646028] [DEBUG] [LOCAL ] DBRG: Loaded 50211 existing records from primary storage. [2025-09-19T18:18:10.646186] [INFO ] [MAIN ] DBRG: Loaded 50211 existing records. [2025-09-19T18:18:10.829610] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:10.829882] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-19T18:18:10.829931] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-19T18:18:10.831137] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-19T18:18:10.831200] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-19T18:18:11.048505] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-19T18:18:11.194261] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:18:11.227934] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:11.843273] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-19T18:18:12.431557] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T18:18:12.643263] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-19T18:18:13.443263] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-19T18:18:13.957909] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T18:18:14.243284] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-19T18:18:15.043246] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-19T18:18:15.808176] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (3.16 seconds). [2025-09-19T18:18:15.843227] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-19T18:18:16.241532] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-19T18:18:16.418964] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T18:18:16.440267] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T18:18:16.643262] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-19T18:18:17.421814] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T18:18:17.443285] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-19T18:18:18.065916] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T18:18:18.243262] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-19T18:18:19.043238] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-19T18:18:19.170929] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:18:19.675772] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-19T18:18:19.843264] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-19T18:18:20.106799] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T18:18:20.114735] [INFO ] [REMOTE ] DB: Full fetch complete (74046 records). [2025-09-19T18:18:20.114851] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-19T18:18:20.513226] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T18:18:20.513347] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-19T18:18:20.515367] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-19T18:18:20.516881] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-19T18:18:20.517260] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-19T18:18:20.518780] [DEBUG] [LOCAL ] DB: Trimmed 74046 records to 53423 (keeping 200 days of data) [2025-09-19T18:18:20.643636] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-19T18:18:20.847002] [DEBUG] [LOCAL ] DB: Primary data saved (53423 records). [2025-09-19T18:18:20.847146] [INFO ] [MAIN ] DB: Full history saved. [2025-09-19T18:18:20.847233] [INFO ] [MAIN ] Update Progress: 593/2372 symbols completed. DB took 38.2s. Estimated remaining: 3h 54m 50s. Rate: 7.6 symbols/min [2025-09-19T18:18:21.019320] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:21.056107] [DEBUG] [LOCAL ] DCI: Loaded 38012 existing records from primary storage. [2025-09-19T18:18:21.056262] [INFO ] [MAIN ] DCI: Loaded 38012 existing records. [2025-09-19T18:18:21.235448] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:21.235754] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-19T18:18:21.235811] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-19T18:18:21.236800] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-19T18:18:21.236860] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-19T18:18:21.448430] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-19T18:18:21.594305] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:22.229304] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T18:18:22.243211] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-19T18:18:22.605761] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:18:23.043272] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-19T18:18:23.467475] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T18:18:23.843310] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-19T18:18:24.643325] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-19T18:18:25.443316] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-19T18:18:25.675126] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-19T18:18:25.753079] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T18:18:26.000956] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:18:26.243271] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-19T18:18:27.043293] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-19T18:18:27.233085] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T18:18:27.234221] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T18:18:27.247433] [INFO ] [REMOTE ] DBL: Full fetch complete (12432 records). [2025-09-19T18:18:27.247556] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-19T18:18:27.701015] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-19T18:18:27.701100] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-19T18:18:27.701416] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-19T18:18:27.701456] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-19T18:18:27.702404] [DEBUG] [LOCAL ] DBL: Trimmed 12432 records to 9154 (keeping 200 days of data) [2025-09-19T18:18:27.764616] [DEBUG] [LOCAL ] DBL: Primary data saved (9154 records). [2025-09-19T18:18:27.764795] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-19T18:18:27.764888] [INFO ] [MAIN ] Update Progress: 594/2372 symbols completed. DBL took 19.3s. Estimated remaining: 3h 54m 39s. Rate: 7.6 symbols/min [2025-09-19T18:18:27.848446] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-19T18:18:27.974460] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:27.990356] [DEBUG] [LOCAL ] DCO: Loaded 13679 existing records from primary storage. [2025-09-19T18:18:27.990493] [INFO ] [MAIN ] DCO: Loaded 13679 existing records. [2025-09-19T18:18:28.198080] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:28.198524] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-19T18:18:28.198622] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-19T18:18:28.199358] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-19T18:18:28.199539] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-19T18:18:28.538900] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T18:18:28.652849] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-19T18:18:28.659690] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:29.443292] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-19T18:18:29.874818] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T18:18:30.243305] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-19T18:18:30.301968] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T18:18:30.729810] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T18:18:31.043269] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-19T18:18:31.843252] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-19T18:18:32.283028] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T18:18:32.428382] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T18:18:32.643281] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-19T18:18:33.127810] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T18:18:33.443267] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-19T18:18:34.182109] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:18:34.243259] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-19T18:18:35.043248] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-19T18:18:35.269692] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T18:18:35.595607] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T18:18:35.660692] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T18:18:35.843273] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-19T18:18:36.643329] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-19T18:18:36.886219] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T18:18:37.443261] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-19T18:18:38.243271] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-19T18:18:38.626298] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:18:39.043300] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-19T18:18:39.687136] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:18:39.725052] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T18:18:39.843254] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-19T18:18:40.643300] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-19T18:18:40.668870] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T18:18:41.375026] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:18:41.382470] [INFO ] [REMOTE ] DBRG: Full fetch complete (72203 records). [2025-09-19T18:18:41.382703] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-19T18:18:41.451272] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-19T18:18:41.789031] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-19T18:18:41.789145] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-19T18:18:41.789990] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-19T18:18:41.790054] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-19T18:18:41.791703] [DEBUG] [LOCAL ] DBRG: Trimmed 72203 records to 50570 (keeping 200 days of data) [2025-09-19T18:18:42.092890] [DEBUG] [LOCAL ] DBRG: Primary data saved (50570 records). [2025-09-19T18:18:42.093039] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-19T18:18:42.093141] [INFO ] [MAIN ] Update Progress: 595/2372 symbols completed. DBRG took 31.7s. Estimated remaining: 3h 54m 50s. Rate: 7.6 symbols/min [2025-09-19T18:18:42.257810] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-19T18:18:42.260316] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:42.335021] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:18:42.335997] [DEBUG] [LOCAL ] DD: Loaded 53183 existing records from primary storage. [2025-09-19T18:18:42.344694] [INFO ] [MAIN ] DD: Loaded 53183 existing records. [2025-09-19T18:18:42.523683] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:42.523944] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-19T18:18:42.524014] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-19T18:18:42.525151] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-19T18:18:42.525210] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-19T18:18:42.891694] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:42.916774] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T18:18:43.043270] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-19T18:18:43.408508] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T18:18:43.843264] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-19T18:18:44.484841] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T18:18:44.643238] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-19T18:18:44.945364] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T18:18:45.443264] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-19T18:18:46.085278] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T18:18:46.243267] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-19T18:18:46.583530] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:18:47.043302] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-19T18:18:47.843266] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-19T18:18:47.994674] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:18:48.643267] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-19T18:18:48.930676] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T18:18:48.937473] [INFO ] [REMOTE ] DBI: Full fetch complete (66612 records). [2025-09-19T18:18:48.937621] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-19T18:18:49.330605] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-19T18:18:49.330731] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-19T18:18:49.331493] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-19T18:18:49.331536] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-19T18:18:49.333122] [DEBUG] [LOCAL ] DBI: Trimmed 66612 records to 45867 (keeping 200 days of data) [2025-09-19T18:18:49.444502] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-19T18:18:49.599467] [DEBUG] [LOCAL ] DBI: Primary data saved (45867 records). [2025-09-19T18:18:49.599606] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-19T18:18:49.599714] [INFO ] [MAIN ] Update Progress: 596/2372 symbols completed. DBI took 42.0s. Estimated remaining: 3h 54m 41s. Rate: 7.6 symbols/min [2025-09-19T18:18:49.770255] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:49.824140] [DEBUG] [LOCAL ] DDD: Loaded 51205 existing records from primary storage. [2025-09-19T18:18:49.824288] [INFO ] [MAIN ] DDD: Loaded 51205 existing records. [2025-09-19T18:18:50.010337] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:50.010784] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-19T18:18:50.010853] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-19T18:18:50.015146] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-19T18:18:50.040551] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-19T18:18:50.118088] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T18:18:50.236029] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T18:18:50.245821] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-19T18:18:50.424957] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:50.469118] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T18:18:50.475383] [INFO ] [REMOTE ] DCI: Full fetch complete (54444 records). [2025-09-19T18:18:50.475500] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-19T18:18:50.882389] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-19T18:18:50.882517] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-19T18:18:50.883289] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-19T18:18:50.883359] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-19T18:18:50.884539] [DEBUG] [LOCAL ] DCI: Trimmed 54444 records to 38302 (keeping 200 days of data) [2025-09-19T18:18:51.056958] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-19T18:18:51.123906] [DEBUG] [LOCAL ] DCI: Primary data saved (38302 records). [2025-09-19T18:18:51.124056] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-19T18:18:51.124144] [INFO ] [MAIN ] Update Progress: 597/2372 symbols completed. DCI took 30.3s. Estimated remaining: 3h 54m 14s. Rate: 7.6 symbols/min [2025-09-19T18:18:51.843265] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-19T18:18:52.328091] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T18:18:52.520815] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:18:52.643237] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-19T18:18:53.344491] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T18:18:53.443231] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-19T18:18:53.544545] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T18:18:54.243269] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-19T18:18:55.053264] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-19T18:18:55.074138] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T18:18:55.843243] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-19T18:18:56.353208] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T18:18:56.640297] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T18:18:56.650977] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-19T18:18:57.443309] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-19T18:18:57.840598] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T18:18:57.922291] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:18:57.925321] [INFO ] [REMOTE ] DCO: Full fetch complete (19677 records). [2025-09-19T18:18:57.925418] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-19T18:18:58.248072] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-19T18:18:58.292505] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-19T18:18:58.292603] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-19T18:18:58.293065] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-19T18:18:58.293118] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-19T18:18:58.293706] [DEBUG] [LOCAL ] DCO: Trimmed 19677 records to 13827 (keeping 200 days of data) [2025-09-19T18:18:58.379032] [DEBUG] [LOCAL ] DCO: Primary data saved (13827 records). [2025-09-19T18:18:58.379157] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-19T18:18:58.379241] [INFO ] [MAIN ] Update Progress: 598/2372 symbols completed. DCO took 30.6s. Estimated remaining: 3h 54m 4s. Rate: 7.6 symbols/min [2025-09-19T18:18:59.490637] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T18:18:59.502268] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-19T18:18:59.849158] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T18:18:59.859972] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-19T18:19:01.659622] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T18:19:01.675862] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-19T18:19:01.727997] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T18:19:01.739717] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-19T18:19:03.853227] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T18:19:03.871434] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-19T18:19:03.994513] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-19T18:19:04.009302] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-19T18:19:05.981993] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:19:05.994136] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-19T18:19:06.137792] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T18:19:06.148260] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-19T18:19:07.659461] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T18:19:07.667318] [INFO ] [REMOTE ] DD: Full fetch complete (76239 records). [2025-09-19T18:19:07.667458] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-19T18:19:08.075168] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-19T18:19:08.075444] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-19T18:19:08.076455] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-19T18:19:08.076575] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-19T18:19:08.078923] [DEBUG] [LOCAL ] DD: Trimmed 76239 records to 53571 (keeping 200 days of data) [2025-09-19T18:19:08.111172] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:19:08.211475] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-19T18:19:08.463380] [DEBUG] [LOCAL ] DD: Primary data saved (53571 records). [2025-09-19T18:19:08.463539] [INFO ] [MAIN ] DD: Full history saved. [2025-09-19T18:19:08.463679] [INFO ] [MAIN ] Update Progress: 599/2372 symbols completed. DD took 26.4s. Estimated remaining: 3h 54m 3s. Rate: 7.6 symbols/min [2025-09-19T18:19:10.267051] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T18:19:10.278169] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-19T18:19:12.382320] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T18:19:12.389997] [INFO ] [REMOTE ] DDD: Full fetch complete (73680 records). [2025-09-19T18:19:12.390131] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-19T18:19:12.780798] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-19T18:19:12.780884] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-19T18:19:12.781789] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-19T18:19:12.781857] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-19T18:19:12.783496] [DEBUG] [LOCAL ] DDD: Trimmed 73680 records to 51576 (keeping 200 days of data) [2025-09-19T18:19:13.081954] [DEBUG] [LOCAL ] DDD: Primary data saved (51576 records). [2025-09-19T18:19:13.082189] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-19T18:19:13.083516] [INFO ] [MAIN ] Update Progress: 600/2372 symbols completed. DDD took 23.5s. Estimated remaining: 3h 53m 45s. Rate: 7.6 symbols/min [2025-09-19T18:19:13.735387] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:13.721232] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:13.799432] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:13.780253] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:13.807952] [DEBUG] [LOCAL ] DDT: Loaded 2096 existing records from primary storage. [2025-09-19T18:19:13.808099] [INFO ] [MAIN ] DDT: Loaded 2096 existing records. [2025-09-19T18:19:13.988706] [DEBUG] [LOCAL ] DDS: Loaded 13611 existing records from primary storage. [2025-09-19T18:19:14.001189] [INFO ] [MAIN ] DDS: Loaded 13611 existing records. [2025-09-19T18:19:14.044253] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:14.056026] [DEBUG] [LOCAL ] DDL: Loaded 36628 existing records from primary storage. [2025-09-19T18:19:14.085079] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-19T18:19:14.079734] [INFO ] [MAIN ] DDL: Loaded 36628 existing records. [2025-09-19T18:19:14.090520] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-19T18:19:14.173578] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-19T18:19:14.196697] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-19T18:19:14.287599] [DEBUG] [LOCAL ] DE: Loaded 48145 existing records from primary storage. [2025-09-19T18:19:14.342686] [INFO ] [MAIN ] DE: Loaded 48145 existing records. [2025-09-19T18:19:14.555151] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:14.631298] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-19T18:19:14.712429] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-19T18:19:14.728906] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-19T18:19:14.725742] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:14.749058] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-19T18:19:14.782923] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-19T18:19:14.826345] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-19T18:19:14.890413] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-19T18:19:14.948327] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-19T18:19:15.078922] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:15.134445] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-19T18:19:15.155500] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-19T18:19:15.254232] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-19T18:19:15.274976] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-19T18:19:15.389740] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:15.441623] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-19T18:19:15.978900] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:15.992487] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-19T18:19:15.991969] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:16.026350] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-19T18:19:16.175347] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:16.175735] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-19T18:19:16.928729] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T18:19:16.930025] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-19T18:19:17.286113] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-19T18:19:17.287321] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-19T18:19:17.333505] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T18:19:17.337129] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-19T18:19:17.845056] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T18:19:17.853933] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-19T18:19:17.880203] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-19T18:19:17.881442] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-19T18:19:18.073421] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T18:19:18.083602] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-19T18:19:18.092097] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T18:19:18.095406] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-19T18:19:18.442315] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T18:19:18.443509] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-19T18:19:18.822859] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T18:19:18.826000] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-19T18:19:18.875608] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T18:19:18.882734] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-19T18:19:19.086839] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T18:19:19.088424] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-19T18:19:19.690938] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T18:19:19.692165] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-19T18:19:19.740510] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T18:19:19.760944] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T18:19:19.843234] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-19T18:19:20.263716] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T18:19:20.504961] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T18:19:20.643266] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-19T18:19:21.427133] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T18:19:21.443232] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-19T18:19:21.746823] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T18:19:22.243294] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-19T18:19:22.699820] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-19T18:19:23.043287] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-19T18:19:23.587450] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T18:19:23.843263] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-19T18:19:24.481774] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:19:24.643262] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-19T18:19:25.443266] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-19T18:19:25.882123] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-19T18:19:26.186353] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T18:19:26.243255] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-19T18:19:26.279484] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T18:19:27.043257] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-19T18:19:27.843274] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-19T18:19:28.363845] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T18:19:28.524238] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T18:19:28.643241] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-19T18:19:29.245120] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T18:19:29.443275] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-19T18:19:29.815755] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T18:19:30.243254] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-19T18:19:30.727914] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T18:19:31.043252] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-19T18:19:31.470548] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:19:31.843277] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-19T18:19:32.089846] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T18:19:32.643345] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-19T18:19:33.174845] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:19:33.183499] [INFO ] [REMOTE ] DDL: Full fetch complete (53379 records). [2025-09-19T18:19:33.183682] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-19T18:19:33.450892] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-19T18:19:33.570196] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-19T18:19:33.570285] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-19T18:19:33.570982] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-19T18:19:33.571051] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-19T18:19:33.572325] [DEBUG] [LOCAL ] DDL: Trimmed 53379 records to 36967 (keeping 200 days of data) [2025-09-19T18:19:33.782725] [DEBUG] [LOCAL ] DDL: Primary data saved (36967 records). [2025-09-19T18:19:33.783000] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-19T18:19:33.783120] [INFO ] [MAIN ] Update Progress: 601/2372 symbols completed. DDL took 20.7s. Estimated remaining: 3h 54m 15s. Rate: 7.6 symbols/min [2025-09-19T18:19:33.966951] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:34.007386] [DEBUG] [LOCAL ] DEA: Loaded 42080 existing records from primary storage. [2025-09-19T18:19:34.007535] [INFO ] [MAIN ] DEA: Loaded 42080 existing records. [2025-09-19T18:19:34.181358] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:19:34.192626] [INFO ] [REMOTE ] DDT: Full fetch complete (2900 records). [2025-09-19T18:19:34.196724] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-19T18:19:34.196613] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:34.230402] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-19T18:19:34.230497] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-19T18:19:34.254223] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-19T18:19:34.263260] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-19T18:19:34.269776] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-19T18:19:34.952270] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-19T18:19:34.985553] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:34.982216] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-19T18:19:34.986149] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-19T18:19:34.986613] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-19T18:19:34.987455] [DEBUG] [LOCAL ] DDT: Trimmed 2900 records to 2112 (keeping 200 days of data) [2025-09-19T18:19:35.002499] [DEBUG] [LOCAL ] DDT: Primary data saved (2112 records). [2025-09-19T18:19:35.002774] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-19T18:19:35.002947] [INFO ] [MAIN ] Update Progress: 602/2372 symbols completed. DDT took 21.9s. Estimated remaining: 3h 53m 47s. Rate: 7.6 symbols/min [2025-09-19T18:19:35.050416] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-19T18:19:35.218584] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:35.219664] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-09-19T18:19:35.221437] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-09-19T18:19:35.221341] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-19T18:19:35.221768] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-19T18:19:35.231710] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-19T18:19:35.232001] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-09-19T18:19:35.232055] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-19T18:19:35.552621] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T18:19:35.631182] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:35.843264] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-19T18:19:36.643310] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-19T18:19:36.971960] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T18:19:37.291346] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T18:19:37.359941] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T18:19:37.443292] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-19T18:19:38.243270] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-19T18:19:39.043250] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-19T18:19:39.617463] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T18:19:39.634738] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:19:39.637141] [INFO ] [REMOTE ] DDS: Full fetch complete (19299 records). [2025-09-19T18:19:39.637227] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-19T18:19:39.855743] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-19T18:19:40.015905] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-19T18:19:40.015984] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-19T18:19:40.016403] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-19T18:19:40.016442] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-19T18:19:40.017055] [DEBUG] [LOCAL ] DDS: Trimmed 19299 records to 13658 (keeping 200 days of data) [2025-09-19T18:19:40.108178] [DEBUG] [LOCAL ] DDS: Primary data saved (13658 records). [2025-09-19T18:19:40.108339] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-19T18:19:40.108505] [INFO ] [MAIN ] Update Progress: 603/2372 symbols completed. DDS took 27.0s. Estimated remaining: 3h 53m 31s. Rate: 7.6 symbols/min [2025-09-19T18:19:40.277829] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:40.336346] [DEBUG] [LOCAL ] DECK: Loaded 53698 existing records from primary storage. [2025-09-19T18:19:40.336554] [INFO ] [MAIN ] DECK: Loaded 53698 existing records. [2025-09-19T18:19:40.530962] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:40.531381] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-19T18:19:40.531494] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-19T18:19:40.542402] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-19T18:19:40.544215] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-19T18:19:40.594069] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T18:19:40.652749] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-19T18:19:40.939940] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:41.443304] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-19T18:19:41.505315] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T18:19:42.243312] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-19T18:19:42.535428] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T18:19:43.043256] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-19T18:19:43.651227] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T18:19:43.799996] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:19:43.807323] [INFO ] [REMOTE ] DE: Full fetch complete (69620 records). [2025-09-19T18:19:43.807460] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-19T18:19:43.855562] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-19T18:19:44.249153] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-19T18:19:44.249266] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-19T18:19:44.250104] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-19T18:19:44.250273] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-19T18:19:44.268580] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T18:19:44.275164] [DEBUG] [LOCAL ] DE: Trimmed 69620 records to 48509 (keeping 200 days of data) [2025-09-19T18:19:44.607527] [DEBUG] [LOCAL ] DE: Primary data saved (48509 records). [2025-09-19T18:19:44.607735] [INFO ] [MAIN ] DE: Full history saved. [2025-09-19T18:19:44.607870] [INFO ] [MAIN ] Update Progress: 604/2372 symbols completed. DE took 31.5s. Estimated remaining: 3h 53m 13s. Rate: 7.6 symbols/min [2025-09-19T18:19:44.651238] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-19T18:19:44.786670] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:44.835316] [DEBUG] [LOCAL ] DEI: Loaded 48891 existing records from primary storage. [2025-09-19T18:19:44.835478] [INFO ] [MAIN ] DEI: Loaded 48891 existing records. [2025-09-19T18:19:45.013537] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:45.013876] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-19T18:19:45.013931] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-19T18:19:45.015260] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-19T18:19:45.015322] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-19T18:19:45.380554] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:45.409223] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T18:19:45.443210] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-19T18:19:46.243279] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-19T18:19:46.707730] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T18:19:47.043324] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-19T18:19:47.360009] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T18:19:47.843269] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-19T18:19:48.143909] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:19:48.427177] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:19:48.643265] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-19T18:19:49.269853] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T18:19:49.443294] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-19T18:19:50.243271] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-19T18:19:50.398115] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T18:19:50.576777] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:19:51.043254] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-19T18:19:51.843281] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-19T18:19:52.066045] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:19:52.213218] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T18:19:52.643269] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-19T18:19:53.443272] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-19T18:19:53.594876] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T18:19:53.686199] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T18:19:54.243279] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-19T18:19:54.892046] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T18:19:55.043254] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-19T18:19:55.762425] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T18:19:55.843265] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-19T18:19:56.472835] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T18:19:56.643396] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-19T18:19:57.443401] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-19T18:19:57.748947] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:19:58.243352] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-19T18:19:58.633852] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:19:58.775556] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T18:19:59.043291] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-19T18:19:59.460182] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T18:19:59.843314] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-19T18:20:00.643389] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-19T18:20:01.305358] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T18:20:01.312141] [INFO ] [REMOTE ] DEC: Full fetch complete (42907 records). [2025-09-19T18:20:01.312357] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-19T18:20:01.448523] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-19T18:20:01.750865] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-19T18:20:01.751018] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-19T18:20:01.751883] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-19T18:20:01.752013] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-19T18:20:01.754066] [DEBUG] [LOCAL ] DEC: Trimmed 42907 records to 31645 (keeping 200 days of data) [2025-09-19T18:20:01.993549] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-09-19T18:20:02.029854] [DEBUG] [LOCAL ] DEC: Primary data saved (31645 records). [2025-09-19T18:20:02.030037] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-19T18:20:02.030159] [INFO ] [MAIN ] Update Progress: 605/2372 symbols completed. DEC took 27.0s. Estimated remaining: 3h 53m 33s. Rate: 7.6 symbols/min [2025-09-19T18:20:02.214466] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:02.247592] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-19T18:20:02.272632] [DEBUG] [LOCAL ] DELL: Loaded 54126 existing records from primary storage. [2025-09-19T18:20:02.272829] [INFO ] [MAIN ] DELL: Loaded 54126 existing records. [2025-09-19T18:20:02.461591] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:02.462428] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-19T18:20:02.462538] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-19T18:20:02.464379] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-19T18:20:02.464478] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-19T18:20:02.646071] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:20:02.990048] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:03.026975] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T18:20:03.043302] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-19T18:20:03.843332] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-19T18:20:04.643391] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-19T18:20:04.848236] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-19T18:20:05.102741] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:20:05.109672] [INFO ] [REMOTE ] DEA: Full fetch complete (63191 records). [2025-09-19T18:20:05.109790] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-19T18:20:05.448420] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-19T18:20:05.521256] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-19T18:20:05.521340] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-19T18:20:05.522247] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-19T18:20:05.522315] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-19T18:20:05.526683] [DEBUG] [LOCAL ] DEA: Trimmed 63191 records to 42365 (keeping 200 days of data) [2025-09-19T18:20:05.791012] [DEBUG] [LOCAL ] DEA: Primary data saved (42365 records). [2025-09-19T18:20:05.791144] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-19T18:20:05.791279] [INFO ] [MAIN ] Update Progress: 606/2372 symbols completed. DEA took 32.0s. Estimated remaining: 3h 53m 13s. Rate: 7.6 symbols/min [2025-09-19T18:20:05.971457] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:06.023004] [DEBUG] [LOCAL ] DEO: Loaded 49348 existing records from primary storage. [2025-09-19T18:20:06.023166] [INFO ] [MAIN ] DEO: Loaded 49348 existing records. [2025-09-19T18:20:06.204816] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:06.205145] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-19T18:20:06.205202] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-19T18:20:06.206545] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-19T18:20:06.206607] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-19T18:20:06.523464] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T18:20:06.550092] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-19T18:20:06.619558] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:06.824663] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.98 seconds). [2025-09-19T18:20:07.043247] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-19T18:20:07.843270] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-19T18:20:08.362954] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.91 seconds). [2025-09-19T18:20:08.643245] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-19T18:20:09.062325] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-19T18:20:09.234124] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:20:09.443295] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-19T18:20:10.251691] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-19T18:20:10.259670] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T18:20:11.043363] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-19T18:20:11.082128] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-19T18:20:11.536844] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T18:20:11.843258] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-19T18:20:12.099188] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T18:20:12.558842] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T18:20:12.643228] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-19T18:20:13.443281] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-19T18:20:14.243272] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-19T18:20:14.378593] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-19T18:20:14.620806] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T18:20:14.666581] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T18:20:15.043255] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-19T18:20:15.843310] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-19T18:20:16.131205] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T18:20:16.643274] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-19T18:20:17.282133] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T18:20:17.443284] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-19T18:20:18.243318] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-19T18:20:18.907675] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-09-19T18:20:18.915192] [INFO ] [REMOTE ] DEI: Full fetch complete (69509 records). [2025-09-19T18:20:18.915368] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-19T18:20:19.359736] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-19T18:20:19.360224] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-19T18:20:19.361155] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-19T18:20:19.361247] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-19T18:20:19.363637] [DEBUG] [LOCAL ] DEI: Trimmed 69509 records to 49247 (keeping 200 days of data) [2025-09-19T18:20:19.677994] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-09-19T18:20:19.680407] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T18:20:19.706995] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-19T18:20:19.777307] [DEBUG] [LOCAL ] DEI: Primary data saved (49247 records). [2025-09-19T18:20:19.777523] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-19T18:20:19.779110] [INFO ] [MAIN ] Update Progress: 607/2372 symbols completed. DEI took 35.2s. Estimated remaining: 3h 53m 22s. Rate: 7.6 symbols/min [2025-09-19T18:20:19.849269] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-19T18:20:19.959972] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:19.982565] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T18:20:19.990617] [INFO ] [REMOTE ] DECK: Full fetch complete (76577 records). [2025-09-19T18:20:19.990821] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-19T18:20:20.200846] [DEBUG] [LOCAL ] DFH: Loaded 33349 existing records from primary storage. [2025-09-19T18:20:20.251268] [INFO ] [MAIN ] DFH: Loaded 33349 existing records. [2025-09-19T18:20:20.599964] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-19T18:20:20.604366] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-19T18:20:20.605270] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-19T18:20:20.605477] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-19T18:20:20.605417] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:20.605795] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-19T18:20:20.605844] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-19T18:20:20.606812] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-19T18:20:20.606876] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-19T18:20:20.638344] [DEBUG] [LOCAL ] DECK: Trimmed 76577 records to 54084 (keeping 200 days of data) [2025-09-19T18:20:21.097000] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:21.097811] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-19T18:20:21.302479] [DEBUG] [LOCAL ] DECK: Primary data saved (54084 records). [2025-09-19T18:20:21.302638] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-19T18:20:21.302794] [INFO ] [MAIN ] Update Progress: 608/2372 symbols completed. DECK took 41.2s. Estimated remaining: 3h 52m 56s. Rate: 7.6 symbols/min [2025-09-19T18:20:21.480359] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:21.506258] [DEBUG] [LOCAL ] DFIN: Loaded 23738 existing records from primary storage. [2025-09-19T18:20:21.506438] [INFO ] [MAIN ] DFIN: Loaded 23738 existing records. [2025-09-19T18:20:21.718660] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T18:20:21.723107] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:21.732980] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-19T18:20:21.733216] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-19T18:20:21.733780] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-19T18:20:21.734825] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-19T18:20:21.734897] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-19T18:20:22.124156] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:22.206513] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T18:20:22.243229] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-19T18:20:23.043285] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-19T18:20:23.251610] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T18:20:23.785272] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:20:23.843265] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-19T18:20:23.984039] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:20:24.643282] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-19T18:20:24.817333] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-19T18:20:25.443300] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-19T18:20:25.645774] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T18:20:25.746226] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T18:20:26.243272] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-19T18:20:27.043250] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-19T18:20:27.848331] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-19T18:20:27.860685] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T18:20:28.069437] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-19T18:20:28.094053] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T18:20:28.643261] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-19T18:20:29.443253] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-19T18:20:29.718687] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T18:20:30.243261] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-19T18:20:30.318977] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T18:20:31.043286] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-19T18:20:31.796987] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:20:31.804447] [INFO ] [REMOTE ] DEO: Full fetch complete (71116 records). [2025-09-19T18:20:31.804610] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-19T18:20:31.805472] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:20:31.805609] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:20:31.805735] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:20:31.805829] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-19T18:20:31.805912] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-09-19T18:20:31.805950] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-09-19T18:20:31.806415] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-09-19T18:20:31.806518] [INFO ] [MAIN ] Update Progress: 609/2372 symbols completed. DEO took 26.0s. Estimated remaining: 3h 52m 55s. Rate: 7.6 symbols/min [2025-09-19T18:20:31.850726] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-19T18:20:31.996279] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:32.036042] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-19T18:20:32.053621] [DEBUG] [LOCAL ] DFP: Loaded 11867 existing records from primary storage. [2025-09-19T18:20:32.053775] [INFO ] [MAIN ] DFP: Loaded 11867 existing records. [2025-09-19T18:20:32.230937] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:32.231192] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-19T18:20:32.231249] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-19T18:20:32.231669] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-19T18:20:32.231743] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-19T18:20:32.584745] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:32.643221] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-19T18:20:32.717967] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T18:20:32.899526] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T18:20:33.443296] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-19T18:20:33.706886] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T18:20:34.243316] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-19T18:20:35.043276] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-19T18:20:35.330181] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T18:20:35.843275] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-19T18:20:36.504482] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T18:20:36.515154] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-09-19T18:20:36.515318] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-19T18:20:36.648375] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-19T18:20:36.945755] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-19T18:20:36.945864] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-19T18:20:36.946759] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-19T18:20:36.946841] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-19T18:20:36.948814] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T18:20:36.959492] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54515 (keeping 200 days of data) [2025-09-19T18:20:37.316992] [DEBUG] [LOCAL ] DELL: Primary data saved (54515 records). [2025-09-19T18:20:37.317167] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-19T18:20:37.317268] [INFO ] [MAIN ] Update Progress: 610/2372 symbols completed. DELL took 35.3s. Estimated remaining: 3h 52m 40s. Rate: 7.6 symbols/min [2025-09-19T18:20:37.448333] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-19T18:20:37.506505] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:37.518426] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T18:20:37.578559] [DEBUG] [LOCAL ] DG: Loaded 53697 existing records from primary storage. [2025-09-19T18:20:37.578729] [INFO ] [MAIN ] DG: Loaded 53697 existing records. [2025-09-19T18:20:37.743584] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T18:20:37.776254] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:37.776459] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-19T18:20:37.776506] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-19T18:20:37.777824] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-19T18:20:37.777885] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-19T18:20:38.132516] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:38.243240] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-19T18:20:39.043317] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-19T18:20:39.202730] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T18:20:39.843290] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-19T18:20:40.030408] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T18:20:40.380430] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T18:20:40.643225] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-19T18:20:41.168346] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T18:20:41.443250] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-19T18:20:41.483442] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T18:20:42.243269] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-19T18:20:43.043281] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-19T18:20:43.609139] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T18:20:43.848347] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-19T18:20:43.860264] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T18:20:44.382570] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T18:20:44.643251] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-19T18:20:45.012577] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T18:20:45.443375] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-19T18:20:45.610919] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:20:46.243318] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-19T18:20:46.600023] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T18:20:47.043283] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-19T18:20:47.327735] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T18:20:47.843269] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-19T18:20:47.972979] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T18:20:47.977927] [INFO ] [REMOTE ] DFH: Full fetch complete (49224 records). [2025-09-19T18:20:47.978091] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-19T18:20:48.360317] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-19T18:20:48.360429] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-19T18:20:48.361166] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-19T18:20:48.361233] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-19T18:20:48.362381] [DEBUG] [LOCAL ] DFH: Trimmed 49224 records to 33560 (keeping 200 days of data) [2025-09-19T18:20:48.572892] [DEBUG] [LOCAL ] DFH: Primary data saved (33560 records). [2025-09-19T18:20:48.573075] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-19T18:20:48.573177] [INFO ] [MAIN ] Update Progress: 611/2372 symbols completed. DFH took 28.8s. Estimated remaining: 3h 52m 42s. Rate: 7.6 symbols/min [2025-09-19T18:20:48.648438] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-19T18:20:48.768609] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:48.824083] [DEBUG] [LOCAL ] DGX: Loaded 45793 existing records from primary storage. [2025-09-19T18:20:48.824259] [INFO ] [MAIN ] DGX: Loaded 45793 existing records. [2025-09-19T18:20:48.999949] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:49.000217] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-19T18:20:49.000280] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-19T18:20:49.001763] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-19T18:20:49.001850] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-19T18:20:49.378330] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:49.443229] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-19T18:20:49.843296] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T18:20:50.243323] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-19T18:20:50.342721] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:20:50.608198] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T18:20:51.043346] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-19T18:20:51.843260] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-19T18:20:52.113406] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T18:20:52.383632] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T18:20:52.387349] [INFO ] [REMOTE ] DFIN: Full fetch complete (33281 records). [2025-09-19T18:20:52.387449] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-19T18:20:52.655245] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-19T18:20:52.804014] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-19T18:20:52.804101] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-19T18:20:52.804717] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-19T18:20:52.804780] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-19T18:20:52.805789] [DEBUG] [LOCAL ] DFIN: Trimmed 33281 records to 23906 (keeping 200 days of data) [2025-09-19T18:20:52.944488] [DEBUG] [LOCAL ] DFIN: Primary data saved (23906 records). [2025-09-19T18:20:52.944627] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-19T18:20:52.944749] [INFO ] [MAIN ] Update Progress: 612/2372 symbols completed. DFIN took 31.6s. Estimated remaining: 3h 52m 24s. Rate: 7.6 symbols/min [2025-09-19T18:20:53.123153] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:53.123393] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-09-19T18:20:53.123449] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-09-19T18:20:53.123605] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-19T18:20:53.123675] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-19T18:20:53.123741] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-19T18:20:53.123776] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-19T18:20:53.453730] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-19T18:20:53.497902] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:53.527424] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T18:20:53.627439] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:20:54.243312] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-19T18:20:55.043237] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-19T18:20:55.415152] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T18:20:55.843229] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-19T18:20:55.968425] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-19T18:20:56.643299] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-19T18:20:56.930393] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T18:20:56.947684] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T18:20:57.443297] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-19T18:20:58.243287] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-19T18:20:58.532789] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T18:20:58.828244] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:20:59.043262] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-19T18:20:59.635000] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:20:59.843253] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-19T18:21:00.308819] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T18:21:00.643274] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-19T18:21:01.443298] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-19T18:21:02.243285] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-19T18:21:02.626939] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-19T18:21:03.043258] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-19T18:21:04.145587] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (3.50 seconds). [2025-09-19T18:21:04.157247] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-19T18:21:04.413220] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-19T18:21:04.415849] [INFO ] [REMOTE ] DFP: Full fetch complete (16220 records). [2025-09-19T18:21:04.415958] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-19T18:21:04.803697] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-19T18:21:04.803823] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-19T18:21:04.804189] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-19T18:21:04.804231] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-19T18:21:04.804789] [DEBUG] [LOCAL ] DFP: Trimmed 16220 records to 11926 (keeping 200 days of data) [2025-09-19T18:21:04.874843] [DEBUG] [LOCAL ] DFP: Primary data saved (11926 records). [2025-09-19T18:21:04.874985] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-19T18:21:04.875072] [INFO ] [MAIN ] Update Progress: 613/2372 symbols completed. DFP took 33.1s. Estimated remaining: 3h 52m 28s. Rate: 7.6 symbols/min [2025-09-19T18:21:05.050223] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:05.110914] [DEBUG] [LOCAL ] DHI: Loaded 53765 existing records from primary storage. [2025-09-19T18:21:05.111067] [INFO ] [MAIN ] DHI: Loaded 53765 existing records. [2025-09-19T18:21:05.299158] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:05.299455] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-19T18:21:05.299509] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-19T18:21:05.300838] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-19T18:21:05.300898] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-19T18:21:05.668879] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:05.669233] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-19T18:21:05.846469] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (3.60 seconds). [2025-09-19T18:21:05.853699] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-19T18:21:06.006008] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-09-19T18:21:06.243299] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-19T18:21:06.843888] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-19T18:21:06.883687] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T18:21:07.043275] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-19T18:21:07.522280] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T18:21:07.582287] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T18:21:07.843265] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-19T18:21:08.643294] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-19T18:21:09.443260] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-19T18:21:09.577183] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-19T18:21:09.618700] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T18:21:10.107169] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T18:21:10.243307] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-19T18:21:11.043282] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-19T18:21:11.317542] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T18:21:11.843278] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-19T18:21:11.926883] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T18:21:12.643288] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-19T18:21:12.967717] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T18:21:12.975449] [INFO ] [REMOTE ] DG: Full fetch complete (77238 records). [2025-09-19T18:21:12.975579] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-19T18:21:13.362317] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-19T18:21:13.362403] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-19T18:21:13.363275] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-19T18:21:13.363360] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-19T18:21:13.364888] [DEBUG] [LOCAL ] DG: Trimmed 77238 records to 54085 (keeping 200 days of data) [2025-09-19T18:21:13.455347] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-19T18:21:13.704573] [DEBUG] [LOCAL ] DG: Primary data saved (54085 records). [2025-09-19T18:21:13.704805] [INFO ] [MAIN ] DG: Full history saved. [2025-09-19T18:21:13.704916] [INFO ] [MAIN ] Update Progress: 614/2372 symbols completed. DG took 36.4s. Estimated remaining: 3h 52m 22s. Rate: 7.6 symbols/min [2025-09-19T18:21:13.876617] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:13.888977] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T18:21:13.959699] [DEBUG] [LOCAL ] DHR: Loaded 53757 existing records from primary storage. [2025-09-19T18:21:13.960093] [INFO ] [MAIN ] DHR: Loaded 53757 existing records. [2025-09-19T18:21:14.162853] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:14.163358] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-19T18:21:14.163421] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-19T18:21:14.172098] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-19T18:21:14.187277] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-19T18:21:14.221258] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T18:21:14.254298] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-19T18:21:14.591548] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:15.043252] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-19T18:21:15.843273] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-19T18:21:16.711535] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (3.26 seconds). [2025-09-19T18:21:16.724245] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-19T18:21:16.832304] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T18:21:16.839149] [INFO ] [REMOTE ] DGX: Full fetch complete (65125 records). [2025-09-19T18:21:16.839330] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-19T18:21:17.056563] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-19T18:21:17.270199] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-19T18:21:17.270280] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-19T18:21:17.271048] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-19T18:21:17.271111] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-19T18:21:17.272500] [DEBUG] [LOCAL ] DGX: Trimmed 65125 records to 46056 (keeping 200 days of data) [2025-09-19T18:21:17.461196] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-19T18:21:17.574152] [DEBUG] [LOCAL ] DGX: Primary data saved (46056 records). [2025-09-19T18:21:17.574328] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-19T18:21:17.575196] [INFO ] [MAIN ] Update Progress: 615/2372 symbols completed. DGX took 29.0s. Estimated remaining: 3h 52m 3s. Rate: 7.6 symbols/min [2025-09-19T18:21:17.747310] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:17.798337] [DEBUG] [LOCAL ] DHT: Loaded 48423 existing records from primary storage. [2025-09-19T18:21:17.798486] [INFO ] [MAIN ] DHT: Loaded 48423 existing records. [2025-09-19T18:21:17.975341] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:17.975708] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-19T18:21:17.975765] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-19T18:21:17.977260] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-19T18:21:17.977322] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-19T18:21:18.352817] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:18.353284] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-19T18:21:18.390042] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-19T18:21:18.860201] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:21:19.043248] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-19T18:21:19.395559] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T18:21:19.823554] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T18:21:19.843224] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-19T18:21:20.643261] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-19T18:21:20.987101] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:21:21.412461] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T18:21:21.443234] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-19T18:21:22.104135] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:21:22.243253] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-19T18:21:23.043254] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-19T18:21:23.541395] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T18:21:23.843263] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-19T18:21:24.432236] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T18:21:24.643265] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-19T18:21:24.765671] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T18:21:24.768618] [INFO ] [REMOTE ] DHF: Full fetch complete (29472 records). [2025-09-19T18:21:24.768724] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-19T18:21:24.769274] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:21:24.769356] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:21:24.769398] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:21:24.769436] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-19T18:21:24.769517] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-19T18:21:24.769574] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-09-19T18:21:24.769632] [DEBUG] [LOCAL ] DHF: No derivative data file found to delete. [2025-09-19T18:21:24.769740] [INFO ] [MAIN ] Update Progress: 616/2372 symbols completed. DHF took 31.8s. Estimated remaining: 3h 51m 53s. Rate: 7.6 symbols/min [2025-09-19T18:21:24.952857] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:24.967291] [DEBUG] [LOCAL ] DHX: Loaded 13327 existing records from primary storage. [2025-09-19T18:21:24.967413] [INFO ] [MAIN ] DHX: Loaded 13327 existing records. [2025-09-19T18:21:25.141325] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:25.141596] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-19T18:21:25.141676] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-19T18:21:25.142123] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-19T18:21:25.142182] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-19T18:21:25.456877] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-19T18:21:25.500377] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:25.941474] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T18:21:26.249189] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-19T18:21:26.255880] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T18:21:27.043230] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-19T18:21:27.404320] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T18:21:27.451321] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T18:21:27.843291] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-19T18:21:28.643296] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-19T18:21:29.167003] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T18:21:29.443288] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-19T18:21:29.621185] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:21:30.243287] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-19T18:21:30.731506] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T18:21:31.043243] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-19T18:21:31.496090] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T18:21:31.843265] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-19T18:21:31.951669] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T18:21:32.643242] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-19T18:21:33.423091] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T18:21:33.444258] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-19T18:21:33.446519] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T18:21:34.126418] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-19T18:21:34.243298] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-19T18:21:35.046592] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-19T18:21:35.052424] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T18:21:35.843277] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-19T18:21:35.884749] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T18:21:36.643288] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-19T18:21:37.419829] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:21:37.443266] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-19T18:21:37.811127] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:21:38.213821] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-19T18:21:38.243282] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-19T18:21:39.043250] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-19T18:21:39.315045] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T18:21:39.843271] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-19T18:21:40.439987] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T18:21:40.460429] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T18:21:40.643270] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-19T18:21:41.443268] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-19T18:21:41.845355] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:21:41.852933] [INFO ] [REMOTE ] DHI: Full fetch complete (76819 records). [2025-09-19T18:21:41.853101] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-19T18:21:41.854069] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:21:41.854165] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:21:41.854214] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:21:41.854263] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-19T18:21:41.854355] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-19T18:21:41.854413] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-09-19T18:21:41.854780] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-09-19T18:21:41.854922] [INFO ] [MAIN ] Update Progress: 617/2372 symbols completed. DHI took 37.0s. Estimated remaining: 3h 52m 11s. Rate: 7.6 symbols/min [2025-09-19T18:21:42.036937] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:42.052616] [DEBUG] [LOCAL ] DIAX: Loaded 12421 existing records from primary storage. [2025-09-19T18:21:42.052782] [INFO ] [MAIN ] DIAX: Loaded 12421 existing records. [2025-09-19T18:21:42.230391] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:42.230922] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-19T18:21:42.230978] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-19T18:21:42.231437] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-19T18:21:42.231496] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-19T18:21:42.263489] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-19T18:21:42.604463] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:42.936802] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-19T18:21:42.947029] [INFO ] [REMOTE ] DHR: Full fetch complete (77274 records). [2025-09-19T18:21:42.947207] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-19T18:21:43.054212] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-19T18:21:43.366974] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-19T18:21:43.367078] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-19T18:21:43.368110] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-19T18:21:43.368278] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-19T18:21:43.389455] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T18:21:43.395918] [DEBUG] [LOCAL ] DHR: Trimmed 77274 records to 54147 (keeping 200 days of data) [2025-09-19T18:21:43.397466] [INFO ] [REMOTE ] DHT: Full fetch complete (69817 records). [2025-09-19T18:21:43.397639] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-19T18:21:43.398492] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:21:43.462074] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:21:43.462174] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:21:43.462612] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-19T18:21:43.489349] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-19T18:21:43.492686] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-19T18:21:43.497605] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-09-19T18:21:43.499173] [INFO ] [MAIN ] Update Progress: 618/2372 symbols completed. DHT took 25.9s. Estimated remaining: 3h 51m 45s. Rate: 7.6 symbols/min [2025-09-19T18:21:43.653986] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:21:43.715387] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:43.716904] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-09-19T18:21:43.716976] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-09-19T18:21:43.718743] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-19T18:21:43.719038] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-19T18:21:43.719890] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-09-19T18:21:43.720693] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-19T18:21:43.848187] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-19T18:21:44.157946] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T18:21:44.284474] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:44.470513] [DEBUG] [LOCAL ] DHR: Primary data saved (54147 records). [2025-09-19T18:21:44.470778] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-19T18:21:44.470917] [INFO ] [MAIN ] Update Progress: 619/2372 symbols completed. DHR took 30.8s. Estimated remaining: 3h 51m 17s. Rate: 7.6 symbols/min [2025-09-19T18:21:44.648504] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-19T18:21:44.765446] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:44.846885] [DEBUG] [LOCAL ] DINO: Loaded 53364 existing records from primary storage. [2025-09-19T18:21:44.847116] [INFO ] [MAIN ] DINO: Loaded 53364 existing records. [2025-09-19T18:21:45.137913] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:45.138463] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-19T18:21:45.138561] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-19T18:21:45.145980] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-19T18:21:45.155167] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T18:21:45.154432] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-19T18:21:45.448450] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-19T18:21:45.623067] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:46.243322] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-19T18:21:46.637102] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T18:21:46.792184] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T18:21:47.043263] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-19T18:21:47.715898] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T18:21:47.843257] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-19T18:21:48.422695] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T18:21:48.643268] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-19T18:21:48.883508] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T18:21:49.443310] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-19T18:21:50.243329] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-19T18:21:50.687343] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T18:21:50.712963] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T18:21:51.043253] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-19T18:21:51.462103] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:21:51.843298] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-19T18:21:52.568931] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T18:21:52.643300] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-19T18:21:53.086122] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T18:21:53.443282] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-19T18:21:53.658788] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T18:21:54.243319] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-19T18:21:54.453203] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T18:21:55.043258] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-19T18:21:55.843267] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-19T18:21:56.138670] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:21:56.538150] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T18:21:56.643258] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-19T18:21:56.721427] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T18:21:57.443326] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-19T18:21:58.243289] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-19T18:21:58.471376] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T18:21:58.912154] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T18:21:58.975553] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:21:58.979111] [INFO ] [REMOTE ] DHX: Full fetch complete (20833 records). [2025-09-19T18:21:58.979247] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-19T18:21:58.980019] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:21:58.980135] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:21:58.980358] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:21:58.980449] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-19T18:21:58.980539] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-19T18:21:58.980587] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-09-19T18:21:58.981021] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-09-19T18:21:58.981146] [INFO ] [MAIN ] Update Progress: 620/2372 symbols completed. DHX took 34.2s. Estimated remaining: 3h 51m 28s. Rate: 7.6 symbols/min [2025-09-19T18:21:59.048511] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-19T18:21:59.186116] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:59.247724] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-09-19T18:21:59.247874] [INFO ] [MAIN ] DIS: Loaded 54178 existing records. [2025-09-19T18:21:59.438119] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:59.438371] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-19T18:21:59.438427] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-19T18:21:59.440111] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-19T18:21:59.440180] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-19T18:21:59.804215] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:59.843228] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-19T18:22:00.643244] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-19T18:22:01.323443] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T18:22:01.396802] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T18:22:01.443229] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-19T18:22:02.243315] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-19T18:22:02.321285] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-19T18:22:02.835982] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T18:22:03.043255] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-19T18:22:03.843285] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-19T18:22:04.037750] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:22:04.135812] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:22:04.643314] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-19T18:22:05.443273] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-19T18:22:05.660475] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T18:22:05.731771] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:22:05.734128] [INFO ] [REMOTE ] DIAX: Full fetch complete (16987 records). [2025-09-19T18:22:05.734218] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-19T18:22:05.734667] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:22:05.734777] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:22:05.734851] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:22:05.734948] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-19T18:22:05.735033] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-19T18:22:05.735071] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-19T18:22:05.735467] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-09-19T18:22:05.735576] [INFO ] [MAIN ] Update Progress: 621/2372 symbols completed. DIAX took 23.9s. Estimated remaining: 3h 51m 17s. Rate: 7.6 symbols/min [2025-09-19T18:22:05.909746] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:05.909932] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-19T18:22:05.910028] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-19T18:22:05.910219] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-19T18:22:05.910273] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-19T18:22:05.910358] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-19T18:22:05.910399] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-19T18:22:06.248699] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-19T18:22:06.270934] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:07.043284] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-19T18:22:07.843315] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-19T18:22:07.965771] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T18:22:08.315270] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-19T18:22:08.503792] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-09-19T18:22:08.643263] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-19T18:22:09.069729] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:22:09.174393] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-19T18:22:09.443268] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-19T18:22:10.243266] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-19T18:22:11.002030] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T18:22:11.043241] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-19T18:22:11.048436] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T18:22:11.843268] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-19T18:22:12.643277] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-19T18:22:13.232186] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T18:22:13.387327] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-19T18:22:13.443270] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-19T18:22:14.040028] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T18:22:14.243247] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-19T18:22:14.771500] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T18:22:14.866800] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-19T18:22:15.043268] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-19T18:22:15.843266] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-19T18:22:16.643239] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-19T18:22:17.156632] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-19T18:22:17.181220] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T18:22:17.191101] [INFO ] [REMOTE ] DINO: Full fetch complete (76641 records). [2025-09-19T18:22:17.191327] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-19T18:22:17.409053] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:22:17.443247] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-19T18:22:17.662243] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-19T18:22:17.662350] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-19T18:22:17.663714] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-19T18:22:17.663801] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-19T18:22:17.665679] [DEBUG] [LOCAL ] DINO: Trimmed 76641 records to 53743 (keeping 200 days of data) [2025-09-19T18:22:17.902580] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-19T18:22:18.014937] [DEBUG] [LOCAL ] DINO: Primary data saved (53743 records). [2025-09-19T18:22:18.015112] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-19T18:22:18.015275] [INFO ] [MAIN ] Update Progress: 622/2372 symbols completed. DINO took 33.5s. Estimated remaining: 3h 51m 21s. Rate: 7.6 symbols/min [2025-09-19T18:22:18.195150] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:18.248507] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-19T18:22:18.253258] [DEBUG] [LOCAL ] DK: Loaded 49841 existing records from primary storage. [2025-09-19T18:22:18.253617] [INFO ] [MAIN ] DK: Loaded 49841 existing records. [2025-09-19T18:22:18.452625] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:18.453010] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-19T18:22:18.453074] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-19T18:22:18.454177] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-19T18:22:18.454256] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-19T18:22:18.814798] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:19.043265] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-19T18:22:19.843273] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-19T18:22:20.027691] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T18:22:20.036384] [INFO ] [REMOTE ] DIN: Full fetch complete (55071 records). [2025-09-19T18:22:20.036606] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-19T18:22:20.449980] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-19T18:22:20.450076] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-19T18:22:20.450830] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-19T18:22:20.450929] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-19T18:22:20.452886] [DEBUG] [LOCAL ] DIN: Trimmed 55071 records to 38019 (keeping 200 days of data) [2025-09-19T18:22:20.662726] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-19T18:22:20.696248] [DEBUG] [LOCAL ] DIN: Primary data saved (38019 records). [2025-09-19T18:22:20.696405] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-19T18:22:20.696548] [INFO ] [MAIN ] Update Progress: 623/2372 symbols completed. DIN took 37.2s. Estimated remaining: 3h 50m 58s. Rate: 7.6 symbols/min [2025-09-19T18:22:20.871351] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:20.892420] [DEBUG] [LOCAL ] DKL: Loaded 19651 existing records from primary storage. [2025-09-19T18:22:20.892570] [INFO ] [MAIN ] DKL: Loaded 19651 existing records. [2025-09-19T18:22:21.076323] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:21.080591] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-19T18:22:21.082284] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-19T18:22:21.082368] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-19T18:22:21.083811] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-19T18:22:21.083889] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-19T18:22:21.378771] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T18:22:21.454189] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-19T18:22:21.496881] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:22.243279] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-19T18:22:22.462722] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-19T18:22:23.043276] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-19T18:22:23.251160] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T18:22:23.342117] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T18:22:23.843288] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-19T18:22:24.643297] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-19T18:22:25.091795] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-19T18:22:25.439873] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T18:22:25.450725] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-19T18:22:25.867441] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T18:22:26.186211] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T18:22:26.243263] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-19T18:22:27.043275] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-19T18:22:27.843272] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-19T18:22:28.143472] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:22:28.346005] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-19T18:22:28.347203] [INFO ] [REMOTE ] DIVY: Full fetch complete (1718 records). [2025-09-19T18:22:28.347278] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-19T18:22:28.523616] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T18:22:28.523851] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:22:28.523940] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:22:28.524034] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-19T18:22:28.524115] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-19T18:22:28.524164] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-19T18:22:28.524231] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-19T18:22:28.524315] [INFO ] [MAIN ] Update Progress: 624/2372 symbols completed. DIVY took 22.8s. Estimated remaining: 3h 50m 50s. Rate: 7.6 symbols/min [2025-09-19T18:22:28.648336] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-19T18:22:28.695513] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:28.774527] [DEBUG] [LOCAL ] DKS: Loaded 50351 existing records from primary storage. [2025-09-19T18:22:28.774698] [INFO ] [MAIN ] DKS: Loaded 50351 existing records. [2025-09-19T18:22:28.949962] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:28.950230] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-19T18:22:28.950286] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-19T18:22:28.951524] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-19T18:22:28.951598] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-19T18:22:29.327251] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:29.443282] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-19T18:22:29.841190] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-19T18:22:30.189299] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T18:22:30.243240] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-19T18:22:31.043281] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-19T18:22:31.096538] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:22:31.125056] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T18:22:31.843278] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-19T18:22:32.643268] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-19T18:22:32.945939] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T18:22:33.443311] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-19T18:22:33.495722] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-19T18:22:34.243298] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-19T18:22:34.433394] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T18:22:34.457813] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T18:22:35.043268] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-19T18:22:35.843332] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-19T18:22:36.643311] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-19T18:22:36.927621] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-19T18:22:37.122613] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:22:37.443325] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-19T18:22:37.796978] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:22:37.869949] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T18:22:38.243301] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-19T18:22:39.043306] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-19T18:22:39.444809] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:22:39.843256] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-19T18:22:40.035547] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-19T18:22:40.643279] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-19T18:22:40.864193] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T18:22:41.443303] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-19T18:22:41.714777] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:22:41.774672] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T18:22:42.243309] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-19T18:22:43.043290] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-19T18:22:43.500722] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T18:22:43.843280] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-19T18:22:44.257134] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T18:22:44.643298] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-19T18:22:45.067101] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T18:22:45.071714] [INFO ] [REMOTE ] DKL: Full fetch complete (29596 records). [2025-09-19T18:22:45.071860] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-19T18:22:45.448453] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-19T18:22:45.539374] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-19T18:22:45.539525] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-19T18:22:45.540358] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-19T18:22:45.540433] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-19T18:22:45.541887] [DEBUG] [LOCAL ] DKL: Trimmed 29596 records to 19705 (keeping 200 days of data) [2025-09-19T18:22:45.673336] [DEBUG] [LOCAL ] DKL: Primary data saved (19705 records). [2025-09-19T18:22:45.673804] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-19T18:22:45.673932] [INFO ] [MAIN ] Update Progress: 625/2372 symbols completed. DKL took 25.0s. Estimated remaining: 3h 51m 8s. Rate: 7.6 symbols/min [2025-09-19T18:22:45.869578] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-19T18:22:45.872714] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:45.882052] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-19T18:22:45.882252] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-19T18:22:46.152209] [DEBUG] [LOCAL ] DLB: Loaded 32524 existing records from primary storage. [2025-09-19T18:22:46.191853] [INFO ] [MAIN ] DLB: Loaded 32524 existing records. [2025-09-19T18:22:46.575695] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-19T18:22:46.575969] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-19T18:22:46.575584] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:46.577041] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-19T18:22:46.577286] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-19T18:22:46.579044] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-19T18:22:46.579202] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-19T18:22:46.579451] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 54568 (keeping 200 days of data) [2025-09-19T18:22:46.580838] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-19T18:22:46.580914] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-19T18:22:46.900216] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T18:22:46.957531] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-19T18:22:47.135853] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:47.136820] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-19T18:22:47.381538] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-09-19T18:22:47.381726] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-19T18:22:47.381846] [INFO ] [MAIN ] Update Progress: 626/2372 symbols completed. DIS took 48.4s. Estimated remaining: 3h 50m 43s. Rate: 7.6 symbols/min [2025-09-19T18:22:47.553114] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:47.561822] [DEBUG] [LOCAL ] DLNG: Loaded 6345 existing records from primary storage. [2025-09-19T18:22:47.561956] [INFO ] [MAIN ] DLNG: Loaded 6345 existing records. [2025-09-19T18:22:47.742793] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:47.743153] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-19T18:22:47.743217] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-19T18:22:47.743601] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-19T18:22:47.743690] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-19T18:22:48.053700] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-19T18:22:48.082382] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-19T18:22:48.151135] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:48.643304] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-19T18:22:48.827622] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:22:48.953388] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:22:48.963326] [INFO ] [REMOTE ] DK: Full fetch complete (70577 records). [2025-09-19T18:22:48.963495] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-19T18:22:49.360403] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-19T18:22:49.360547] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-19T18:22:49.361449] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-19T18:22:49.361534] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-19T18:22:49.363210] [DEBUG] [LOCAL ] DK: Trimmed 70577 records to 50194 (keeping 200 days of data) [2025-09-19T18:22:49.462754] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-19T18:22:49.634230] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T18:22:49.699520] [DEBUG] [LOCAL ] DK: Primary data saved (50194 records). [2025-09-19T18:22:49.699739] [INFO ] [MAIN ] DK: Full history saved. [2025-09-19T18:22:49.699868] [INFO ] [MAIN ] Update Progress: 627/2372 symbols completed. DK took 31.7s. Estimated remaining: 3h 50m 19s. Rate: 7.6 symbols/min [2025-09-19T18:22:49.884032] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:49.884295] [DEBUG] [LOCAL ] DLR: No existing data file found in primary storage. [2025-09-19T18:22:49.884351] [WARN ] [MAIN ] DLR: No existing data found, performing full refresh instead. [2025-09-19T18:22:49.884771] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-19T18:22:49.884942] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-19T18:22:49.885014] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-19T18:22:49.885051] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-19T18:22:50.008176] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T18:22:50.252933] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-19T18:22:50.295735] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:50.707954] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T18:22:51.043331] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-19T18:22:51.843300] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-19T18:22:52.316447] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T18:22:52.643330] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-19T18:22:52.645300] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:22:53.443275] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-19T18:22:53.563351] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T18:22:54.243325] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-19T18:22:54.721471] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T18:22:55.043408] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-19T18:22:55.439976] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T18:22:55.546747] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T18:22:55.843306] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-19T18:22:56.643310] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-19T18:22:57.168637] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T18:22:57.443275] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-19T18:22:57.467744] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:22:57.848265] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:22:58.243403] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-19T18:22:59.043309] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-19T18:22:59.352744] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T18:22:59.360724] [INFO ] [REMOTE ] DKS: Full fetch complete (71622 records). [2025-09-19T18:22:59.360904] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-19T18:22:59.774932] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T18:22:59.801871] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-19T18:22:59.802000] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-19T18:22:59.802957] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-19T18:22:59.803069] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-19T18:22:59.804960] [DEBUG] [LOCAL ] DKS: Trimmed 71622 records to 50730 (keeping 200 days of data) [2025-09-19T18:22:59.877717] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-19T18:23:00.161811] [DEBUG] [LOCAL ] DKS: Primary data saved (50730 records). [2025-09-19T18:23:00.162159] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-19T18:23:00.162328] [INFO ] [MAIN ] Update Progress: 628/2372 symbols completed. DKS took 31.6s. Estimated remaining: 3h 50m 18s. Rate: 7.6 symbols/min [2025-09-19T18:23:00.336964] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:00.370097] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T18:23:00.411128] [DEBUG] [LOCAL ] DLX: Loaded 29538 existing records from primary storage. [2025-09-19T18:23:00.411285] [INFO ] [MAIN ] DLX: Loaded 29538 existing records. [2025-09-19T18:23:00.529181] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-19T18:23:00.616463] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:23:00.616840] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-19T18:23:00.616915] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-19T18:23:00.617717] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-19T18:23:00.617777] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-19T18:23:00.648451] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-19T18:23:00.999630] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:01.443330] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-19T18:23:01.672070] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T18:23:02.243335] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-19T18:23:03.043329] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-19T18:23:03.843275] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-19T18:23:04.083292] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T18:23:04.139761] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:23:04.643297] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-19T18:23:04.874341] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T18:23:05.443290] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-19T18:23:05.686400] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T18:23:05.960808] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (4.52 seconds). [2025-09-19T18:23:06.243267] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-19T18:23:06.573753] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T18:23:07.043270] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-19T18:23:07.799575] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T18:23:07.843330] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-19T18:23:08.284072] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:23:08.599205] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T18:23:08.643301] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-19T18:23:09.443301] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-19T18:23:10.041367] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T18:23:10.222869] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T18:23:10.243258] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-19T18:23:11.043304] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-19T18:23:11.777427] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T18:23:11.843281] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-19T18:23:11.886422] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T18:23:11.887860] [INFO ] [REMOTE ] DLNG: Full fetch complete (12104 records). [2025-09-19T18:23:11.887937] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-19T18:23:12.271068] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-19T18:23:12.271172] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-19T18:23:12.271440] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-19T18:23:12.271481] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-19T18:23:12.272056] [DEBUG] [LOCAL ] DLNG: Trimmed 12104 records to 6395 (keeping 200 days of data) [2025-09-19T18:23:12.308594] [DEBUG] [LOCAL ] DLNG: Primary data saved (6395 records). [2025-09-19T18:23:12.308726] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-19T18:23:12.308819] [INFO ] [MAIN ] Update Progress: 629/2372 symbols completed. DLNG took 24.9s. Estimated remaining: 3h 50m 22s. Rate: 7.6 symbols/min [2025-09-19T18:23:12.476758] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:12.476950] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-09-19T18:23:12.476989] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-09-19T18:23:12.477152] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-19T18:23:12.477195] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-19T18:23:12.477279] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-09-19T18:23:12.477331] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-19T18:23:12.648790] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-19T18:23:12.835639] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:13.443263] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-19T18:23:13.945393] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:23:13.972962] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T18:23:13.978724] [INFO ] [REMOTE ] DLB: Full fetch complete (47043 records). [2025-09-19T18:23:13.978880] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-19T18:23:14.255007] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-19T18:23:14.430717] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-19T18:23:14.430816] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-19T18:23:14.431553] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-19T18:23:14.431597] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-19T18:23:14.432717] [DEBUG] [LOCAL ] DLB: Trimmed 47043 records to 32772 (keeping 200 days of data) [2025-09-19T18:23:14.648843] [DEBUG] [LOCAL ] DLB: Primary data saved (32772 records). [2025-09-19T18:23:14.649027] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-19T18:23:14.649796] [INFO ] [MAIN ] Update Progress: 630/2372 symbols completed. DLB took 29.0s. Estimated remaining: 3h 49m 59s. Rate: 7.6 symbols/min [2025-09-19T18:23:14.818243] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:14.818456] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-09-19T18:23:14.818510] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-09-19T18:23:14.818683] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-19T18:23:14.818737] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-19T18:23:14.818780] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-09-19T18:23:14.818812] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-19T18:23:15.049419] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-19T18:23:15.210455] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:15.231210] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T18:23:15.823120] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T18:23:15.843258] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-19T18:23:16.184568] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T18:23:16.643307] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-19T18:23:17.437177] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T18:23:17.436921] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:23:17.443508] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-19T18:23:18.198699] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T18:23:18.243311] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-19T18:23:19.043283] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-19T18:23:19.770877] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T18:23:19.843261] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-19T18:23:20.624580] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T18:23:20.643222] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-19T18:23:21.443269] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-19T18:23:21.861713] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:23:21.989622] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T18:23:21.997690] [INFO ] [REMOTE ] DLR: Full fetch complete (74267 records). [2025-09-19T18:23:21.997870] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-19T18:23:22.239868] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T18:23:22.253638] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-19T18:23:22.417780] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-19T18:23:22.417863] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-19T18:23:22.419749] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-19T18:23:22.419815] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-19T18:23:22.421266] [DEBUG] [LOCAL ] DLR: Trimmed 74267 records to 51987 (keeping 200 days of data) [2025-09-19T18:23:22.749139] [DEBUG] [LOCAL ] DLR: Primary data saved (51987 records). [2025-09-19T18:23:22.749274] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-19T18:23:22.749360] [INFO ] [MAIN ] Update Progress: 631/2372 symbols completed. DLR took 33.0s. Estimated remaining: 3h 49m 51s. Rate: 7.6 symbols/min [2025-09-19T18:23:22.919468] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:22.930742] [DEBUG] [LOCAL ] DMB: Loaded 10199 existing records from primary storage. [2025-09-19T18:23:22.930878] [INFO ] [MAIN ] DMB: Loaded 10199 existing records. [2025-09-19T18:23:23.048440] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-19T18:23:23.120007] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:23:23.120272] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-19T18:23:23.120328] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-19T18:23:23.120811] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-19T18:23:23.120872] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-19T18:23:23.474585] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:23.763766] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T18:23:23.848152] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-19T18:23:23.849162] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T18:23:24.643258] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-19T18:23:24.921982] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T18:23:25.443299] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-19T18:23:25.894352] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T18:23:26.158920] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-19T18:23:26.243294] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-19T18:23:27.043281] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-19T18:23:27.193669] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T18:23:27.843250] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-19T18:23:28.291684] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T18:23:28.643266] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-19T18:23:28.836868] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T18:23:29.443275] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-19T18:23:30.082689] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T18:23:30.244997] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T18:23:30.243709] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-19T18:23:30.939780] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T18:23:31.043296] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-19T18:23:31.843268] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-19T18:23:32.171191] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:23:32.643244] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-19T18:23:32.747832] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T18:23:33.367067] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T18:23:33.443270] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-19T18:23:34.243253] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-19T18:23:34.564719] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T18:23:34.808901] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T18:23:35.043266] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-19T18:23:35.843268] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-19T18:23:35.897996] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T18:23:35.899501] [INFO ] [REMOTE ] DMA: Full fetch complete (6497 records). [2025-09-19T18:23:35.899589] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-19T18:23:36.279101] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-19T18:23:36.279183] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-19T18:23:36.279392] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-19T18:23:36.279457] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-19T18:23:36.280679] [DEBUG] [LOCAL ] DMA: Trimmed 6497 records to 4603 (keeping 200 days of data) [2025-09-19T18:23:36.308688] [DEBUG] [LOCAL ] DMA: Primary data saved (4603 records). [2025-09-19T18:23:36.308855] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-19T18:23:36.308947] [INFO ] [MAIN ] Update Progress: 632/2372 symbols completed. DMA took 21.7s. Estimated remaining: 3h 49m 59s. Rate: 7.6 symbols/min [2025-09-19T18:23:36.482472] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:36.482665] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-09-19T18:23:36.482725] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-09-19T18:23:36.482904] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-19T18:23:36.482950] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-19T18:23:36.482994] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-19T18:23:36.483028] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-19T18:23:36.644425] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-19T18:23:36.702824] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:23:36.865552] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:37.443274] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-19T18:23:38.243350] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-19T18:23:38.418497] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T18:23:38.513446] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T18:23:38.878628] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T18:23:39.043263] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-19T18:23:39.843272] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-19T18:23:40.063901] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:23:40.643312] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-19T18:23:41.163979] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T18:23:41.443322] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-19T18:23:41.638124] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T18:23:42.130809] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T18:23:42.243298] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-19T18:23:43.043306] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-19T18:23:43.843277] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-19T18:23:43.988538] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:23:44.002616] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T18:23:44.643284] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-19T18:23:44.736484] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T18:23:45.443278] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-19T18:23:46.028145] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T18:23:46.032752] [INFO ] [REMOTE ] DLX: Full fetch complete (41219 records). [2025-09-19T18:23:46.032853] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-19T18:23:46.250395] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-19T18:23:46.442116] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-19T18:23:46.442205] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-19T18:23:46.442818] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-19T18:23:46.442895] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-19T18:23:46.451817] [DEBUG] [LOCAL ] DLX: Trimmed 41219 records to 29746 (keeping 200 days of data) [2025-09-19T18:23:46.452979] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T18:23:46.642304] [DEBUG] [LOCAL ] DLX: Primary data saved (29746 records). [2025-09-19T18:23:46.642466] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-19T18:23:46.642600] [INFO ] [MAIN ] Update Progress: 633/2372 symbols completed. DLX took 46.5s. Estimated remaining: 3h 49m 58s. Rate: 7.6 symbols/min [2025-09-19T18:23:46.813494] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:46.813747] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-09-19T18:23:46.813803] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-09-19T18:23:46.813951] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-19T18:23:46.813993] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-19T18:23:46.814038] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-09-19T18:23:46.814068] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-19T18:23:47.051390] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-19T18:23:47.179419] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:47.580033] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T18:23:47.843264] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-19T18:23:48.442950] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:23:48.445430] [INFO ] [REMOTE ] DMB: Full fetch complete (15060 records). [2025-09-19T18:23:48.445504] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-19T18:23:48.648362] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-19T18:23:48.816782] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-19T18:23:48.816862] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-19T18:23:48.817273] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-19T18:23:48.817320] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-19T18:23:48.817876] [DEBUG] [LOCAL ] DMB: Trimmed 15060 records to 10260 (keeping 200 days of data) [2025-09-19T18:23:48.881213] [DEBUG] [LOCAL ] DMB: Primary data saved (10260 records). [2025-09-19T18:23:48.881377] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-19T18:23:48.881471] [INFO ] [MAIN ] Update Progress: 634/2372 symbols completed. DMB took 26.1s. Estimated remaining: 3h 49m 34s. Rate: 7.6 symbols/min [2025-09-19T18:23:49.057845] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:49.093213] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T18:23:49.117553] [DEBUG] [LOCAL ] DNOW: Loaded 43837 existing records from primary storage. [2025-09-19T18:23:49.117742] [INFO ] [MAIN ] DNOW: Loaded 43837 existing records. [2025-09-19T18:23:49.323891] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:23:49.324238] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-19T18:23:49.324307] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-19T18:23:49.325433] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-19T18:23:49.325498] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-19T18:23:49.448548] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-19T18:23:49.745061] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T18:23:49.777861] [INFO ] [REMOTE ] DLY: Full fetch complete (28182 records). [2025-09-19T18:23:49.800386] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-19T18:23:50.086005] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:50.250095] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-19T18:23:50.413216] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-19T18:23:50.413296] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-19T18:23:50.413998] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-19T18:23:50.414059] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-19T18:23:50.414990] [DEBUG] [LOCAL ] DLY: Trimmed 28182 records to 19696 (keeping 200 days of data) [2025-09-19T18:23:50.538850] [DEBUG] [LOCAL ] DLY: Primary data saved (19696 records). [2025-09-19T18:23:50.538990] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-19T18:23:50.539065] [INFO ] [MAIN ] Update Progress: 635/2372 symbols completed. DLY took 38.2s. Estimated remaining: 3h 49m 9s. Rate: 7.6 symbols/min [2025-09-19T18:23:50.708208] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:50.743623] [DEBUG] [LOCAL ] DNP: Loaded 33722 existing records from primary storage. [2025-09-19T18:23:50.743841] [INFO ] [MAIN ] DNP: Loaded 33722 existing records. [2025-09-19T18:23:50.922486] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:23:50.922743] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-19T18:23:50.922804] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-19T18:23:50.923892] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-19T18:23:50.923952] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-19T18:23:51.048413] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-19T18:23:51.292791] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:51.606767] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:23:51.843273] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-19T18:23:51.929555] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:23:52.361238] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:23:52.643234] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-19T18:23:53.443307] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-19T18:23:53.634392] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T18:23:53.794753] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T18:23:54.243310] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-19T18:23:54.452871] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:23:55.043283] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-19T18:23:55.843277] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-19T18:23:55.902849] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T18:23:56.643263] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-19T18:23:56.758704] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T18:23:57.448377] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-19T18:23:57.465922] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T18:23:57.621869] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T18:23:58.243266] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-19T18:23:59.044054] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-19T18:23:59.048993] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T18:23:59.156909] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T18:23:59.843268] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-19T18:24:00.018172] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:24:00.643282] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-19T18:24:01.443293] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-19T18:24:02.243327] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-19T18:24:02.970704] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (3.13 seconds). [2025-09-19T18:24:03.043327] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-19T18:24:03.601794] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T18:24:03.689847] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (3.05 seconds). [2025-09-19T18:24:03.843325] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-19T18:24:04.643318] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-19T18:24:04.876965] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-19T18:24:05.229168] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T18:24:05.443264] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-19T18:24:05.731759] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T18:24:06.243263] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-19T18:24:06.635122] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T18:24:06.764763] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T18:24:07.043305] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-19T18:24:07.761887] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T18:24:07.769770] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:24:07.777731] [INFO ] [REMOTE ] DMO: Full fetch complete (14409 records). [2025-09-19T18:24:07.778098] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-19T18:24:07.778911] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:24:07.778998] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:24:07.779041] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:24:07.779080] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-19T18:24:07.779137] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-19T18:24:07.779179] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-09-19T18:24:07.779239] [DEBUG] [LOCAL ] DMO: No derivative data file found to delete. [2025-09-19T18:24:07.779317] [INFO ] [MAIN ] Update Progress: 636/2372 symbols completed. DMO took 31.5s. Estimated remaining: 3h 49m 27s. Rate: 7.6 symbols/min [2025-09-19T18:24:07.848389] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-19T18:24:07.957784] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:08.019745] [DEBUG] [LOCAL ] DOC: Loaded 53925 existing records from primary storage. [2025-09-19T18:24:08.019936] [INFO ] [MAIN ] DOC: Loaded 53925 existing records. [2025-09-19T18:24:08.206636] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:08.206957] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-19T18:24:08.207027] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-19T18:24:08.208414] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-19T18:24:08.208486] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-19T18:24:08.565516] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:08.643238] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-19T18:24:09.443353] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-19T18:24:09.523428] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T18:24:10.101625] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:24:10.243264] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-19T18:24:11.043281] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-19T18:24:11.089623] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T18:24:11.843291] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-19T18:24:12.567597] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:24:12.643236] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-19T18:24:13.443271] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-19T18:24:14.257177] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-19T18:24:14.264273] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-19T18:24:14.874381] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (3.83 seconds). [2025-09-19T18:24:15.043256] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-19T18:24:15.180627] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T18:24:15.307820] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T18:24:15.843266] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-19T18:24:16.289682] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:24:16.643267] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-19T18:24:16.923045] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T18:24:17.443270] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-19T18:24:17.837906] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:24:18.083361] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T18:24:18.243274] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-19T18:24:18.852544] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:24:18.861427] [INFO ] [REMOTE ] DNOW: Full fetch complete (62265 records). [2025-09-19T18:24:18.861592] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-19T18:24:19.051280] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-19T18:24:19.307578] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-19T18:24:19.307690] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-19T18:24:19.308856] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-19T18:24:19.308919] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-19T18:24:19.310614] [DEBUG] [LOCAL ] DNOW: Trimmed 62265 records to 44148 (keeping 200 days of data) [2025-09-19T18:24:19.576206] [DEBUG] [LOCAL ] DNOW: Primary data saved (44148 records). [2025-09-19T18:24:19.576338] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-19T18:24:19.576433] [INFO ] [MAIN ] Update Progress: 637/2372 symbols completed. DNOW took 30.7s. Estimated remaining: 3h 49m 29s. Rate: 7.6 symbols/min [2025-09-19T18:24:19.843251] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-19T18:24:20.221130] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T18:24:20.643274] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-19T18:24:20.897204] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:24:21.443291] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-19T18:24:21.464769] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T18:24:21.470718] [INFO ] [REMOTE ] DNP: Full fetch complete (49451 records). [2025-09-19T18:24:21.470861] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-19T18:24:21.895660] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-19T18:24:21.895760] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-19T18:24:21.896495] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-19T18:24:21.896571] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-19T18:24:21.899773] [DEBUG] [LOCAL ] DNP: Trimmed 49451 records to 33926 (keeping 200 days of data) [2025-09-19T18:24:22.110999] [DEBUG] [LOCAL ] DNP: Primary data saved (33926 records). [2025-09-19T18:24:22.111159] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-19T18:24:22.111280] [INFO ] [MAIN ] Update Progress: 638/2372 symbols completed. DNP took 31.6s. Estimated remaining: 3h 49m 7s. Rate: 7.6 symbols/min [2025-09-19T18:24:22.376201] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:24:22.389625] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-19T18:24:24.082561] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-19T18:24:24.100453] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-19T18:24:24.576527] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T18:24:24.584612] [INFO ] [REMOTE ] DNA: Full fetch complete (70983 records). [2025-09-19T18:24:24.584818] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-19T18:24:24.999427] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-19T18:24:24.999540] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-19T18:24:25.000455] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-19T18:24:25.000534] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-19T18:24:25.002510] [DEBUG] [LOCAL ] DNA: Trimmed 70983 records to 49205 (keeping 200 days of data) [2025-09-19T18:24:25.310004] [DEBUG] [LOCAL ] DNA: Primary data saved (49205 records). [2025-09-19T18:24:25.310275] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-19T18:24:25.310502] [INFO ] [MAIN ] Update Progress: 639/2372 symbols completed. DNA took 38.7s. Estimated remaining: 3h 48m 46s. Rate: 7.6 symbols/min [2025-09-19T18:24:25.636256] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T18:24:25.648968] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-19T18:24:27.187175] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:24:27.198552] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-19T18:24:29.401329] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T18:24:29.413194] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-19T18:24:31.640062] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T18:24:31.651791] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-19T18:24:33.733907] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T18:24:33.742135] [INFO ] [REMOTE ] DOC: Full fetch complete (77366 records). [2025-09-19T18:24:33.742327] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-19T18:24:34.148269] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-19T18:24:34.148360] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-19T18:24:34.149285] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-19T18:24:34.149366] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-19T18:24:34.151041] [DEBUG] [LOCAL ] DOC: Trimmed 77366 records to 54313 (keeping 200 days of data) [2025-09-19T18:24:34.517466] [DEBUG] [LOCAL ] DOC: Primary data saved (54313 records). [2025-09-19T18:24:34.517630] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-19T18:24:34.518226] [INFO ] [MAIN ] Update Progress: 640/2372 symbols completed. DOC took 26.7s. Estimated remaining: 3h 48m 41s. Rate: 7.6 symbols/min [2025-09-19T18:24:35.196879] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:35.275773] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:35.280297] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:35.308086] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:35.390184] [DEBUG] [LOCAL ] DOUG: Loaded 35182 existing records from primary storage. [2025-09-19T18:24:35.390395] [INFO ] [MAIN ] DOUG: Loaded 35182 existing records. [2025-09-19T18:24:35.577585] [DEBUG] [LOCAL ] DOCN: Loaded 50790 existing records from primary storage. [2025-09-19T18:24:35.579180] [INFO ] [MAIN ] DOCN: Loaded 50790 existing records. [2025-09-19T18:24:35.579079] [DEBUG] [LOCAL ] DOCS: Loaded 51729 existing records from primary storage. [2025-09-19T18:24:35.579832] [DEBUG] [LOCAL ] DOLE: Loaded 38101 existing records from primary storage. [2025-09-19T18:24:35.606600] [INFO ] [MAIN ] DOLE: Loaded 38101 existing records. [2025-09-19T18:24:35.585237] [INFO ] [MAIN ] DOCS: Loaded 51729 existing records. [2025-09-19T18:24:35.876795] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:35.948546] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-19T18:24:36.025294] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-19T18:24:36.112480] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-19T18:24:36.236300] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:36.245074] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:36.200395] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-19T18:24:36.268866] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-19T18:24:36.248279] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:36.278129] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-19T18:24:36.278039] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-19T18:24:36.293820] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-19T18:24:36.317410] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-19T18:24:36.323017] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-19T18:24:36.328367] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-19T18:24:36.333792] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-19T18:24:36.339270] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-19T18:24:36.354902] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-19T18:24:36.460697] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-19T18:24:36.485344] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-19T18:24:37.383889] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:37.412280] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-19T18:24:37.677093] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:37.711321] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-19T18:24:37.757873] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:37.770267] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-19T18:24:37.811776] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:37.812900] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-19T18:24:39.007999] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:24:39.017098] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-19T18:24:39.083336] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T18:24:39.092669] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-19T18:24:39.587256] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T18:24:39.594415] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-19T18:24:39.954770] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T18:24:39.965252] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-19T18:24:40.448489] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T18:24:40.458678] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-19T18:24:40.631921] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T18:24:40.640722] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-19T18:24:40.757868] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T18:24:40.765287] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-19T18:24:41.729406] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T18:24:41.737295] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-19T18:24:42.154000] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:24:42.170301] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-19T18:24:42.336497] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T18:24:42.352111] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-19T18:24:42.418898] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T18:24:42.429032] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-19T18:24:42.860544] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T18:24:42.869672] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-19T18:24:43.410100] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:24:43.417584] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-19T18:24:44.228077] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T18:24:44.238156] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-19T18:24:44.322817] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T18:24:44.333203] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-19T18:24:44.356361] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:24:44.364540] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-19T18:24:44.572755] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T18:24:44.580892] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-19T18:24:45.815998] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T18:24:45.826300] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-19T18:24:46.021516] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:24:46.030203] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-19T18:24:46.255601] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T18:24:46.264344] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-19T18:24:46.452103] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T18:24:46.463507] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-19T18:24:47.632372] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T18:24:47.640354] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-19T18:24:47.829093] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T18:24:47.843217] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-19T18:24:47.904596] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T18:24:48.150335] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T18:24:48.643311] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-19T18:24:48.693964] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T18:24:49.443282] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-19T18:24:49.695429] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T18:24:49.824937] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T18:24:50.243257] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-19T18:24:51.043306] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-19T18:24:51.268060] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T18:24:51.843273] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-19T18:24:52.042752] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T18:24:52.643286] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-19T18:24:53.183814] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-19T18:24:53.402348] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:24:53.407499] [INFO ] [REMOTE ] DOUG: Full fetch complete (51816 records). [2025-09-19T18:24:53.407597] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-19T18:24:53.451467] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-19T18:24:53.896920] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-19T18:24:53.897252] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-19T18:24:53.898044] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-19T18:24:53.898112] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-19T18:24:53.899407] [DEBUG] [LOCAL ] DOUG: Trimmed 51816 records to 35374 (keeping 200 days of data) [2025-09-19T18:24:54.099843] [DEBUG] [LOCAL ] DOUG: Primary data saved (35374 records). [2025-09-19T18:24:54.099997] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-19T18:24:54.100088] [INFO ] [MAIN ] Update Progress: 641/2372 symbols completed. DOUG took 19.6s. Estimated remaining: 3h 49m 5s. Rate: 7.6 symbols/min [2025-09-19T18:24:54.253148] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-19T18:24:54.283170] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:54.334487] [DEBUG] [LOCAL ] DOV: Loaded 46188 existing records from primary storage. [2025-09-19T18:24:54.334634] [INFO ] [MAIN ] DOV: Loaded 46188 existing records. [2025-09-19T18:24:54.522009] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:54.522311] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-19T18:24:54.522360] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-19T18:24:54.524062] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-19T18:24:54.524128] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-19T18:24:54.901475] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:55.048421] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-19T18:24:55.066620] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-19T18:24:55.639864] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:24:55.646224] [INFO ] [REMOTE ] DOLE: Full fetch complete (52817 records). [2025-09-19T18:24:55.646421] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-19T18:24:55.648445] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:24:55.648541] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:24:55.648584] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:24:55.648622] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-19T18:24:55.648721] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-09-19T18:24:55.648773] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-09-19T18:24:55.649216] [DEBUG] [LOCAL ] DOLE: Deleted derivative data file. [2025-09-19T18:24:55.649324] [INFO ] [MAIN ] Update Progress: 642/2372 symbols completed. DOLE took 21.1s. Estimated remaining: 3h 48m 40s. Rate: 7.6 symbols/min [2025-09-19T18:24:55.827358] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:55.856526] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-19T18:24:55.865342] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T18:24:55.933306] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-09-19T18:24:55.933480] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-09-19T18:24:56.117894] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:56.118141] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-19T18:24:56.118189] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-19T18:24:56.119895] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-19T18:24:56.119955] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-19T18:24:56.508205] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:56.531157] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T18:24:56.643266] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-19T18:24:57.388438] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T18:24:57.443286] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-19T18:24:58.243293] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-19T18:24:58.843560] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T18:24:58.987726] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T18:24:59.043276] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-19T18:24:59.843275] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-19T18:25:00.087457] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T18:25:00.643276] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-19T18:25:01.151350] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:25:01.443289] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-19T18:25:02.099933] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T18:25:02.243333] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-19T18:25:02.448224] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T18:25:02.456045] [INFO ] [REMOTE ] DOCN: Full fetch complete (71064 records). [2025-09-19T18:25:02.456203] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-19T18:25:02.861119] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-19T18:25:02.861246] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-19T18:25:02.862184] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-19T18:25:02.862263] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-19T18:25:02.864377] [DEBUG] [LOCAL ] DOCN: Trimmed 71064 records to 51180 (keeping 200 days of data) [2025-09-19T18:25:02.975019] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:25:02.987552] [INFO ] [REMOTE ] DOCS: Full fetch complete (74260 records). [2025-09-19T18:25:02.989993] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-19T18:25:03.043243] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-19T18:25:03.537551] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-19T18:25:03.538213] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-19T18:25:03.539638] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-19T18:25:03.540249] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-19T18:25:03.549060] [DEBUG] [LOCAL ] DOCS: Trimmed 74260 records to 52104 (keeping 200 days of data) [2025-09-19T18:25:03.717333] [DEBUG] [LOCAL ] DOCN: Primary data saved (51180 records). [2025-09-19T18:25:03.718943] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-19T18:25:03.719351] [INFO ] [MAIN ] Update Progress: 643/2372 symbols completed. DOCN took 29.2s. Estimated remaining: 3h 48m 32s. Rate: 7.6 symbols/min [2025-09-19T18:25:03.998257] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:04.000392] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-09-19T18:25:04.000838] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-09-19T18:25:04.001442] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-19T18:25:04.006083] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-19T18:25:04.008151] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-19T18:25:04.010793] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-19T18:25:04.520004] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T18:25:04.525586] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:04.537056] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-19T18:25:04.543486] [DEBUG] [LOCAL ] DOCS: Primary data saved (52104 records). [2025-09-19T18:25:04.543581] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-19T18:25:04.543686] [INFO ] [MAIN ] Update Progress: 644/2372 symbols completed. DOCS took 30.0s. Estimated remaining: 3h 48m 5s. Rate: 7.6 symbols/min [2025-09-19T18:25:04.643579] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-19T18:25:04.722226] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:04.761012] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T18:25:04.808313] [DEBUG] [LOCAL ] DQ: Loaded 43417 existing records from primary storage. [2025-09-19T18:25:04.808516] [INFO ] [MAIN ] DQ: Loaded 43417 existing records. [2025-09-19T18:25:04.982736] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:25:04.982979] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-19T18:25:04.983048] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-19T18:25:04.984291] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-19T18:25:04.984377] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-19T18:25:05.297052] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T18:25:05.357496] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:05.443233] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-19T18:25:06.248096] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-19T18:25:06.253953] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T18:25:07.043452] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-19T18:25:07.314379] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T18:25:07.843269] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-19T18:25:08.092960] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T18:25:08.643280] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-19T18:25:09.047230] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:25:09.443315] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-19T18:25:09.755830] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-19T18:25:10.243260] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-19T18:25:10.718749] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:25:11.043320] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-19T18:25:11.223118] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T18:25:11.585079] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T18:25:11.843262] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-19T18:25:12.033400] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T18:25:12.643265] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-19T18:25:13.443266] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-19T18:25:13.585851] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:25:14.243279] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-19T18:25:14.625179] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:25:15.043277] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-19T18:25:15.246166] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T18:25:15.693306] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T18:25:15.843269] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-19T18:25:16.184453] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T18:25:16.643271] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-19T18:25:17.041876] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T18:25:17.443256] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-19T18:25:18.243287] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-19T18:25:18.559127] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T18:25:18.785180] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-19T18:25:19.043267] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-19T18:25:19.767528] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T18:25:19.843299] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-19T18:25:20.099546] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T18:25:20.643354] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-19T18:25:20.884542] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T18:25:21.443283] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-19T18:25:22.041425] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T18:25:22.243318] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-19T18:25:22.789552] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T18:25:23.043321] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-19T18:25:23.843287] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-19T18:25:23.892716] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:25:24.643270] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-19T18:25:24.982287] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-19T18:25:25.252100] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T18:25:25.443267] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-19T18:25:26.243319] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-19T18:25:26.516719] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:25:26.518987] [INFO ] [REMOTE ] DPG: Full fetch complete (18793 records). [2025-09-19T18:25:26.519076] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-19T18:25:26.519543] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:25:26.519627] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:25:26.519718] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:25:26.519790] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-19T18:25:26.519854] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-19T18:25:26.519889] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-09-19T18:25:26.519945] [DEBUG] [LOCAL ] DPG: No derivative data file found to delete. [2025-09-19T18:25:26.520024] [INFO ] [MAIN ] Update Progress: 645/2372 symbols completed. DPG took 22.8s. Estimated remaining: 3h 48m 35s. Rate: 7.6 symbols/min [2025-09-19T18:25:26.697613] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:26.697957] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-09-19T18:25:26.698037] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-09-19T18:25:26.698323] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-19T18:25:26.698470] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-19T18:25:26.698625] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-19T18:25:26.698718] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-19T18:25:26.826066] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T18:25:27.051990] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-19T18:25:27.092871] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:27.843277] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-19T18:25:28.179762] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T18:25:28.643292] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-19T18:25:29.057275] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T18:25:29.063992] [INFO ] [REMOTE ] DOV: Full fetch complete (64714 records). [2025-09-19T18:25:29.064131] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-19T18:25:29.459183] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-19T18:25:29.474455] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-19T18:25:29.475169] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-19T18:25:29.477205] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T18:25:29.476009] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-19T18:25:29.485463] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-19T18:25:29.486979] [DEBUG] [LOCAL ] DOV: Trimmed 64714 records to 46479 (keeping 200 days of data) [2025-09-19T18:25:29.779712] [DEBUG] [LOCAL ] DOV: Primary data saved (46479 records). [2025-09-19T18:25:29.779872] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-19T18:25:29.780691] [INFO ] [MAIN ] Update Progress: 646/2372 symbols completed. DOV took 35.7s. Estimated remaining: 3h 48m 15s. Rate: 7.6 symbols/min [2025-09-19T18:25:29.951676] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:30.003747] [DEBUG] [LOCAL ] DRH: Loaded 50816 existing records from primary storage. [2025-09-19T18:25:30.003904] [INFO ] [MAIN ] DRH: Loaded 50816 existing records. [2025-09-19T18:25:30.186456] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:25:30.186833] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-19T18:25:30.186891] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-19T18:25:30.188157] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-19T18:25:30.188219] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-19T18:25:30.251335] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-19T18:25:30.567022] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:30.614876] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T18:25:30.623128] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-19T18:25:30.623310] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-19T18:25:31.019352] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-19T18:25:31.019453] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-19T18:25:31.020476] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-19T18:25:31.020545] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-19T18:25:31.022232] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54513 (keeping 200 days of data) [2025-09-19T18:25:31.078536] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-19T18:25:31.361310] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-09-19T18:25:31.361462] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-19T18:25:31.361547] [INFO ] [MAIN ] Update Progress: 647/2372 symbols completed. DOW took 35.7s. Estimated remaining: 3h 47m 50s. Rate: 7.6 symbols/min [2025-09-19T18:25:31.530811] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:31.531274] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-09-19T18:25:31.531336] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-09-19T18:25:31.531553] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-19T18:25:31.531783] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-19T18:25:31.531914] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-09-19T18:25:31.532065] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-19T18:25:31.922581] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:31.944260] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-19T18:25:31.942834] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-19T18:25:31.971858] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T18:25:32.643281] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-19T18:25:33.060186] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T18:25:33.443242] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-19T18:25:33.682125] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T18:25:34.137225] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T18:25:34.243315] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-19T18:25:34.812671] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T18:25:35.043323] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-19T18:25:35.411772] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T18:25:35.843288] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-19T18:25:36.363287] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T18:25:36.643232] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-19T18:25:36.938054] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T18:25:37.443319] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-19T18:25:38.243261] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-19T18:25:38.757522] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T18:25:38.766483] [INFO ] [REMOTE ] DQ: Full fetch complete (62903 records). [2025-09-19T18:25:38.766617] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-19T18:25:39.050067] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-19T18:25:39.174539] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-19T18:25:39.174731] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-19T18:25:39.175625] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-19T18:25:39.175730] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-19T18:25:39.177230] [DEBUG] [LOCAL ] DQ: Trimmed 62903 records to 43775 (keeping 200 days of data) [2025-09-19T18:25:39.325429] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T18:25:39.489524] [DEBUG] [LOCAL ] DQ: Primary data saved (43775 records). [2025-09-19T18:25:39.489702] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-19T18:25:39.489809] [INFO ] [MAIN ] Update Progress: 648/2372 symbols completed. DQ took 34.9s. Estimated remaining: 3h 47m 42s. Rate: 7.6 symbols/min [2025-09-19T18:25:39.681727] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:39.699067] [DEBUG] [LOCAL ] DRLL: Loaded 10099 existing records from primary storage. [2025-09-19T18:25:39.699209] [INFO ] [MAIN ] DRLL: Loaded 10099 existing records. [2025-09-19T18:25:39.847781] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-19T18:25:39.890092] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:25:39.890349] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-19T18:25:39.890412] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-19T18:25:39.890941] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-19T18:25:39.891002] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-19T18:25:40.318614] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T18:25:40.324678] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:40.643261] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-19T18:25:40.916702] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T18:25:41.208696] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:25:41.443233] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-19T18:25:41.587724] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:25:42.243263] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-19T18:25:43.043273] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-19T18:25:43.802514] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-19T18:25:43.845941] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T18:25:43.846062] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-19T18:25:44.649244] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-19T18:25:44.670728] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:25:44.847136] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:25:45.443289] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-19T18:25:46.243266] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-19T18:25:46.460582] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:25:47.003736] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T18:25:47.043249] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-19T18:25:47.257158] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T18:25:47.843309] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-19T18:25:48.643281] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-19T18:25:48.917035] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T18:25:49.261459] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T18:25:49.443259] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-19T18:25:49.814564] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:25:50.243270] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-19T18:25:50.811822] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T18:25:51.043291] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-19T18:25:51.393189] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T18:25:51.843258] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-19T18:25:52.243488] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T18:25:52.643264] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-19T18:25:53.443317] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-19T18:25:53.751907] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:25:53.857605] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T18:25:54.061476] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T18:25:54.243269] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-19T18:25:55.043295] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-19T18:25:55.843294] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-19T18:25:55.879796] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T18:25:55.887001] [INFO ] [REMOTE ] DRD: Full fetch complete (48355 records). [2025-09-19T18:25:55.887144] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-19T18:25:56.321439] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-19T18:25:56.321553] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-19T18:25:56.322461] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-19T18:25:56.322544] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-19T18:25:56.324054] [DEBUG] [LOCAL ] DRD: Trimmed 48355 records to 37026 (keeping 200 days of data) [2025-09-19T18:25:56.564431] [DEBUG] [LOCAL ] DRD: Primary data saved (37026 records). [2025-09-19T18:25:56.564714] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-19T18:25:56.564943] [INFO ] [MAIN ] Update Progress: 649/2372 symbols completed. DRD took 30.0s. Estimated remaining: 3h 47m 59s. Rate: 7.6 symbols/min [2025-09-19T18:25:56.648479] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-19T18:25:56.762180] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:56.762395] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-09-19T18:25:56.762450] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-09-19T18:25:56.762620] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-19T18:25:56.762694] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-19T18:25:56.762752] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-09-19T18:25:56.762785] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-19T18:25:57.139198] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:57.170536] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T18:25:57.443269] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-19T18:25:57.669209] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-19T18:25:57.898725] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:25:58.243286] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-19T18:25:59.043331] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-19T18:25:59.183404] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T18:25:59.318370] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T18:25:59.843277] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-19T18:26:00.202635] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T18:26:00.643270] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-19T18:26:01.176568] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T18:26:01.443245] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-19T18:26:01.973453] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:26:02.243291] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-19T18:26:03.043252] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-19T18:26:03.068867] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T18:26:03.070690] [INFO ] [REMOTE ] DRLL: Full fetch complete (16346 records). [2025-09-19T18:26:03.070766] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-19T18:26:03.477941] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-19T18:26:03.478216] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-19T18:26:03.478703] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-19T18:26:03.478849] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-19T18:26:03.479851] [DEBUG] [LOCAL ] DRLL: Trimmed 16346 records to 10151 (keeping 200 days of data) [2025-09-19T18:26:03.558175] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:26:03.585561] [DEBUG] [LOCAL ] DRLL: Primary data saved (10151 records). [2025-09-19T18:26:03.585754] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-19T18:26:03.585869] [INFO ] [MAIN ] Update Progress: 650/2372 symbols completed. DRLL took 24.1s. Estimated remaining: 3h 47m 48s. Rate: 7.6 symbols/min [2025-09-19T18:26:03.759271] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:03.759466] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-09-19T18:26:03.759521] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-09-19T18:26:03.759704] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-19T18:26:03.759756] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-19T18:26:03.759799] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-19T18:26:03.759831] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-19T18:26:03.848830] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-19T18:26:04.128373] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:04.535884] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T18:26:04.543182] [INFO ] [REMOTE ] DRI: Full fetch complete (69517 records). [2025-09-19T18:26:04.543358] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-19T18:26:04.648436] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-19T18:26:04.944466] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-19T18:26:04.944551] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-19T18:26:04.945371] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-19T18:26:04.945436] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-19T18:26:04.946878] [DEBUG] [LOCAL ] DRI: Trimmed 69517 records to 48576 (keeping 200 days of data) [2025-09-19T18:26:05.266923] [DEBUG] [LOCAL ] DRI: Primary data saved (48576 records). [2025-09-19T18:26:05.267077] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-19T18:26:05.267158] [INFO ] [MAIN ] Update Progress: 651/2372 symbols completed. DRI took 33.9s. Estimated remaining: 3h 47m 24s. Rate: 7.6 symbols/min [2025-09-19T18:26:05.443135] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:05.443265] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-19T18:26:05.448210] [DEBUG] [LOCAL ] DSMC: Loaded 2010 existing records from primary storage. [2025-09-19T18:26:05.448395] [INFO ] [MAIN ] DSMC: Loaded 2010 existing records. [2025-09-19T18:26:05.641063] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:05.641440] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-19T18:26:05.641500] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-19T18:26:05.641809] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-19T18:26:05.641870] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-19T18:26:06.012932] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:06.045383] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T18:26:06.046921] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T18:26:06.060096] [INFO ] [REMOTE ] DRH: Full fetch complete (71878 records). [2025-09-19T18:26:06.060292] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-19T18:26:06.246430] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-19T18:26:06.474477] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-19T18:26:06.474624] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-19T18:26:06.475634] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-19T18:26:06.475778] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-19T18:26:06.492923] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T18:26:06.499304] [DEBUG] [LOCAL ] DRH: Trimmed 71878 records to 51192 (keeping 200 days of data) [2025-09-19T18:26:06.799243] [DEBUG] [LOCAL ] DRH: Primary data saved (51192 records). [2025-09-19T18:26:06.799421] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-19T18:26:06.799537] [INFO ] [MAIN ] Update Progress: 652/2372 symbols completed. DRH took 37.0s. Estimated remaining: 3h 46m 59s. Rate: 7.6 symbols/min [2025-09-19T18:26:06.967954] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:06.992809] [DEBUG] [LOCAL ] DSU: Loaded 21836 existing records from primary storage. [2025-09-19T18:26:06.993013] [INFO ] [MAIN ] DSU: Loaded 21836 existing records. [2025-09-19T18:26:07.055180] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-19T18:26:07.177948] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:07.178241] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-19T18:26:07.178300] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-19T18:26:07.179287] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-19T18:26:07.179350] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-19T18:26:07.531962] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:07.542435] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:26:07.843268] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-19T18:26:08.646494] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-19T18:26:08.655965] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T18:26:09.109862] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-19T18:26:09.198965] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T18:26:09.443260] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-19T18:26:10.243248] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-19T18:26:10.569915] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T18:26:10.798314] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-19T18:26:11.043278] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-19T18:26:11.843247] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-19T18:26:12.365011] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T18:26:12.643267] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-19T18:26:13.168404] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T18:26:13.443284] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-19T18:26:13.593028] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T18:26:14.243266] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-19T18:26:14.812067] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:26:15.043262] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-19T18:26:15.410238] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-19T18:26:15.527802] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T18:26:15.843261] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-19T18:26:16.643228] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-19T18:26:17.188672] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:26:17.374148] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T18:26:17.443274] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-19T18:26:18.243224] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-19T18:26:18.368733] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T18:26:19.043283] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-19T18:26:19.843315] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-19T18:26:19.902360] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T18:26:20.614877] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T18:26:20.643215] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-19T18:26:20.688695] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:26:21.209423] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T18:26:21.443272] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-19T18:26:22.243312] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-19T18:26:22.409130] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T18:26:22.655518] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T18:26:23.043295] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-19T18:26:23.843278] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-19T18:26:24.116292] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T18:26:24.643287] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-19T18:26:25.143621] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T18:26:25.350563] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T18:26:25.443294] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-19T18:26:25.974762] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T18:26:26.243280] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-19T18:26:26.769781] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-19T18:26:27.043273] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-19T18:26:27.843302] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-19T18:26:27.998482] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T18:26:28.643267] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-19T18:26:29.087458] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T18:26:29.088453] [INFO ] [REMOTE ] DSMC: Full fetch complete (2873 records). [2025-09-19T18:26:29.088525] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-19T18:26:29.446038] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-19T18:26:29.493882] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-19T18:26:29.493978] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-19T18:26:29.494186] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-19T18:26:29.494302] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-19T18:26:29.494862] [DEBUG] [LOCAL ] DSMC: Trimmed 2873 records to 2049 (keeping 200 days of data) [2025-09-19T18:26:29.520553] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T18:26:29.530249] [DEBUG] [LOCAL ] DSMC: Primary data saved (2049 records). [2025-09-19T18:26:29.530341] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-19T18:26:29.530419] [INFO ] [MAIN ] Update Progress: 653/2372 symbols completed. DSMC took 24.3s. Estimated remaining: 3h 47m 30s. Rate: 7.6 symbols/min [2025-09-19T18:26:29.720736] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:29.745781] [DEBUG] [LOCAL ] DSX: Loaded 24874 existing records from primary storage. [2025-09-19T18:26:29.745916] [INFO ] [MAIN ] DSX: Loaded 24874 existing records. [2025-09-19T18:26:29.941351] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:29.941639] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-19T18:26:29.941721] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-19T18:26:29.942634] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-19T18:26:29.942736] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-19T18:26:30.256857] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-19T18:26:30.305045] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:30.403385] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T18:26:31.043284] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-19T18:26:31.712383] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T18:26:31.718369] [INFO ] [REMOTE ] DSL: Full fetch complete (41307 records). [2025-09-19T18:26:31.718495] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-19T18:26:31.848502] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-19T18:26:32.147115] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-19T18:26:32.147196] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-19T18:26:32.147830] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-19T18:26:32.147892] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-19T18:26:32.149215] [DEBUG] [LOCAL ] DSL: Trimmed 41307 records to 28666 (keeping 200 days of data) [2025-09-19T18:26:32.328123] [DEBUG] [LOCAL ] DSL: Primary data saved (28666 records). [2025-09-19T18:26:32.328262] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-19T18:26:32.328408] [INFO ] [MAIN ] Update Progress: 654/2372 symbols completed. DSL took 35.8s. Estimated remaining: 3h 47m 9s. Rate: 7.6 symbols/min [2025-09-19T18:26:32.455523] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T18:26:32.534139] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:32.585324] [DEBUG] [LOCAL ] DT: Loaded 53342 existing records from primary storage. [2025-09-19T18:26:32.585501] [INFO ] [MAIN ] DT: Loaded 53342 existing records. [2025-09-19T18:26:32.655592] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-19T18:26:32.793152] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T18:26:32.799427] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:32.804309] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-19T18:26:32.804382] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-19T18:26:32.806060] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-19T18:26:32.806123] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-19T18:26:33.163328] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:33.443286] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-19T18:26:34.126486] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T18:26:34.131075] [INFO ] [REMOTE ] DSU: Full fetch complete (32122 records). [2025-09-19T18:26:34.131202] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-19T18:26:34.248446] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-19T18:26:34.514018] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-19T18:26:34.556715] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-19T18:26:34.556811] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-19T18:26:34.557467] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-19T18:26:34.557544] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-19T18:26:34.558367] [DEBUG] [LOCAL ] DSU: Trimmed 32122 records to 22088 (keeping 200 days of data) [2025-09-19T18:26:34.707207] [DEBUG] [LOCAL ] DSU: Primary data saved (22088 records). [2025-09-19T18:26:34.707342] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-19T18:26:34.707451] [INFO ] [MAIN ] Update Progress: 655/2372 symbols completed. DSU took 27.9s. Estimated remaining: 3h 46m 46s. Rate: 7.6 symbols/min [2025-09-19T18:26:34.875712] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:34.875887] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-09-19T18:26:34.875940] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-09-19T18:26:34.876090] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-19T18:26:34.876142] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-19T18:26:34.876207] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-09-19T18:26:34.876261] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-19T18:26:35.050414] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-19T18:26:35.255030] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:35.843301] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-19T18:26:36.407696] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:26:36.498961] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:26:36.643296] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-19T18:26:36.765837] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T18:26:37.443266] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-19T18:26:37.594763] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T18:26:38.123296] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T18:26:38.243289] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-19T18:26:38.921432] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T18:26:39.043249] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-19T18:26:39.843284] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-19T18:26:40.643240] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-19T18:26:41.200703] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-19T18:26:41.324628] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:26:41.327223] [INFO ] [REMOTE ] DSM: Full fetch complete (24720 records). [2025-09-19T18:26:41.327330] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-19T18:26:41.448356] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-19T18:26:41.715823] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-19T18:26:41.715909] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-19T18:26:41.716389] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-19T18:26:41.716466] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-19T18:26:41.717247] [DEBUG] [LOCAL ] DSM: Trimmed 24720 records to 16018 (keeping 200 days of data) [2025-09-19T18:26:41.820319] [DEBUG] [LOCAL ] DSM: Primary data saved (16018 records). [2025-09-19T18:26:41.820458] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-19T18:26:41.820555] [INFO ] [MAIN ] Update Progress: 656/2372 symbols completed. DSM took 38.2s. Estimated remaining: 3h 46m 36s. Rate: 7.6 symbols/min [2025-09-19T18:26:42.002787] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:42.066922] [DEBUG] [LOCAL ] DTE: Loaded 48330 existing records from primary storage. [2025-09-19T18:26:42.067077] [INFO ] [MAIN ] DTE: Loaded 48330 existing records. [2025-09-19T18:26:42.256809] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:42.250037] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-19T18:26:42.257695] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-19T18:26:42.258979] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-19T18:26:42.277478] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:26:42.277554] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-19T18:26:42.284029] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-19T18:26:42.650781] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:43.003226] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T18:26:43.043228] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-19T18:26:43.488622] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-19T18:26:43.567160] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T18:26:43.843303] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-19T18:26:44.643270] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-19T18:26:45.346518] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T18:26:45.398502] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T18:26:45.443324] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-19T18:26:46.191693] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T18:26:46.243329] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-19T18:26:47.043269] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-19T18:26:47.094631] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T18:26:47.843281] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-19T18:26:48.405272] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T18:26:48.501464] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-19T18:26:48.643287] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-19T18:26:49.443270] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-19T18:26:50.243283] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-19T18:26:50.731574] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T18:26:51.043241] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-19T18:26:51.809430] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T18:26:51.843219] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-19T18:26:52.042882] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T18:26:52.042265] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-19T18:26:52.643274] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-19T18:26:53.150326] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T18:26:53.443305] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-19T18:26:54.243274] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-19T18:26:54.591095] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T18:26:54.915591] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:26:55.043288] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-19T18:26:55.843266] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-19T18:26:56.081059] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T18:26:56.509415] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T18:26:56.643230] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-19T18:26:57.443263] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-19T18:26:57.955272] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T18:26:57.976886] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:26:57.982927] [INFO ] [REMOTE ] DSX: Full fetch complete (37596 records). [2025-09-19T18:26:57.983019] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-19T18:26:58.248410] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-19T18:26:58.359174] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-19T18:26:58.359676] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-19T18:26:58.360289] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-19T18:26:58.360441] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-19T18:26:58.361369] [DEBUG] [LOCAL ] DSX: Trimmed 37596 records to 25050 (keeping 200 days of data) [2025-09-19T18:26:58.519960] [DEBUG] [LOCAL ] DSX: Primary data saved (25050 records). [2025-09-19T18:26:58.520132] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-19T18:26:58.520265] [INFO ] [MAIN ] Update Progress: 657/2372 symbols completed. DSX took 29.0s. Estimated remaining: 3h 46m 51s. Rate: 7.6 symbols/min [2025-09-19T18:26:58.737431] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:58.737737] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-19T18:26:58.737792] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-19T18:26:58.737962] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-19T18:26:58.738006] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-19T18:26:58.738050] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-19T18:26:58.738131] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-19T18:26:59.048387] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-19T18:26:59.106474] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:59.333709] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T18:26:59.777504] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T18:26:59.843283] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-19T18:26:59.994602] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T18:26:59.996905] [INFO ] [REMOTE ] DTB: Full fetch complete (6792 records). [2025-09-19T18:26:59.997016] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-19T18:27:00.414580] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-19T18:27:00.414831] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-19T18:27:00.415063] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-19T18:27:00.415109] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-19T18:27:00.415858] [DEBUG] [LOCAL ] DTB: Trimmed 6792 records to 4777 (keeping 200 days of data) [2025-09-19T18:27:00.459970] [DEBUG] [LOCAL ] DTB: Primary data saved (4777 records). [2025-09-19T18:27:00.460150] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-19T18:27:00.460318] [INFO ] [MAIN ] Update Progress: 658/2372 symbols completed. DTB took 25.8s. Estimated remaining: 3h 46m 28s. Rate: 7.6 symbols/min [2025-09-19T18:27:00.645811] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-19T18:27:00.647551] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:00.663027] [DEBUG] [LOCAL ] DTG: Loaded 5943 existing records from primary storage. [2025-09-19T18:27:00.663214] [INFO ] [MAIN ] DTG: Loaded 5943 existing records. [2025-09-19T18:27:00.855328] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:00.855581] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-19T18:27:00.855629] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-19T18:27:00.856063] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-19T18:27:00.856124] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-19T18:27:01.215600] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:01.418205] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T18:27:01.443263] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-19T18:27:01.829068] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T18:27:02.243267] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-19T18:27:03.043293] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-19T18:27:03.843358] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-19T18:27:04.651948] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-19T18:27:04.653294] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-19T18:27:04.660775] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (3.22 seconds). [2025-09-19T18:27:05.354130] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T18:27:05.443259] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-19T18:27:05.960533] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-19T18:27:06.186863] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T18:27:06.243259] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-19T18:27:06.274414] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-19T18:27:06.648244] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-19T18:27:07.043284] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-19T18:27:07.843274] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-19T18:27:08.643265] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-19T18:27:08.897856] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T18:27:09.185431] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T18:27:09.443269] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-19T18:27:09.917049] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-19T18:27:09.968179] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T18:27:09.976715] [INFO ] [REMOTE ] DT: Full fetch complete (76641 records). [2025-09-19T18:27:09.976849] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-19T18:27:10.250986] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-19T18:27:10.402137] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-19T18:27:10.402221] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-19T18:27:10.403104] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-19T18:27:10.403168] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-19T18:27:10.404675] [DEBUG] [LOCAL ] DT: Trimmed 76641 records to 53726 (keeping 200 days of data) [2025-09-19T18:27:10.624577] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-19T18:27:10.737461] [DEBUG] [LOCAL ] DT: Primary data saved (53726 records). [2025-09-19T18:27:10.737599] [INFO ] [MAIN ] DT: Full history saved. [2025-09-19T18:27:10.737714] [INFO ] [MAIN ] Update Progress: 659/2372 symbols completed. DT took 38.4s. Estimated remaining: 3h 46m 26s. Rate: 7.6 symbols/min [2025-09-19T18:27:10.905059] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:10.949876] [DEBUG] [LOCAL ] DTM: Loaded 44984 existing records from primary storage. [2025-09-19T18:27:10.950040] [INFO ] [MAIN ] DTM: Loaded 44984 existing records. [2025-09-19T18:27:11.049291] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-19T18:27:11.134551] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:11.134860] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-19T18:27:11.134914] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-19T18:27:11.136409] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-19T18:27:11.136487] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-19T18:27:11.511841] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:11.843241] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-19T18:27:12.287894] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T18:27:12.643258] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-19T18:27:13.195773] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-19T18:27:13.240304] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T18:27:13.443282] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-19T18:27:14.243313] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-19T18:27:15.043334] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-19T18:27:15.788660] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T18:27:15.843287] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-19T18:27:16.019221] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:27:16.521552] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T18:27:16.631448] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T18:27:16.643212] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-19T18:27:17.443270] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-19T18:27:17.932434] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T18:27:17.933348] [INFO ] [REMOTE ] DTF: Full fetch complete (2193 records). [2025-09-19T18:27:17.933419] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-19T18:27:17.933846] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:27:17.933932] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:27:17.933977] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:27:17.934017] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-19T18:27:17.934075] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-19T18:27:17.934114] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-19T18:27:17.934185] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-19T18:27:17.934284] [INFO ] [MAIN ] Update Progress: 660/2372 symbols completed. DTF took 19.4s. Estimated remaining: 3h 46m 16s. Rate: 7.6 symbols/min [2025-09-19T18:27:18.106827] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:18.113965] [DEBUG] [LOCAL ] DTW: Loaded 4957 existing records from primary storage. [2025-09-19T18:27:18.114074] [INFO ] [MAIN ] DTW: Loaded 4957 existing records. [2025-09-19T18:27:18.251279] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-19T18:27:18.292429] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:18.292712] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-19T18:27:18.292768] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-19T18:27:18.293077] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-19T18:27:18.293138] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-19T18:27:18.662845] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:18.690385] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T18:27:19.043291] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-19T18:27:19.843247] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-19T18:27:20.202779] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T18:27:20.618220] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:27:20.643225] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-19T18:27:20.775007] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T18:27:21.443331] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-19T18:27:22.202924] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T18:27:22.243276] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-19T18:27:22.636448] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T18:27:22.636588] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:27:22.646050] [INFO ] [REMOTE ] DTE: Full fetch complete (69304 records). [2025-09-19T18:27:22.646181] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-19T18:27:23.044742] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-19T18:27:23.045319] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-19T18:27:23.046770] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-19T18:27:23.047867] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-19T18:27:23.048043] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-19T18:27:23.050184] [DEBUG] [LOCAL ] DTE: Trimmed 69304 records to 48671 (keeping 200 days of data) [2025-09-19T18:27:23.397351] [DEBUG] [LOCAL ] DTE: Primary data saved (48671 records). [2025-09-19T18:27:23.397518] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-19T18:27:23.397612] [INFO ] [MAIN ] Update Progress: 661/2372 symbols completed. DTE took 41.6s. Estimated remaining: 3h 46m 2s. Rate: 7.6 symbols/min [2025-09-19T18:27:23.573432] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:23.639177] [DEBUG] [LOCAL ] DUK: Loaded 53863 existing records from primary storage. [2025-09-19T18:27:23.639375] [INFO ] [MAIN ] DUK: Loaded 53863 existing records. [2025-09-19T18:27:23.843287] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-19T18:27:23.877982] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:23.878279] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-19T18:27:23.878352] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-19T18:27:23.880561] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-19T18:27:23.880635] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-19T18:27:24.241791] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:24.322997] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T18:27:24.643311] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-19T18:27:24.872800] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:27:25.092363] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-19T18:27:25.443313] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-19T18:27:26.243286] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-19T18:27:27.043252] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-19T18:27:27.541504] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T18:27:27.843292] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-19T18:27:28.016121] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T18:27:28.330095] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T18:27:28.643269] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-19T18:27:29.377838] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T18:27:29.443299] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-19T18:27:29.855869] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T18:27:29.908910] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T18:27:30.243272] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-19T18:27:31.043302] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-19T18:27:31.843244] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-19T18:27:31.931974] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T18:27:32.020343] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T18:27:32.643299] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-19T18:27:32.688438] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T18:27:33.443308] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-19T18:27:34.187288] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T18:27:34.243236] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-19T18:27:34.685726] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T18:27:34.805511] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T18:27:35.043308] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-19T18:27:35.843277] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-19T18:27:36.643244] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-19T18:27:36.816910] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T18:27:36.875367] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T18:27:37.443311] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-19T18:27:38.243288] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-19T18:27:38.297510] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T18:27:38.299067] [INFO ] [REMOTE ] DTW: Full fetch complete (7870 records). [2025-09-19T18:27:38.299157] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-19T18:27:38.822464] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-19T18:27:38.822601] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-19T18:27:38.823083] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-19T18:27:38.823165] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-19T18:27:38.824185] [DEBUG] [LOCAL ] DTW: Trimmed 7870 records to 4977 (keeping 200 days of data) [2025-09-19T18:27:38.869204] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T18:27:38.885731] [DEBUG] [LOCAL ] DTW: Primary data saved (4977 records). [2025-09-19T18:27:38.887194] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-19T18:27:38.887383] [INFO ] [MAIN ] Update Progress: 662/2372 symbols completed. DTW took 21.0s. Estimated remaining: 3h 46m 13s. Rate: 7.6 symbols/min [2025-09-19T18:27:38.876631] [INFO ] [REMOTE ] DTG: Full fetch complete (9027 records). [2025-09-19T18:27:38.905480] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-19T18:27:39.053167] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-19T18:27:39.325875] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:39.515796] [DEBUG] [LOCAL ] DUKB: Loaded 6483 existing records from primary storage. [2025-09-19T18:27:39.526375] [INFO ] [MAIN ] DUKB: Loaded 6483 existing records. [2025-09-19T18:27:39.747374] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-19T18:27:39.751493] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-19T18:27:39.751819] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-19T18:27:39.757628] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-19T18:27:39.841160] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:39.842318] [DEBUG] [LOCAL ] DTG: Trimmed 9027 records to 5979 (keeping 200 days of data) [2025-09-19T18:27:39.842736] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-19T18:27:39.843107] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-19T18:27:39.843506] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-19T18:27:39.843570] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-19T18:27:39.998593] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (3.36 seconds). [2025-09-19T18:27:40.044943] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-19T18:27:40.079933] [DEBUG] [LOCAL ] DTG: Primary data saved (5979 records). [2025-09-19T18:27:40.100961] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-19T18:27:40.102034] [INFO ] [MAIN ] Update Progress: 663/2372 symbols completed. DTG took 39.6s. Estimated remaining: 3h 45m 48s. Rate: 7.6 symbols/min [2025-09-19T18:27:40.496431] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:40.490823] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:40.565419] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T18:27:40.590711] [DEBUG] [LOCAL ] DV: Loaded 51678 existing records from primary storage. [2025-09-19T18:27:40.590879] [INFO ] [MAIN ] DV: Loaded 51678 existing records. [2025-09-19T18:27:40.654249] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-19T18:27:40.782155] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:40.782411] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-19T18:27:40.782469] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-19T18:27:40.783982] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-19T18:27:40.784048] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-19T18:27:41.168720] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:41.338229] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-19T18:27:41.443283] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-19T18:27:42.243257] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-19T18:27:42.327145] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:27:42.455587] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-19T18:27:43.043267] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-19T18:27:43.778490] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:27:43.843268] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-19T18:27:44.321823] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T18:27:44.557817] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T18:27:44.643275] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-19T18:27:45.443301] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-19T18:27:46.243272] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-19T18:27:46.455808] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T18:27:46.828916] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-19T18:27:46.989387] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T18:27:47.043226] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-19T18:27:47.843283] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-19T18:27:48.643302] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-19T18:27:48.821237] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T18:27:48.855040] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T18:27:49.443288] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-19T18:27:50.243292] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-19T18:27:50.611406] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:27:51.043302] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-19T18:27:51.400762] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T18:27:51.408882] [INFO ] [REMOTE ] DTM: Full fetch complete (64947 records). [2025-09-19T18:27:51.409066] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-19T18:27:51.804750] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-19T18:27:51.804881] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-19T18:27:51.805683] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-19T18:27:51.805745] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-19T18:27:51.807107] [DEBUG] [LOCAL ] DTM: Trimmed 64947 records to 45355 (keeping 200 days of data) [2025-09-19T18:27:51.864511] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-19T18:27:52.096354] [DEBUG] [LOCAL ] DTM: Primary data saved (45355 records). [2025-09-19T18:27:52.096505] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-19T18:27:52.096733] [INFO ] [MAIN ] Update Progress: 664/2372 symbols completed. DTM took 41.4s. Estimated remaining: 3h 45m 50s. Rate: 7.6 symbols/min [2025-09-19T18:27:52.233066] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T18:27:52.313314] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:52.356707] [DEBUG] [LOCAL ] DVA: Loaded 42021 existing records from primary storage. [2025-09-19T18:27:52.356849] [INFO ] [MAIN ] DVA: Loaded 42021 existing records. [2025-09-19T18:27:52.532762] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:52.533027] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-19T18:27:52.533086] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-19T18:27:52.534077] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-19T18:27:52.534136] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-19T18:27:52.648406] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-19T18:27:52.897702] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:52.929589] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T18:27:52.962117] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T18:27:53.443273] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-19T18:27:54.187697] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T18:27:54.243217] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-19T18:27:55.043234] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-19T18:27:55.778874] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T18:27:55.843226] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-19T18:27:55.890777] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-19T18:27:56.242391] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:27:56.643278] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-19T18:27:57.443291] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-19T18:27:58.150002] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T18:27:58.243275] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-19T18:27:58.570698] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T18:27:58.628187] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-19T18:27:59.043279] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-19T18:27:59.107258] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:27:59.843276] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-19T18:27:59.946175] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T18:27:59.947849] [INFO ] [REMOTE ] DUKB: Full fetch complete (9596 records). [2025-09-19T18:27:59.947926] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-19T18:28:00.329824] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-19T18:28:00.329924] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-19T18:28:00.330392] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-19T18:28:00.330453] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-19T18:28:00.331820] [DEBUG] [LOCAL ] DUKB: Trimmed 9596 records to 6504 (keeping 200 days of data) [2025-09-19T18:28:00.372382] [DEBUG] [LOCAL ] DUKB: Primary data saved (6504 records). [2025-09-19T18:28:00.372484] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-19T18:28:00.372587] [INFO ] [MAIN ] Update Progress: 665/2372 symbols completed. DUKB took 21.5s. Estimated remaining: 3h 45m 43s. Rate: 7.6 symbols/min [2025-09-19T18:28:00.569239] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:00.629179] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-09-19T18:28:00.629337] [INFO ] [MAIN ] DVN: Loaded 54089 existing records. [2025-09-19T18:28:00.651119] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-19T18:28:00.820512] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:00.820840] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-19T18:28:00.820892] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-19T18:28:00.822308] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-19T18:28:00.822372] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-19T18:28:01.206946] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:01.443296] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-19T18:28:01.950783] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T18:28:02.243269] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-19T18:28:02.725403] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T18:28:03.043261] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-19T18:28:03.178584] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-19T18:28:03.186727] [INFO ] [REMOTE ] DUK: Full fetch complete (77405 records). [2025-09-19T18:28:03.186882] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-19T18:28:03.583301] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-19T18:28:03.583393] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-19T18:28:03.584394] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-19T18:28:03.584465] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-19T18:28:03.586227] [DEBUG] [LOCAL ] DUK: Trimmed 77405 records to 54250 (keeping 200 days of data) [2025-09-19T18:28:03.856877] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T18:28:03.853723] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-19T18:28:03.998430] [DEBUG] [LOCAL ] DUK: Primary data saved (54250 records). [2025-09-19T18:28:03.998614] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-19T18:28:03.998772] [INFO ] [MAIN ] Update Progress: 666/2372 symbols completed. DUK took 40.6s. Estimated remaining: 3h 45m 24s. Rate: 7.6 symbols/min [2025-09-19T18:28:04.181398] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:04.239404] [DEBUG] [LOCAL ] DX: Loaded 52855 existing records from primary storage. [2025-09-19T18:28:04.239568] [INFO ] [MAIN ] DX: Loaded 52855 existing records. [2025-09-19T18:28:04.430182] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:04.430428] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-19T18:28:04.430476] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-19T18:28:04.431580] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-19T18:28:04.431680] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-19T18:28:04.661504] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-19T18:28:04.823076] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:05.352966] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T18:28:05.443222] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-19T18:28:05.683794] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-19T18:28:06.176033] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T18:28:06.243238] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-19T18:28:06.861625] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T18:28:07.043306] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-19T18:28:07.843243] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-19T18:28:07.876723] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:28:07.884698] [INFO ] [REMOTE ] DV: Full fetch complete (73182 records). [2025-09-19T18:28:07.884830] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-19T18:28:08.322149] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-19T18:28:08.322287] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-19T18:28:08.323189] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-19T18:28:08.323255] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-19T18:28:08.324872] [DEBUG] [LOCAL ] DV: Trimmed 73182 records to 52057 (keeping 200 days of data) [2025-09-19T18:28:08.644180] [DEBUG] [LOCAL ] DV: Primary data saved (52057 records). [2025-09-19T18:28:08.644354] [INFO ] [MAIN ] DV: Full history saved. [2025-09-19T18:28:08.644554] [INFO ] [MAIN ] Update Progress: 667/2372 symbols completed. DV took 28.5s. Estimated remaining: 3h 45m 8s. Rate: 7.6 symbols/min [2025-09-19T18:28:08.644045] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-19T18:28:08.825931] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:08.918336] [DEBUG] [LOCAL ] DXC: Loaded 49827 existing records from primary storage. [2025-09-19T18:28:08.917262] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:28:08.930992] [INFO ] [MAIN ] DXC: Loaded 49827 existing records. [2025-09-19T18:28:09.118537] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:09.118866] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-19T18:28:09.118923] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-19T18:28:09.120042] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-19T18:28:09.120106] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-19T18:28:09.448351] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-19T18:28:09.486957] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:09.838964] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:28:10.243236] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-19T18:28:10.295525] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T18:28:11.043263] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-19T18:28:11.219728] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:28:11.843276] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-19T18:28:11.879580] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T18:28:12.380169] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T18:28:12.643267] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-19T18:28:13.443326] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-19T18:28:13.586857] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T18:28:13.731162] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:28:14.243307] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-19T18:28:15.043303] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-19T18:28:15.450852] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T18:28:15.843269] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-19T18:28:16.115242] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:28:16.643287] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-19T18:28:17.443254] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-19T18:28:17.593269] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-19T18:28:17.709994] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T18:28:17.819466] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T18:28:18.243263] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-19T18:28:19.043325] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-19T18:28:19.190330] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T18:28:19.843317] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-19T18:28:20.376563] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T18:28:20.643330] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-19T18:28:20.998849] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-19T18:28:21.443324] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-19T18:28:21.781822] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T18:28:21.885122] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T18:28:22.243336] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-19T18:28:23.043291] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-19T18:28:23.153581] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T18:28:23.843321] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-19T18:28:24.251085] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T18:28:24.315426] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:28:24.321952] [INFO ] [REMOTE ] DVA: Full fetch complete (59737 records). [2025-09-19T18:28:24.322136] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-19T18:28:24.655448] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-19T18:28:24.715414] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-19T18:28:24.715522] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-19T18:28:24.716421] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-19T18:28:24.716493] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-19T18:28:24.717982] [DEBUG] [LOCAL ] DVA: Trimmed 59737 records to 42344 (keeping 200 days of data) [2025-09-19T18:28:24.973845] [DEBUG] [LOCAL ] DVA: Primary data saved (42344 records). [2025-09-19T18:28:24.973984] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-19T18:28:24.974072] [INFO ] [MAIN ] Update Progress: 668/2372 symbols completed. DVA took 32.9s. Estimated remaining: 3h 45m 22s. Rate: 7.6 symbols/min [2025-09-19T18:28:25.144707] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:25.180861] [DEBUG] [LOCAL ] DXYZ: Loaded 37029 existing records from primary storage. [2025-09-19T18:28:25.181016] [INFO ] [MAIN ] DXYZ: Loaded 37029 existing records. [2025-09-19T18:28:25.361218] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:25.361511] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-19T18:28:25.361561] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-19T18:28:25.362475] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-19T18:28:25.362537] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-19T18:28:25.451369] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-19T18:28:25.717249] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:26.248919] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-19T18:28:26.268811] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-19T18:28:26.609600] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T18:28:26.813638] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T18:28:27.043259] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-19T18:28:27.843298] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-19T18:28:28.654451] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-19T18:28:28.660308] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T18:28:29.147954] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-19T18:28:29.443311] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-19T18:28:30.250598] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-19T18:28:30.257438] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T18:28:30.658495] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T18:28:30.886217] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T18:28:31.043271] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-19T18:28:31.843341] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-19T18:28:32.169716] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T18:28:32.434401] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T18:28:32.643351] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-19T18:28:33.434005] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:28:33.449360] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-19T18:28:34.243318] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-19T18:28:34.875228] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T18:28:34.883840] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-19T18:28:34.884051] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-19T18:28:35.052390] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-19T18:28:35.295890] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-19T18:28:35.295974] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-19T18:28:35.296880] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-19T18:28:35.296958] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-19T18:28:35.298483] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54479 (keeping 200 days of data) [2025-09-19T18:28:35.548792] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T18:28:35.678248] [DEBUG] [LOCAL ] DVN: Primary data saved (54479 records). [2025-09-19T18:28:35.678396] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-19T18:28:35.678484] [INFO ] [MAIN ] Update Progress: 669/2372 symbols completed. DVN took 35.3s. Estimated remaining: 3h 45m 21s. Rate: 7.6 symbols/min [2025-09-19T18:28:35.848387] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-19T18:28:35.850496] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:35.851679] [DEBUG] [LOCAL ] DY: No existing data file found in primary storage. [2025-09-19T18:28:35.851741] [WARN ] [MAIN ] DY: No existing data found, performing full refresh instead. [2025-09-19T18:28:35.851932] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-19T18:28:35.851985] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-19T18:28:35.852028] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-09-19T18:28:35.852076] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-19T18:28:36.214560] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:36.384482] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T18:28:36.576325] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T18:28:36.643217] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-19T18:28:37.443262] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-19T18:28:37.537616] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T18:28:38.243259] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-19T18:28:38.662886] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T18:28:38.670446] [INFO ] [REMOTE ] DXC: Full fetch complete (68372 records). [2025-09-19T18:28:38.670596] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-19T18:28:39.047499] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-19T18:28:39.070063] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-19T18:28:39.070201] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-19T18:28:39.071169] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-19T18:28:39.071244] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-19T18:28:39.076843] [DEBUG] [LOCAL ] DXC: Trimmed 68372 records to 50193 (keeping 200 days of data) [2025-09-19T18:28:39.371082] [DEBUG] [LOCAL ] DXC: Primary data saved (50193 records). [2025-09-19T18:28:39.371217] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-19T18:28:39.373676] [INFO ] [MAIN ] Update Progress: 670/2372 symbols completed. DXC took 30.7s. Estimated remaining: 3h 45m 2s. Rate: 7.6 symbols/min [2025-09-19T18:28:39.546447] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:39.584124] [DEBUG] [LOCAL ] E: Loaded 33908 existing records from primary storage. [2025-09-19T18:28:39.584270] [INFO ] [MAIN ] E: Loaded 33908 existing records. [2025-09-19T18:28:39.769326] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:39.770062] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-19T18:28:39.770200] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-19T18:28:39.771090] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-19T18:28:39.771151] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-19T18:28:39.951255] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-19T18:28:40.065137] [INFO ] [REMOTE ] DX: Full fetch complete (75234 records). [2025-09-19T18:28:40.096222] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-19T18:28:40.275749] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:40.286957] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-19T18:28:40.554149] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T18:28:40.622256] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-19T18:28:40.622341] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-19T18:28:40.626462] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-19T18:28:40.626781] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-19T18:28:40.643264] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-19T18:28:40.654997] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T18:28:40.662889] [DEBUG] [LOCAL ] DX: Trimmed 75234 records to 53245 (keeping 200 days of data) [2025-09-19T18:28:41.007412] [DEBUG] [LOCAL ] DX: Primary data saved (53245 records). [2025-09-19T18:28:41.007572] [INFO ] [MAIN ] DX: Full history saved. [2025-09-19T18:28:41.007726] [INFO ] [MAIN ] Update Progress: 671/2372 symbols completed. DX took 37.0s. Estimated remaining: 3h 44m 38s. Rate: 7.6 symbols/min [2025-09-19T18:28:41.204959] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:41.250504] [DEBUG] [LOCAL ] EAF: Loaded 44503 existing records from primary storage. [2025-09-19T18:28:41.250672] [INFO ] [MAIN ] EAF: Loaded 44503 existing records. [2025-09-19T18:28:41.448434] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-19T18:28:41.457872] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:41.459693] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-19T18:28:41.459784] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-19T18:28:41.460999] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-19T18:28:41.461108] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-19T18:28:41.840971] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:42.164633] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T18:28:42.243268] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-19T18:28:42.872904] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T18:28:43.043269] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-19T18:28:43.114909] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:28:43.241468] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:28:43.843271] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-19T18:28:44.643245] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-19T18:28:45.110416] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T18:28:45.188994] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-19T18:28:45.443283] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-19T18:28:45.629248] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T18:28:46.243309] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-19T18:28:47.043275] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-19T18:28:47.471152] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T18:28:47.843262] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-19T18:28:48.024329] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:28:48.643283] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-19T18:28:48.843067] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T18:28:49.443275] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-19T18:28:49.799524] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T18:28:50.243302] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-19T18:28:50.373193] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:28:50.681008] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T18:28:51.043281] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-19T18:28:51.843266] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-19T18:28:52.108402] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:28:52.643271] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-19T18:28:52.875276] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T18:28:53.091296] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T18:28:53.096792] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58333 records). [2025-09-19T18:28:53.096925] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-19T18:28:53.451550] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-19T18:28:53.509373] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-19T18:28:53.509479] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-19T18:28:53.510350] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-19T18:28:53.510415] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-19T18:28:53.514794] [DEBUG] [LOCAL ] DXYZ: Trimmed 58333 records to 37323 (keeping 200 days of data) [2025-09-19T18:28:53.747544] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37323 records). [2025-09-19T18:28:53.747746] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-19T18:28:53.747897] [INFO ] [MAIN ] Update Progress: 672/2372 symbols completed. DXYZ took 28.8s. Estimated remaining: 3h 44m 42s. Rate: 7.6 symbols/min [2025-09-19T18:28:53.926418] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:53.935739] [DEBUG] [LOCAL ] EAI: Loaded 4051 existing records from primary storage. [2025-09-19T18:28:53.935853] [INFO ] [MAIN ] EAI: Loaded 4051 existing records. [2025-09-19T18:28:54.123050] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:54.123786] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-19T18:28:54.123900] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-19T18:28:54.124605] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-19T18:28:54.124835] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-19T18:28:54.248226] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-19T18:28:54.415388] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:28:54.573154] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:55.043293] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-19T18:28:55.433636] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:28:55.843279] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-19T18:28:55.900413] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:28:56.290660] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T18:28:56.643286] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-19T18:28:57.443291] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-19T18:28:57.470033] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T18:28:57.959478] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T18:28:58.243270] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-19T18:28:59.043285] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-19T18:28:59.449936] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T18:28:59.843271] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-19T18:29:00.153921] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T18:29:00.643327] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-19T18:29:00.755953] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T18:29:01.443286] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-19T18:29:01.864932] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T18:29:02.243278] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-19T18:29:02.402780] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T18:29:02.407288] [INFO ] [REMOTE ] DY: Full fetch complete (44944 records). [2025-09-19T18:29:02.407391] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-19T18:29:02.787946] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-19T18:29:02.788165] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-19T18:29:02.788986] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-19T18:29:02.789077] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-19T18:29:02.790518] [DEBUG] [LOCAL ] DY: Trimmed 44944 records to 30563 (keeping 200 days of data) [2025-09-19T18:29:02.815618] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T18:29:03.014251] [DEBUG] [LOCAL ] DY: Primary data saved (30563 records). [2025-09-19T18:29:03.014393] [INFO ] [MAIN ] DY: Full history saved. [2025-09-19T18:29:03.014507] [INFO ] [MAIN ] Update Progress: 673/2372 symbols completed. DY took 27.3s. Estimated remaining: 3h 44m 38s. Rate: 7.6 symbols/min [2025-09-19T18:29:03.047236] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-19T18:29:03.200251] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:03.196924] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T18:29:03.235417] [DEBUG] [LOCAL ] EARN: Loaded 30975 existing records from primary storage. [2025-09-19T18:29:03.235556] [INFO ] [MAIN ] EARN: Loaded 30975 existing records. [2025-09-19T18:29:03.421448] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:03.421763] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-19T18:29:03.421819] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-19T18:29:03.422630] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-19T18:29:03.422722] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-19T18:29:03.783252] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:03.843212] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-19T18:29:04.643271] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-19T18:29:04.669263] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:29:05.244289] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T18:29:05.355768] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T18:29:05.443261] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-19T18:29:06.243259] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-19T18:29:06.685589] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T18:29:06.694005] [INFO ] [REMOTE ] E: Full fetch complete (48602 records). [2025-09-19T18:29:06.694205] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-19T18:29:07.048362] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-19T18:29:07.118428] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-19T18:29:07.118683] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-19T18:29:07.119373] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-19T18:29:07.119496] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-19T18:29:07.120550] [DEBUG] [LOCAL ] E: Trimmed 48602 records to 34114 (keeping 200 days of data) [2025-09-19T18:29:07.352744] [DEBUG] [LOCAL ] E: Primary data saved (34114 records). [2025-09-19T18:29:07.352927] [INFO ] [MAIN ] E: Full history saved. [2025-09-19T18:29:07.353759] [INFO ] [MAIN ] Update Progress: 674/2372 symbols completed. E took 28.0s. Estimated remaining: 3h 44m 21s. Rate: 7.6 symbols/min [2025-09-19T18:29:07.537695] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:07.600058] [DEBUG] [LOCAL ] EAT: Loaded 50215 existing records from primary storage. [2025-09-19T18:29:07.600214] [INFO ] [MAIN ] EAT: Loaded 50215 existing records. [2025-09-19T18:29:07.799887] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:07.805685] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-19T18:29:07.806673] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T18:29:07.806807] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-19T18:29:07.810292] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-19T18:29:07.810381] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-19T18:29:07.849242] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-19T18:29:08.173371] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T18:29:08.223740] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:08.643268] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-19T18:29:08.707390] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:29:09.443280] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-19T18:29:10.243269] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-19T18:29:10.645011] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T18:29:10.697319] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-19T18:29:11.043310] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-19T18:29:11.371191] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T18:29:11.843296] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-19T18:29:12.643268] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-19T18:29:12.800569] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T18:29:13.289133] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:29:13.443272] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-19T18:29:14.165420] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T18:29:14.243320] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-19T18:29:15.043278] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-19T18:29:15.355106] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:29:15.843264] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-19T18:29:16.213107] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T18:29:16.505074] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:29:16.505329] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-19T18:29:16.643302] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-19T18:29:17.443269] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-19T18:29:17.979685] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T18:29:18.243269] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-19T18:29:19.043265] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-19T18:29:19.399151] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T18:29:19.491893] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T18:29:19.783679] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T18:29:19.843270] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-19T18:29:20.643296] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-19T18:29:20.975760] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T18:29:21.443260] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-19T18:29:21.957271] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T18:29:21.961946] [INFO ] [REMOTE ] EAF: Full fetch complete (64953 records). [2025-09-19T18:29:21.962096] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-19T18:29:21.963054] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:29:21.963168] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:29:21.963212] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:29:21.963278] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-19T18:29:21.963348] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-19T18:29:21.963385] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-09-19T18:29:21.963819] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-09-19T18:29:21.963939] [INFO ] [MAIN ] Update Progress: 675/2372 symbols completed. EAF took 41.0s. Estimated remaining: 3h 44m 30s. Rate: 7.6 symbols/min [2025-09-19T18:29:22.137021] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:22.178897] [DEBUG] [LOCAL ] EB: Loaded 38499 existing records from primary storage. [2025-09-19T18:29:22.179038] [INFO ] [MAIN ] EB: Loaded 38499 existing records. [2025-09-19T18:29:22.243972] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-19T18:29:22.303429] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T18:29:22.403544] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:22.403934] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-19T18:29:22.404029] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-19T18:29:22.405188] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-19T18:29:22.405252] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-19T18:29:22.796790] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:23.043276] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-19T18:29:23.691158] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T18:29:23.719866] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T18:29:23.843266] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-19T18:29:24.643568] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-19T18:29:24.814403] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T18:29:24.816207] [INFO ] [REMOTE ] EAI: Full fetch complete (6185 records). [2025-09-19T18:29:24.816303] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-19T18:29:25.331542] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-19T18:29:25.331674] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-19T18:29:25.331930] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-19T18:29:25.332005] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-19T18:29:25.332735] [DEBUG] [LOCAL ] EAI: Trimmed 6185 records to 4060 (keeping 200 days of data) [2025-09-19T18:29:25.363535] [DEBUG] [LOCAL ] EAI: Primary data saved (4060 records). [2025-09-19T18:29:25.363749] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-19T18:29:25.363866] [INFO ] [MAIN ] Update Progress: 676/2372 symbols completed. EAI took 31.6s. Estimated remaining: 3h 44m 10s. Rate: 7.6 symbols/min [2025-09-19T18:29:25.448477] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-19T18:29:25.543486] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:25.563812] [DEBUG] [LOCAL ] EBF: Loaded 19811 existing records from primary storage. [2025-09-19T18:29:25.563984] [INFO ] [MAIN ] EBF: Loaded 19811 existing records. [2025-09-19T18:29:25.744608] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:25.744887] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-19T18:29:25.744955] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-19T18:29:25.745525] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-19T18:29:25.745585] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-19T18:29:26.071562] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T18:29:26.130260] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:26.243221] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-19T18:29:27.043264] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-19T18:29:27.471006] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T18:29:27.843276] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-19T18:29:28.129357] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-19T18:29:28.621401] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T18:29:28.643214] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-19T18:29:28.962088] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:29:29.443268] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-19T18:29:29.820415] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T18:29:30.243304] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-19T18:29:30.612917] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:29:31.043300] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-19T18:29:31.536513] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T18:29:31.540215] [INFO ] [REMOTE ] EARN: Full fetch complete (46689 records). [2025-09-19T18:29:31.540313] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-19T18:29:31.541005] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:29:31.541098] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:29:31.541161] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:29:31.541200] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-19T18:29:31.541259] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-19T18:29:31.541296] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-09-19T18:29:31.541729] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-09-19T18:29:31.541828] [INFO ] [MAIN ] Update Progress: 677/2372 symbols completed. EARN took 28.5s. Estimated remaining: 3h 43m 58s. Rate: 7.6 symbols/min [2025-09-19T18:29:31.843267] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-19T18:29:32.216304] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:29:32.643275] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-19T18:29:33.443269] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-19T18:29:33.840347] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T18:29:34.243241] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-19T18:29:34.422210] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T18:29:34.778007] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T18:29:35.043282] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-19T18:29:35.843247] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-19T18:29:35.940728] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T18:29:36.111493] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:29:36.643270] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-19T18:29:37.362965] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T18:29:37.443228] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-19T18:29:38.243277] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-19T18:29:38.354116] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T18:29:39.043264] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-19T18:29:39.284277] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T18:29:39.843283] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-19T18:29:40.299205] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:29:40.563116] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T18:29:40.643220] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-19T18:29:40.909789] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T18:29:41.443261] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-19T18:29:42.251173] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-19T18:29:42.253922] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T18:29:42.329376] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T18:29:43.043269] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-19T18:29:43.843291] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-19T18:29:44.060691] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T18:29:44.513432] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T18:29:44.643296] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-19T18:29:45.261849] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T18:29:45.269277] [INFO ] [REMOTE ] EAT: Full fetch complete (71714 records). [2025-09-19T18:29:45.269459] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-19T18:29:45.443314] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-19T18:29:45.589603] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T18:29:45.609740] [INFO ] [REMOTE ] EBF: Full fetch complete (27283 records). [2025-09-19T18:29:45.620088] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-19T18:29:45.807448] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-19T18:29:45.807833] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-19T18:29:45.808814] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-19T18:29:45.814264] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-19T18:29:45.869385] [DEBUG] [LOCAL ] EAT: Trimmed 71714 records to 50594 (keeping 200 days of data) [2025-09-19T18:29:46.194063] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-19T18:29:46.200177] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-19T18:29:46.204672] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-19T18:29:46.207224] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-19T18:29:46.215792] [DEBUG] [LOCAL ] EBF: Trimmed 27283 records to 19927 (keeping 200 days of data) [2025-09-19T18:29:46.529846] [DEBUG] [LOCAL ] EAT: Primary data saved (50594 records). [2025-09-19T18:29:46.530521] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-19T18:29:46.533187] [INFO ] [MAIN ] Update Progress: 678/2372 symbols completed. EAT took 39.2s. Estimated remaining: 3h 44m 8s. Rate: 7.6 symbols/min [2025-09-19T18:29:46.533315] [DEBUG] [LOCAL ] EBF: Primary data saved (19927 records). [2025-09-19T18:29:46.533540] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-19T18:29:46.533617] [INFO ] [MAIN ] Update Progress: 679/2372 symbols completed. EBF took 21.2s. Estimated remaining: 3h 43m 40s. Rate: 7.6 symbols/min [2025-09-19T18:29:47.176634] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:29:47.185142] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-19T18:29:48.717732] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:29:48.722899] [INFO ] [REMOTE ] EB: Full fetch complete (57239 records). [2025-09-19T18:29:48.723013] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-19T18:29:49.113950] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-19T18:29:49.114035] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-19T18:29:49.114938] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-19T18:29:49.115005] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-19T18:29:49.116277] [DEBUG] [LOCAL ] EB: Trimmed 57239 records to 38768 (keeping 200 days of data) [2025-09-19T18:29:49.334032] [DEBUG] [LOCAL ] EB: Primary data saved (38768 records). [2025-09-19T18:29:49.334214] [INFO ] [MAIN ] EB: Full history saved. [2025-09-19T18:29:49.334312] [INFO ] [MAIN ] Update Progress: 680/2372 symbols completed. EB took 27.4s. Estimated remaining: 3h 43m 19s. Rate: 7.6 symbols/min [2025-09-19T18:29:50.002288] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:49.994103] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:50.019593] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:50.031173] [DEBUG] [LOCAL ] EBR: No existing data file found in primary storage. [2025-09-19T18:29:50.053450] [WARN ] [MAIN ] EBR: No existing data found, performing full refresh instead. [2025-09-19T18:29:50.084293] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:50.085252] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-19T18:29:50.085378] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-19T18:29:50.085447] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-19T18:29:50.085484] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-19T18:29:50.406278] [DEBUG] [LOCAL ] ECAT: Loaded 30165 existing records from primary storage. [2025-09-19T18:29:50.424512] [INFO ] [MAIN ] ECAT: Loaded 30165 existing records. [2025-09-19T18:29:50.503775] [DEBUG] [LOCAL ] EBS: Loaded 47331 existing records from primary storage. [2025-09-19T18:29:50.544314] [DEBUG] [LOCAL ] EC: Loaded 49826 existing records from primary storage. [2025-09-19T18:29:50.543536] [INFO ] [MAIN ] EBS: Loaded 47331 existing records. [2025-09-19T18:29:50.592670] [INFO ] [MAIN ] EC: Loaded 49826 existing records. [2025-09-19T18:29:50.681500] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:50.764403] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-19T18:29:51.012881] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:51.047682] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:51.081398] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-19T18:29:51.081339] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-19T18:29:51.081500] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-19T18:29:51.103218] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-19T18:29:51.119705] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-19T18:29:51.125440] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-19T18:29:51.136939] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-19T18:29:51.125580] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:51.152042] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-19T18:29:51.183281] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-19T18:29:51.212543] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-19T18:29:51.249638] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-19T18:29:51.275478] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-19T18:29:52.143878] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:52.176565] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-19T18:29:52.274986] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:52.282843] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-19T18:29:52.361530] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:52.362132] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-19T18:29:52.949817] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T18:29:52.960601] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-19T18:29:53.875435] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T18:29:53.881388] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-19T18:29:53.970293] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:29:53.983727] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-19T18:29:54.020393] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T18:29:54.030465] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-19T18:29:54.762138] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T18:29:54.772979] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-19T18:29:54.792207] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T18:29:54.802324] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-19T18:29:55.415859] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T18:29:55.426664] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-19T18:29:55.876014] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T18:29:55.885489] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-19T18:29:55.990546] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T18:29:56.316558] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T18:29:56.643263] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-19T18:29:57.242773] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:29:57.443270] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-19T18:29:57.615075] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T18:29:58.243273] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-19T18:29:58.411794] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:29:59.043285] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-19T18:29:59.338578] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:29:59.843275] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-19T18:29:59.877504] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:30:00.411637] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T18:30:00.643282] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-19T18:30:01.443307] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-19T18:30:01.518030] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T18:30:02.243254] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-19T18:30:02.736579] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T18:30:03.043296] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-19T18:30:03.843303] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-19T18:30:04.658446] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (3.22 seconds). [2025-09-19T18:30:04.668534] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-19T18:30:05.762225] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (3.52 seconds). [2025-09-19T18:30:05.772992] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-19T18:30:06.573716] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-19T18:30:06.584013] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-19T18:30:06.693072] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (3.65 seconds). [2025-09-19T18:30:06.736961] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T18:30:07.043269] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-19T18:30:07.843295] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-19T18:30:07.885049] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T18:30:07.939899] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T18:30:08.643273] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-19T18:30:08.910273] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:30:08.978244] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T18:30:09.443299] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-19T18:30:10.243277] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-19T18:30:10.739027] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:30:11.043316] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-19T18:30:11.237762] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T18:30:11.843269] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-19T18:30:12.000432] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T18:30:12.529868] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T18:30:12.643272] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-19T18:30:13.443302] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-19T18:30:13.756803] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T18:30:14.243273] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-19T18:30:14.274754] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T18:30:15.043285] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-19T18:30:15.843291] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-19T18:30:16.307429] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-19T18:30:16.643314] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-19T18:30:16.974187] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-19T18:30:17.125174] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T18:30:17.443313] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-19T18:30:17.969727] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T18:30:17.974932] [INFO ] [REMOTE ] ECAT: Full fetch complete (42241 records). [2025-09-19T18:30:17.975074] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-19T18:30:17.975923] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:30:17.976028] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:17.976072] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:17.976137] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-19T18:30:17.976216] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-19T18:30:17.976272] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-09-19T18:30:17.976733] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-09-19T18:30:17.976834] [INFO ] [MAIN ] Update Progress: 681/2372 symbols completed. ECAT took 28.6s. Estimated remaining: 3h 44m 3s. Rate: 7.5 symbols/min [2025-09-19T18:30:18.158860] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:18.208457] [DEBUG] [LOCAL ] ECC: Loaded 43720 existing records from primary storage. [2025-09-19T18:30:18.208613] [INFO ] [MAIN ] ECC: Loaded 43720 existing records. [2025-09-19T18:30:18.243553] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-19T18:30:18.406107] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:30:18.423838] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-19T18:30:18.423994] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-19T18:30:18.425455] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-19T18:30:18.425383] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T18:30:18.425697] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-19T18:30:18.511728] [INFO ] [REMOTE ] EBR: Full fetch complete (62487 records). [2025-09-19T18:30:18.523222] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-19T18:30:18.547485] [FATAL] [VALIDATOR ] EBR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:30:18.563369] [FATAL] [MAIN ] EBR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:18.573741] [WARN ] [MAIN ] EBR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:18.588503] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-19T18:30:18.609589] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-19T18:30:18.611347] [INFO ] [LOCAL ] EBR: Starting deletion of derivative data. [2025-09-19T18:30:18.625746] [DEBUG] [LOCAL ] EBR: No derivative data file found to delete. [2025-09-19T18:30:18.669320] [INFO ] [MAIN ] Update Progress: 682/2372 symbols completed. EBR took 29.3s. Estimated remaining: 3h 43m 37s. Rate: 7.6 symbols/min [2025-09-19T18:30:18.934803] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:19.023628] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:19.023908] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-19T18:30:19.024012] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-19T18:30:19.024351] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-19T18:30:19.024515] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-19T18:30:19.024604] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-19T18:30:19.024824] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-19T18:30:19.052328] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-19T18:30:19.135416] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T18:30:19.173550] [INFO ] [REMOTE ] EC: Full fetch complete (71992 records). [2025-09-19T18:30:19.189170] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-19T18:30:19.615848] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:19.850189] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-19T18:30:19.875407] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-19T18:30:19.875530] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-19T18:30:19.876530] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-19T18:30:19.876601] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-19T18:30:19.878457] [DEBUG] [LOCAL ] EC: Trimmed 71992 records to 50191 (keeping 200 days of data) [2025-09-19T18:30:20.181091] [DEBUG] [LOCAL ] EC: Primary data saved (50191 records). [2025-09-19T18:30:20.181311] [INFO ] [MAIN ] EC: Full history saved. [2025-09-19T18:30:20.181689] [INFO ] [MAIN ] Update Progress: 683/2372 symbols completed. EC took 30.8s. Estimated remaining: 3h 43m 13s. Rate: 7.6 symbols/min [2025-09-19T18:30:20.356630] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:20.356981] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-19T18:30:20.357173] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-19T18:30:20.357425] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-19T18:30:20.357533] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-19T18:30:20.357616] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-19T18:30:20.357809] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-19T18:30:20.459522] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-19T18:30:20.510724] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T18:30:20.615054] [INFO ] [REMOTE ] EBS: Full fetch complete (67385 records). [2025-09-19T18:30:20.647485] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-19T18:30:20.641824] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-19T18:30:20.858794] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:21.138045] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T18:30:21.155929] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-19T18:30:21.156018] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-19T18:30:21.157110] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-19T18:30:21.157194] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-19T18:30:21.158864] [DEBUG] [LOCAL ] EBS: Trimmed 67385 records to 47661 (keeping 200 days of data) [2025-09-19T18:30:21.262402] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T18:30:21.452366] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-19T18:30:21.468568] [DEBUG] [LOCAL ] EBS: Primary data saved (47661 records). [2025-09-19T18:30:21.468818] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-19T18:30:21.468950] [INFO ] [MAIN ] Update Progress: 684/2372 symbols completed. EBS took 32.1s. Estimated remaining: 3h 42m 49s. Rate: 7.6 symbols/min [2025-09-19T18:30:21.699251] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:21.699458] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-19T18:30:21.699517] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-19T18:30:21.699705] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-19T18:30:21.699759] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-19T18:30:21.699803] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-19T18:30:21.699836] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-19T18:30:21.808551] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-19T18:30:22.082597] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:22.243314] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-19T18:30:23.043271] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-19T18:30:23.475128] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-19T18:30:23.539158] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:30:23.843304] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-19T18:30:24.298585] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-19T18:30:24.643281] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-19T18:30:24.944186] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-19T18:30:25.443268] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-19T18:30:26.243265] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-19T18:30:26.894417] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T18:30:27.043275] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-19T18:30:27.140370] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:30:27.398559] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-19T18:30:27.843284] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-19T18:30:28.221786] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T18:30:28.643306] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-19T18:30:29.343394] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T18:30:29.443266] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-19T18:30:30.243319] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-19T18:30:31.043288] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-19T18:30:31.130907] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T18:30:31.457576] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T18:30:31.537785] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T18:30:31.843295] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-19T18:30:32.643294] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-19T18:30:33.118444] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-19T18:30:33.443295] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-19T18:30:33.880536] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:30:34.217136] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T18:30:34.243288] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-19T18:30:34.713076] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T18:30:35.043317] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-19T18:30:35.522871] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-19T18:30:35.843313] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-19T18:30:36.643303] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-19T18:30:37.126857] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-19T18:30:37.443260] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-19T18:30:37.712967] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T18:30:37.906091] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-19T18:30:38.243271] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-19T18:30:39.043289] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-19T18:30:39.555497] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-19T18:30:39.853484] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-19T18:30:39.858911] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:30:40.245029] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T18:30:40.643261] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-19T18:30:41.443273] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-19T18:30:42.148252] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T18:30:42.243288] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-19T18:30:42.700799] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:30:42.771819] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-19T18:30:43.043269] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-19T18:30:43.578226] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T18:30:43.843260] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-19T18:30:44.159859] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-19T18:30:44.643293] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-19T18:30:45.443271] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-19T18:30:45.552514] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T18:30:45.553416] [INFO ] [REMOTE ] ECCU: Full fetch complete (4396 records). [2025-09-19T18:30:45.553488] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-19T18:30:45.553985] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:30:45.554081] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:45.554124] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:45.554167] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-19T18:30:45.554263] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-19T18:30:45.554318] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-19T18:30:45.554376] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-19T18:30:45.554452] [INFO ] [MAIN ] Update Progress: 685/2372 symbols completed. ECCU took 25.4s. Estimated remaining: 3h 43m 21s. Rate: 7.6 symbols/min [2025-09-19T18:30:45.723356] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:45.723546] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-19T18:30:45.723590] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-19T18:30:45.723754] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-19T18:30:45.723800] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-19T18:30:45.723841] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-19T18:30:45.723873] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-19T18:30:46.078807] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:46.110793] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T18:30:46.111659] [INFO ] [REMOTE ] ECCC: Full fetch complete (1286 records). [2025-09-19T18:30:46.111735] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-19T18:30:46.251221] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-19T18:30:46.293311] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-19T18:30:46.293500] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:46.293568] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:46.293661] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-19T18:30:46.293789] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-19T18:30:46.293847] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-19T18:30:46.293892] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-19T18:30:46.293949] [INFO ] [MAIN ] Update Progress: 686/2372 symbols completed. ECCC took 27.6s. Estimated remaining: 3h 42m 55s. Rate: 7.6 symbols/min [2025-09-19T18:30:46.478587] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:46.515064] [DEBUG] [LOCAL ] ECG: Loaded 34945 existing records from primary storage. [2025-09-19T18:30:46.515211] [INFO ] [MAIN ] ECG: Loaded 34945 existing records. [2025-09-19T18:30:46.698698] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:30:46.699047] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-19T18:30:46.699105] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-19T18:30:46.700364] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-19T18:30:46.700426] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-19T18:30:46.806095] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-19T18:30:47.049168] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-19T18:30:47.073295] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:47.843288] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-19T18:30:48.357534] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T18:30:48.643260] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-19T18:30:48.867772] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T18:30:48.985757] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-19T18:30:49.443297] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-19T18:30:50.243269] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-19T18:30:50.707772] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-19T18:30:51.043241] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-19T18:30:51.133984] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:30:51.341944] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-19T18:30:51.843274] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-19T18:30:52.266863] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-19T18:30:52.643263] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-19T18:30:53.443308] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-19T18:30:54.009104] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T18:30:54.243318] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-19T18:30:54.748001] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T18:30:54.750334] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T18:30:54.756758] [INFO ] [REMOTE ] ECC: Full fetch complete (61070 records). [2025-09-19T18:30:54.756924] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-19T18:30:55.048322] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-19T18:30:55.168913] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-19T18:30:55.169009] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-19T18:30:55.169857] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-19T18:30:55.169923] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-19T18:30:55.171297] [DEBUG] [LOCAL ] ECC: Trimmed 61070 records to 44039 (keeping 200 days of data) [2025-09-19T18:30:55.444515] [DEBUG] [LOCAL ] ECC: Primary data saved (44039 records). [2025-09-19T18:30:55.444668] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-19T18:30:55.444771] [INFO ] [MAIN ] Update Progress: 687/2372 symbols completed. ECC took 37.5s. Estimated remaining: 3h 42m 50s. Rate: 7.6 symbols/min [2025-09-19T18:30:55.618971] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:55.619153] [DEBUG] [LOCAL ] ECL: No existing data file found in primary storage. [2025-09-19T18:30:55.619209] [WARN ] [MAIN ] ECL: No existing data found, performing full refresh instead. [2025-09-19T18:30:55.619356] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-19T18:30:55.619400] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-19T18:30:55.619443] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-19T18:30:55.619475] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-19T18:30:55.850408] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-19T18:30:55.995878] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:56.353993] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T18:30:56.643255] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-19T18:30:57.056591] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T18:30:57.119947] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-19T18:30:57.443265] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-19T18:30:57.929058] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T18:30:57.929868] [INFO ] [REMOTE ] ECCW: Full fetch complete (1414 records). [2025-09-19T18:30:57.929938] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-19T18:30:58.107755] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-19T18:30:58.107943] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:58.108009] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:58.108081] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-19T18:30:58.108145] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-19T18:30:58.108180] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-19T18:30:58.108217] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-19T18:30:58.108274] [INFO ] [MAIN ] Update Progress: 688/2372 symbols completed. ECCW took 36.6s. Estimated remaining: 3h 42m 29s. Rate: 7.6 symbols/min [2025-09-19T18:30:58.251457] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-19T18:30:58.278008] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:58.296518] [DEBUG] [LOCAL ] ECO: Loaded 18799 existing records from primary storage. [2025-09-19T18:30:58.296827] [INFO ] [MAIN ] ECO: Loaded 18799 existing records. [2025-09-19T18:30:58.474158] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:30:58.474435] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-19T18:30:58.474482] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-19T18:30:58.475247] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-19T18:30:58.475336] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-19T18:30:58.830828] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:59.043293] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-19T18:30:59.843264] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-19T18:31:00.643280] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-19T18:31:01.940080] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T18:31:01.948693] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-19T18:31:03.540715] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (4.50 seconds). [2025-09-19T18:31:03.544030] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (5.29 seconds). [2025-09-19T18:31:03.549923] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-19T18:31:03.551378] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-19T18:31:03.787429] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T18:31:03.843234] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-19T18:31:03.976759] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-19T18:31:04.643264] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-19T18:31:05.173286] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T18:31:05.218638] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T18:31:05.219468] [INFO ] [REMOTE ] ECCX: Full fetch complete (1478 records). [2025-09-19T18:31:05.219537] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-19T18:31:05.462485] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-19T18:31:05.470244] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-19T18:31:05.472134] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:31:05.472354] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:31:05.472488] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-19T18:31:05.472702] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-19T18:31:05.472807] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-19T18:31:05.473058] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-19T18:31:05.473222] [INFO ] [MAIN ] Update Progress: 689/2372 symbols completed. ECCX took 19.9s. Estimated remaining: 3h 42m 20s. Rate: 7.6 symbols/min [2025-09-19T18:31:05.689160] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:05.691896] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T18:31:05.728824] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (5.09 seconds). [2025-09-19T18:31:05.774770] [DEBUG] [LOCAL ] ECVT: Loaded 43492 existing records from primary storage. [2025-09-19T18:31:05.774914] [INFO ] [MAIN ] ECVT: Loaded 43492 existing records. [2025-09-19T18:31:05.956725] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:05.957056] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-19T18:31:05.957141] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-19T18:31:05.958413] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-19T18:31:05.958478] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-19T18:31:06.243876] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-19T18:31:06.327950] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:06.715104] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T18:31:07.043259] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-19T18:31:07.843280] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-19T18:31:07.999143] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T18:31:08.352824] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:31:08.643297] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-19T18:31:09.406264] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:31:09.443249] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-19T18:31:10.243295] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-19T18:31:10.721006] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:31:11.043321] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-19T18:31:11.371719] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T18:31:11.601022] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:31:11.843296] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-19T18:31:12.643271] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-19T18:31:12.864019] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T18:31:13.443321] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-19T18:31:14.038735] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T18:31:14.197587] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T18:31:14.243231] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-19T18:31:14.850020] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T18:31:15.043283] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-19T18:31:15.843284] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-19T18:31:15.987273] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T18:31:16.077954] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T18:31:16.643300] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-19T18:31:17.409979] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T18:31:17.443276] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-19T18:31:17.843090] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:31:18.243306] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-19T18:31:18.440796] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:31:19.043325] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-19T18:31:19.257855] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T18:31:19.843241] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-19T18:31:20.286441] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T18:31:20.643317] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-19T18:31:21.443308] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-19T18:31:21.813615] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T18:31:21.822160] [INFO ] [REMOTE ] ECG: Full fetch complete (51746 records). [2025-09-19T18:31:21.822391] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-19T18:31:22.227621] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-19T18:31:22.227788] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-19T18:31:22.228987] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-19T18:31:22.229115] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-19T18:31:22.230733] [DEBUG] [LOCAL ] ECG: Trimmed 51746 records to 35132 (keeping 200 days of data) [2025-09-19T18:31:22.289128] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-19T18:31:22.372437] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T18:31:22.504761] [DEBUG] [LOCAL ] ECG: Primary data saved (35132 records). [2025-09-19T18:31:22.504917] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-19T18:31:22.505039] [INFO ] [MAIN ] Update Progress: 690/2372 symbols completed. ECG took 36.2s. Estimated remaining: 3h 42m 34s. Rate: 7.6 symbols/min [2025-09-19T18:31:22.676154] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:22.734293] [DEBUG] [LOCAL ] ED: Loaded 53213 existing records from primary storage. [2025-09-19T18:31:22.734468] [INFO ] [MAIN ] ED: Loaded 53213 existing records. [2025-09-19T18:31:22.916559] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:22.916828] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-19T18:31:22.916879] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-19T18:31:22.918887] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-19T18:31:22.918950] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-19T18:31:23.048474] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-19T18:31:23.299701] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:23.301145] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T18:31:23.305789] [INFO ] [REMOTE ] ECO: Full fetch complete (29567 records). [2025-09-19T18:31:23.305910] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-19T18:31:23.692958] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-19T18:31:23.693102] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-19T18:31:23.693751] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-19T18:31:23.693863] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-19T18:31:23.694931] [DEBUG] [LOCAL ] ECO: Trimmed 29567 records to 18901 (keeping 200 days of data) [2025-09-19T18:31:23.774373] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-19T18:31:23.847678] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-19T18:31:23.852848] [DEBUG] [LOCAL ] ECO: Primary data saved (18901 records). [2025-09-19T18:31:23.854001] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-19T18:31:23.854121] [INFO ] [MAIN ] Update Progress: 691/2372 symbols completed. ECO took 25.7s. Estimated remaining: 3h 42m 10s. Rate: 7.6 symbols/min [2025-09-19T18:31:24.041815] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:24.069484] [DEBUG] [LOCAL ] EDD: Loaded 27486 existing records from primary storage. [2025-09-19T18:31:24.069666] [INFO ] [MAIN ] EDD: Loaded 27486 existing records. [2025-09-19T18:31:24.253608] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:24.253962] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-19T18:31:24.254062] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-19T18:31:24.254768] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-19T18:31:24.254847] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-19T18:31:24.638752] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:24.643227] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-19T18:31:24.698681] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:31:25.443280] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-19T18:31:26.068419] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:31:26.243320] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-19T18:31:26.317711] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T18:31:27.043311] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-19T18:31:27.403073] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:31:27.843256] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-19T18:31:27.926556] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:31:28.174053] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T18:31:28.643362] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-19T18:31:29.198588] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T18:31:29.443247] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-19T18:31:29.867464] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:31:30.243286] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-19T18:31:31.043293] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-19T18:31:31.394206] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T18:31:31.458180] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T18:31:31.466226] [INFO ] [REMOTE ] ECL: Full fetch complete (67521 records). [2025-09-19T18:31:31.466396] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-19T18:31:31.851162] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-19T18:31:31.874333] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-19T18:31:31.874436] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-19T18:31:31.875315] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-19T18:31:31.875408] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-19T18:31:31.877483] [DEBUG] [LOCAL ] ECL: Trimmed 67521 records to 47444 (keeping 200 days of data) [2025-09-19T18:31:32.207717] [DEBUG] [LOCAL ] ECL: Primary data saved (47444 records). [2025-09-19T18:31:32.207958] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-19T18:31:32.208097] [INFO ] [MAIN ] Update Progress: 692/2372 symbols completed. ECL took 36.8s. Estimated remaining: 3h 42m 3s. Rate: 7.6 symbols/min [2025-09-19T18:31:32.390956] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:32.391175] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-09-19T18:31:32.391233] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-09-19T18:31:32.391433] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-19T18:31:32.391477] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-19T18:31:32.391530] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-09-19T18:31:32.391577] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-19T18:31:32.660752] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-19T18:31:32.831951] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:32.998685] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T18:31:33.443278] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-19T18:31:33.990181] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T18:31:34.243253] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-19T18:31:34.381797] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-19T18:31:34.959771] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T18:31:35.043216] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-19T18:31:35.171535] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T18:31:35.843258] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-19T18:31:35.920797] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:31:36.643274] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-19T18:31:37.429321] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T18:31:37.443224] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-19T18:31:37.508856] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T18:31:38.243289] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-19T18:31:38.797057] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T18:31:39.043306] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-19T18:31:39.843269] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-19T18:31:40.197474] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T18:31:40.507610] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T18:31:40.643297] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-19T18:31:41.075747] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:31:41.443283] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-19T18:31:41.892101] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T18:31:42.243286] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-19T18:31:42.314528] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T18:31:43.043265] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-19T18:31:43.843332] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-19T18:31:44.036567] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T18:31:44.043336] [INFO ] [REMOTE ] ECVT: Full fetch complete (59864 records). [2025-09-19T18:31:44.043456] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-19T18:31:44.438539] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-19T18:31:44.438687] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-19T18:31:44.439725] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-19T18:31:44.439821] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-19T18:31:44.454900] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:31:44.459583] [DEBUG] [LOCAL ] ECVT: Trimmed 59864 records to 43818 (keeping 200 days of data) [2025-09-19T18:31:44.460760] [INFO ] [REMOTE ] EDD: Full fetch complete (39270 records). [2025-09-19T18:31:44.460864] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-19T18:31:44.648085] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-19T18:31:44.723230] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T18:31:45.104576] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-19T18:31:45.104957] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-19T18:31:45.106051] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-19T18:31:45.106455] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-19T18:31:45.114445] [DEBUG] [LOCAL ] EDD: Trimmed 39270 records to 27679 (keeping 200 days of data) [2025-09-19T18:31:45.229537] [DEBUG] [LOCAL ] ECVT: Primary data saved (43818 records). [2025-09-19T18:31:45.230101] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-19T18:31:45.235675] [INFO ] [MAIN ] Update Progress: 693/2372 symbols completed. ECVT took 39.8s. Estimated remaining: 3h 42m 8s. Rate: 7.6 symbols/min [2025-09-19T18:31:45.418336] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:45.453186] [DEBUG] [LOCAL ] EDN: Loaded 17946 existing records from primary storage. [2025-09-19T18:31:45.449261] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-19T18:31:45.453950] [INFO ] [MAIN ] EDN: Loaded 17946 existing records. [2025-09-19T18:31:45.688306] [DEBUG] [LOCAL ] EDD: Primary data saved (27679 records). [2025-09-19T18:31:45.688573] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-19T18:31:45.688770] [INFO ] [MAIN ] Update Progress: 694/2372 symbols completed. EDD took 21.8s. Estimated remaining: 3h 41m 42s. Rate: 7.6 symbols/min [2025-09-19T18:31:45.688432] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:45.754083] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-19T18:31:45.765356] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-19T18:31:45.791639] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-19T18:31:45.791798] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-19T18:31:46.015631] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:46.265534] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:46.266185] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-19T18:31:46.297701] [DEBUG] [LOCAL ] EDU: Loaded 45632 existing records from primary storage. [2025-09-19T18:31:46.297864] [INFO ] [MAIN ] EDU: Loaded 45632 existing records. [2025-09-19T18:31:46.502510] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:46.512029] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-19T18:31:46.512102] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-19T18:31:46.519131] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-19T18:31:46.519273] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-19T18:31:46.587805] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T18:31:46.723606] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T18:31:46.906122] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:47.043249] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-19T18:31:47.438882] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T18:31:47.843275] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-19T18:31:48.643265] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-19T18:31:48.993059] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T18:31:49.443240] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-19T18:31:49.616440] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:31:49.869607] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T18:31:50.243268] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-19T18:31:51.043266] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-19T18:31:51.272063] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T18:31:51.843296] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-19T18:31:52.325712] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:31:52.347119] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T18:31:52.643269] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-19T18:31:53.443283] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-19T18:31:53.494721] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T18:31:53.616667] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:31:54.243275] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-19T18:31:54.639266] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:31:55.043288] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-19T18:31:55.843263] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-19T18:31:56.093422] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:31:56.428049] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:31:56.643267] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-19T18:31:56.729493] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T18:31:56.733342] [INFO ] [REMOTE ] EDF: Full fetch complete (21180 records). [2025-09-19T18:31:56.733480] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-19T18:31:57.104833] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-19T18:31:57.104912] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-19T18:31:57.105363] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-19T18:31:57.105425] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-19T18:31:57.106043] [DEBUG] [LOCAL ] EDF: Trimmed 21180 records to 13744 (keeping 200 days of data) [2025-09-19T18:31:57.184000] [DEBUG] [LOCAL ] EDF: Primary data saved (13744 records). [2025-09-19T18:31:57.184136] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-19T18:31:57.184226] [INFO ] [MAIN ] Update Progress: 695/2372 symbols completed. EDF took 25.0s. Estimated remaining: 3h 41m 42s. Rate: 7.6 symbols/min [2025-09-19T18:31:57.351817] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:57.392332] [DEBUG] [LOCAL ] EE: Loaded 32818 existing records from primary storage. [2025-09-19T18:31:57.392507] [INFO ] [MAIN ] EE: Loaded 32818 existing records. [2025-09-19T18:31:57.454320] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-19T18:31:57.573007] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:57.573456] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-19T18:31:57.573587] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-19T18:31:57.583600] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-19T18:31:57.584245] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-19T18:31:57.584599] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T18:31:57.936607] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:58.243234] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-19T18:31:59.043230] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-19T18:31:59.203723] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T18:31:59.790989] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T18:31:59.843247] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-19T18:31:59.966379] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T18:32:00.643263] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-19T18:32:01.421501] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T18:32:01.443223] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-19T18:32:01.794808] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T18:32:02.243268] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-19T18:32:02.640420] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T18:32:03.043270] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-19T18:32:03.843269] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-19T18:32:04.153340] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T18:32:04.177723] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:32:04.643256] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-19T18:32:05.438953] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-19T18:32:05.447245] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-19T18:32:05.812295] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T18:32:06.243251] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-19T18:32:07.043258] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-19T18:32:07.360807] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T18:32:07.604054] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:32:07.608060] [INFO ] [REMOTE ] EDN: Full fetch complete (30568 records). [2025-09-19T18:32:07.608141] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-19T18:32:07.855481] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-19T18:32:08.003254] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-19T18:32:08.003345] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-19T18:32:08.003951] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-19T18:32:08.004039] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-19T18:32:08.004826] [DEBUG] [LOCAL ] EDN: Trimmed 30568 records to 18158 (keeping 200 days of data) [2025-09-19T18:32:08.112453] [DEBUG] [LOCAL ] EDN: Primary data saved (18158 records). [2025-09-19T18:32:08.112603] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-19T18:32:08.112725] [INFO ] [MAIN ] Update Progress: 696/2372 symbols completed. EDN took 22.9s. Estimated remaining: 3h 41m 42s. Rate: 7.6 symbols/min [2025-09-19T18:32:08.285320] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:08.290159] [DEBUG] [LOCAL ] EEA: Loaded 2842 existing records from primary storage. [2025-09-19T18:32:08.290297] [INFO ] [MAIN ] EEA: Loaded 2842 existing records. [2025-09-19T18:32:08.491699] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:08.492070] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-19T18:32:08.492159] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-19T18:32:08.492456] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-19T18:32:08.492517] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-19T18:32:08.649724] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-19T18:32:08.871717] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:08.936171] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T18:32:09.443275] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-19T18:32:09.681395] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T18:32:09.770250] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:32:09.897604] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T18:32:10.243304] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-19T18:32:11.043291] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-19T18:32:11.426467] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T18:32:11.467391] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T18:32:11.843281] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-19T18:32:12.643306] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-19T18:32:13.173036] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T18:32:13.371359] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T18:32:13.443274] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-19T18:32:14.243327] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-19T18:32:14.638423] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T18:32:15.043327] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-19T18:32:15.448336] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-19T18:32:15.843306] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-19T18:32:16.021083] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T18:32:16.643305] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-19T18:32:17.443282] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-19T18:32:17.933837] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T18:32:17.941342] [INFO ] [REMOTE ] ED: Full fetch complete (75985 records). [2025-09-19T18:32:17.941481] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-19T18:32:17.942540] [FATAL] [VALIDATOR ] ED: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:32:17.942683] [FATAL] [MAIN ] ED: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:32:17.942757] [WARN ] [MAIN ] ED: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:32:17.942812] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-19T18:32:17.942876] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-09-19T18:32:17.942930] [INFO ] [LOCAL ] ED: Starting deletion of derivative data. [2025-09-19T18:32:17.943320] [DEBUG] [LOCAL ] ED: Deleted derivative data file. [2025-09-19T18:32:17.943467] [INFO ] [MAIN ] Update Progress: 697/2372 symbols completed. ED took 55.4s. Estimated remaining: 3h 41m 38s. Rate: 7.6 symbols/min [2025-09-19T18:32:18.120551] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:18.140724] [DEBUG] [LOCAL ] EEX: Loaded 12439 existing records from primary storage. [2025-09-19T18:32:18.140872] [INFO ] [MAIN ] EEX: Loaded 12439 existing records. [2025-09-19T18:32:18.251513] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T18:32:18.251164] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-19T18:32:18.369272] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:18.371935] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T18:32:18.372200] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-19T18:32:18.379284] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-19T18:32:18.380334] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-19T18:32:18.380402] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-19T18:32:18.733958] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:19.043273] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-19T18:32:19.819700] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:32:19.843243] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-19T18:32:20.468637] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T18:32:20.643323] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-19T18:32:21.443330] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-19T18:32:21.698924] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T18:32:21.709718] [INFO ] [REMOTE ] EDU: Full fetch complete (66304 records). [2025-09-19T18:32:21.709944] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-19T18:32:21.711104] [FATAL] [VALIDATOR ] EDU: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:32:21.711269] [FATAL] [MAIN ] EDU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:32:21.711333] [WARN ] [MAIN ] EDU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:32:21.711418] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-19T18:32:21.711511] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-09-19T18:32:21.711571] [INFO ] [LOCAL ] EDU: Starting deletion of derivative data. [2025-09-19T18:32:21.711977] [DEBUG] [LOCAL ] EDU: Deleted derivative data file. [2025-09-19T18:32:21.712111] [INFO ] [MAIN ] Update Progress: 698/2372 symbols completed. EDU took 36.0s. Estimated remaining: 3h 41m 20s. Rate: 7.6 symbols/min [2025-09-19T18:32:21.949279] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:22.008520] [DEBUG] [LOCAL ] EFC: Loaded 46603 existing records from primary storage. [2025-09-19T18:32:22.008709] [INFO ] [MAIN ] EFC: Loaded 46603 existing records. [2025-09-19T18:32:22.207357] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:22.207813] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-19T18:32:22.207992] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-19T18:32:22.209505] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-19T18:32:22.209585] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-19T18:32:22.253563] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-19T18:32:22.380596] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:32:22.624519] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:22.635848] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:32:23.000022] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T18:32:23.043311] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-19T18:32:23.534757] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-19T18:32:23.843271] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-19T18:32:24.643273] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-19T18:32:25.047690] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T18:32:25.443267] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-19T18:32:26.243263] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-19T18:32:26.545878] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T18:32:26.661362] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T18:32:26.841038] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T18:32:27.043266] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-19T18:32:27.843283] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-19T18:32:28.213044] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T18:32:28.643304] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-19T18:32:29.335971] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-19T18:32:29.337145] [INFO ] [REMOTE ] EEA: Full fetch complete (3985 records). [2025-09-19T18:32:29.337226] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-19T18:32:29.448439] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-19T18:32:29.467054] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:32:29.750894] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-19T18:32:29.750981] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-19T18:32:29.751112] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-19T18:32:29.751150] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-19T18:32:29.751524] [DEBUG] [LOCAL ] EEA: Trimmed 3985 records to 2853 (keeping 200 days of data) [2025-09-19T18:32:29.768758] [DEBUG] [LOCAL ] EEA: Primary data saved (2853 records). [2025-09-19T18:32:29.768876] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-19T18:32:29.768960] [INFO ] [MAIN ] Update Progress: 699/2372 symbols completed. EEA took 21.7s. Estimated remaining: 3h 41m 13s. Rate: 7.6 symbols/min [2025-09-19T18:32:29.953152] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:29.969022] [DEBUG] [LOCAL ] EFR: Loaded 14242 existing records from primary storage. [2025-09-19T18:32:29.969138] [INFO ] [MAIN ] EFR: Loaded 14242 existing records. [2025-09-19T18:32:30.146049] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:30.146340] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-19T18:32:30.146404] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-19T18:32:30.146938] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-19T18:32:30.147042] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-19T18:32:30.249549] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-19T18:32:30.522135] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:30.740189] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T18:32:31.043291] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-19T18:32:31.570412] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T18:32:31.575205] [INFO ] [REMOTE ] EE: Full fetch complete (43502 records). [2025-09-19T18:32:31.575293] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-19T18:32:31.851970] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-19T18:32:31.953844] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-19T18:32:31.953965] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-19T18:32:31.954726] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-19T18:32:31.954810] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-19T18:32:31.956180] [DEBUG] [LOCAL ] EE: Trimmed 43502 records to 33025 (keeping 200 days of data) [2025-09-19T18:32:32.149899] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T18:32:32.171435] [DEBUG] [LOCAL ] EE: Primary data saved (33025 records). [2025-09-19T18:32:32.171546] [INFO ] [MAIN ] EE: Full history saved. [2025-09-19T18:32:32.171628] [INFO ] [MAIN ] Update Progress: 700/2372 symbols completed. EE took 35.0s. Estimated remaining: 3h 40m 52s. Rate: 7.6 symbols/min [2025-09-19T18:32:32.350135] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:32.363980] [DEBUG] [LOCAL ] EFT: Loaded 12563 existing records from primary storage. [2025-09-19T18:32:32.364105] [INFO ] [MAIN ] EFT: Loaded 12563 existing records. [2025-09-19T18:32:32.539793] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:32.540065] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-19T18:32:32.540829] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-19T18:32:32.541233] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-19T18:32:32.541293] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-19T18:32:32.645292] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-19T18:32:32.911582] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:33.443242] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-19T18:32:33.861083] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T18:32:34.081529] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T18:32:34.243278] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-19T18:32:34.498629] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T18:32:35.043260] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-19T18:32:35.564670] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T18:32:35.843277] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-19T18:32:35.865586] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T18:32:36.643279] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-19T18:32:36.822150] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T18:32:37.443285] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-19T18:32:37.531631] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T18:32:38.243263] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-19T18:32:38.427737] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T18:32:39.043261] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-19T18:32:39.843314] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-19T18:32:39.914147] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:32:40.035487] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T18:32:40.643267] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-19T18:32:40.771772] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T18:32:41.443259] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-19T18:32:41.491162] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T18:32:42.243261] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-19T18:32:42.302709] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:32:43.043258] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-19T18:32:43.283048] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T18:32:43.843267] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-19T18:32:44.115030] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T18:32:44.643276] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-19T18:32:44.770398] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T18:32:45.443270] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-19T18:32:45.992387] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T18:32:46.243288] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-19T18:32:46.696411] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T18:32:47.043261] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-19T18:32:47.195293] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T18:32:47.197223] [INFO ] [REMOTE ] EEX: Full fetch complete (20139 records). [2025-09-19T18:32:47.197301] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-19T18:32:47.197933] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:32:47.198017] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:32:47.198075] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:32:47.198164] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-19T18:32:47.198265] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-19T18:32:47.198340] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-09-19T18:32:47.198870] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-09-19T18:32:47.199024] [INFO ] [MAIN ] Update Progress: 701/2372 symbols completed. EEX took 29.3s. Estimated remaining: 3h 41m 1s. Rate: 7.6 symbols/min [2025-09-19T18:32:47.368055] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:47.424103] [DEBUG] [LOCAL ] EFX: Loaded 45372 existing records from primary storage. [2025-09-19T18:32:47.424273] [INFO ] [MAIN ] EFX: Loaded 45372 existing records. [2025-09-19T18:32:47.600026] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:47.600316] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-19T18:32:47.600395] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-19T18:32:47.602240] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-19T18:32:47.602304] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-19T18:32:47.844726] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-19T18:32:47.995145] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:48.068788] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T18:32:48.643269] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-19T18:32:49.443240] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-19T18:32:49.819449] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:32:49.960779] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T18:32:50.243243] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-19T18:32:50.583087] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T18:32:51.043240] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-19T18:32:51.385960] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T18:32:51.843266] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-19T18:32:52.643273] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-19T18:32:53.097596] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T18:32:53.366050] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T18:32:53.443277] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-19T18:32:53.597517] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T18:32:54.243270] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-19T18:32:54.795377] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:32:55.043273] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-19T18:32:55.564549] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T18:32:55.843265] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-19T18:32:56.643310] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-19T18:32:56.951267] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T18:32:56.954185] [INFO ] [REMOTE ] EFR: Full fetch complete (18474 records). [2025-09-19T18:32:56.954302] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-19T18:32:57.344514] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-19T18:32:57.344727] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-19T18:32:57.345154] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-19T18:32:57.345227] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-19T18:32:57.368455] [DEBUG] [LOCAL ] EFR: Trimmed 18474 records to 14298 (keeping 200 days of data) [2025-09-19T18:32:57.370364] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T18:32:57.443871] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-19T18:32:57.466332] [DEBUG] [LOCAL ] EFR: Primary data saved (14298 records). [2025-09-19T18:32:57.466431] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-19T18:32:57.466511] [INFO ] [MAIN ] Update Progress: 702/2372 symbols completed. EFR took 27.7s. Estimated remaining: 3h 40m 58s. Rate: 7.6 symbols/min [2025-09-19T18:32:57.649307] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:57.678809] [DEBUG] [LOCAL ] EFXT: Loaded 29917 existing records from primary storage. [2025-09-19T18:32:57.678945] [INFO ] [MAIN ] EFXT: Loaded 29917 existing records. [2025-09-19T18:32:57.870249] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:57.870140] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:32:57.872884] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-19T18:32:57.872758] [INFO ] [REMOTE ] EFT: Full fetch complete (17399 records). [2025-09-19T18:32:57.872991] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-19T18:32:57.873071] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-19T18:32:57.904624] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-19T18:32:57.937095] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-19T18:32:58.270921] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-19T18:32:58.626955] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-19T18:32:58.626860] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:58.627107] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-19T18:32:58.627587] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-19T18:32:58.627703] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-19T18:32:58.628571] [DEBUG] [LOCAL ] EFT: Trimmed 17399 records to 12640 (keeping 200 days of data) [2025-09-19T18:32:58.715322] [DEBUG] [LOCAL ] EFT: Primary data saved (12640 records). [2025-09-19T18:32:58.715500] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-19T18:32:58.715764] [INFO ] [MAIN ] Update Progress: 703/2372 symbols completed. EFT took 26.5s. Estimated remaining: 3h 40m 34s. Rate: 7.6 symbols/min [2025-09-19T18:32:58.902466] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:58.931502] [DEBUG] [LOCAL ] EG: Loaded 29272 existing records from primary storage. [2025-09-19T18:32:58.931638] [INFO ] [MAIN ] EG: Loaded 29272 existing records. [2025-09-19T18:32:59.048385] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-19T18:32:59.132546] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:59.132904] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-19T18:32:59.132983] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-19T18:32:59.133858] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-19T18:32:59.133921] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-19T18:32:59.501285] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:59.529002] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T18:32:59.843268] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-19T18:33:00.230737] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T18:33:00.509282] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T18:33:00.643268] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-19T18:33:01.436179] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T18:33:01.445962] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-19T18:33:02.243311] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-19T18:33:03.048334] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-19T18:33:03.061589] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-19T18:33:03.843350] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-19T18:33:04.235549] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-09-19T18:33:04.643302] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-19T18:33:05.433715] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T18:33:05.440715] [INFO ] [REMOTE ] EFC: Full fetch complete (66026 records). [2025-09-19T18:33:05.440830] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-19T18:33:05.706030] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (3.46 seconds). [2025-09-19T18:33:05.771384] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-19T18:33:05.885681] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-19T18:33:05.885889] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-19T18:33:05.886767] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-19T18:33:05.886854] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-19T18:33:05.888781] [DEBUG] [LOCAL ] EFC: Trimmed 66026 records to 46929 (keeping 200 days of data) [2025-09-19T18:33:05.916778] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T18:33:06.211901] [DEBUG] [LOCAL ] EFC: Primary data saved (46929 records). [2025-09-19T18:33:06.212069] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-19T18:33:06.212193] [INFO ] [MAIN ] Update Progress: 704/2372 symbols completed. EFC took 44.5s. Estimated remaining: 3h 40m 25s. Rate: 7.6 symbols/min [2025-09-19T18:33:06.255571] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-19T18:33:06.386981] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:06.404012] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T18:33:06.457541] [DEBUG] [LOCAL ] EGO: Loaded 51775 existing records from primary storage. [2025-09-19T18:33:06.457706] [INFO ] [MAIN ] EGO: Loaded 51775 existing records. [2025-09-19T18:33:06.636059] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:06.636296] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-19T18:33:06.636343] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-19T18:33:06.637425] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-19T18:33:06.637485] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-19T18:33:06.995831] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:07.043226] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-19T18:33:07.615245] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T18:33:07.843268] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-19T18:33:08.637224] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T18:33:08.646686] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-19T18:33:09.116268] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-19T18:33:09.443262] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-19T18:33:09.535236] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T18:33:10.243292] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-19T18:33:10.349768] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:33:11.043304] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-19T18:33:11.197902] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T18:33:11.843272] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-19T18:33:12.184355] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:33:12.283096] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T18:33:12.643305] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-19T18:33:13.036673] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T18:33:13.443285] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-19T18:33:14.243292] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-19T18:33:15.043343] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-19T18:33:15.271956] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-19T18:33:15.474734] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T18:33:15.830569] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T18:33:15.843217] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-19T18:33:16.434224] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T18:33:16.643287] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-19T18:33:17.443243] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-19T18:33:17.548241] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T18:33:18.243258] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-19T18:33:18.686676] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T18:33:18.777139] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T18:33:19.043267] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-19T18:33:19.843272] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-19T18:33:20.129497] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:33:20.494434] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T18:33:20.643291] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-19T18:33:20.877330] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T18:33:21.443266] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-19T18:33:22.243297] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-19T18:33:22.619113] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:33:23.043296] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-19T18:33:23.355120] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T18:33:23.869351] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-19T18:33:23.883179] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T18:33:24.643319] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-19T18:33:24.840080] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T18:33:25.032729] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T18:33:25.443284] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-19T18:33:26.243291] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-19T18:33:26.634454] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T18:33:26.641415] [INFO ] [REMOTE ] EFX: Full fetch complete (64395 records). [2025-09-19T18:33:26.641597] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-19T18:33:26.848886] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T18:33:27.052575] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-19T18:33:27.075706] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-19T18:33:27.075787] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-19T18:33:27.076615] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-19T18:33:27.076862] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-19T18:33:27.078294] [DEBUG] [LOCAL ] EFX: Trimmed 64395 records to 45687 (keeping 200 days of data) [2025-09-19T18:33:27.349754] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T18:33:27.358437] [INFO ] [REMOTE ] EFXT: Full fetch complete (44195 records). [2025-09-19T18:33:27.359136] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-19T18:33:27.800695] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-19T18:33:27.801157] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-19T18:33:27.803534] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-19T18:33:27.803627] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-19T18:33:27.802485] [DEBUG] [LOCAL ] EFX: Primary data saved (45687 records). [2025-09-19T18:33:27.803960] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-19T18:33:27.804070] [INFO ] [MAIN ] Update Progress: 705/2372 symbols completed. EFX took 40.6s. Estimated remaining: 3h 40m 50s. Rate: 7.5 symbols/min [2025-09-19T18:33:27.845476] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-19T18:33:27.867752] [DEBUG] [LOCAL ] EFXT: Trimmed 44195 records to 30115 (keeping 200 days of data) [2025-09-19T18:33:28.080869] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:28.128244] [DEBUG] [LOCAL ] EGP: Loaded 31675 existing records from primary storage. [2025-09-19T18:33:28.128901] [INFO ] [MAIN ] EGP: Loaded 31675 existing records. [2025-09-19T18:33:28.372692] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:28.374029] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-19T18:33:28.374627] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-19T18:33:28.376134] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-19T18:33:28.376222] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-19T18:33:28.629379] [DEBUG] [LOCAL ] EFXT: Primary data saved (30115 records). [2025-09-19T18:33:28.637112] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-19T18:33:28.642456] [INFO ] [MAIN ] Update Progress: 706/2372 symbols completed. EFXT took 31.2s. Estimated remaining: 3h 40m 25s. Rate: 7.6 symbols/min [2025-09-19T18:33:28.905826] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:28.911451] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-19T18:33:28.973901] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T18:33:28.996736] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:28.998104] [INFO ] [REMOTE ] EG: Full fetch complete (44041 records). [2025-09-19T18:33:28.998240] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-19T18:33:29.320897] [DEBUG] [LOCAL ] EGY: Loaded 42731 existing records from primary storage. [2025-09-19T18:33:29.326736] [INFO ] [MAIN ] EGY: Loaded 42731 existing records. [2025-09-19T18:33:29.532940] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-19T18:33:29.538110] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-19T18:33:29.549385] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-19T18:33:29.549596] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-19T18:33:29.606303] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:29.607199] [DEBUG] [LOCAL ] EG: Trimmed 44041 records to 29471 (keeping 200 days of data) [2025-09-19T18:33:29.608098] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-19T18:33:29.608511] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-19T18:33:29.609633] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-19T18:33:29.609722] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-19T18:33:29.925831] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T18:33:30.082394] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-19T18:33:30.141032] [DEBUG] [LOCAL ] EG: Primary data saved (29471 records). [2025-09-19T18:33:30.142248] [INFO ] [MAIN ] EG: Full history saved. [2025-09-19T18:33:30.142830] [INFO ] [MAIN ] Update Progress: 707/2372 symbols completed. EG took 31.4s. Estimated remaining: 3h 40m 2s. Rate: 7.6 symbols/min [2025-09-19T18:33:30.312850] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:30.335191] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-19T18:33:30.409612] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:30.442990] [DEBUG] [LOCAL ] EHAB: Loaded 30421 existing records from primary storage. [2025-09-19T18:33:30.443140] [INFO ] [MAIN ] EHAB: Loaded 30421 existing records. [2025-09-19T18:33:30.631813] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:30.637471] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-19T18:33:30.637706] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-19T18:33:30.644344] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-19T18:33:30.654179] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-19T18:33:30.725140] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T18:33:31.025181] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:31.043225] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-19T18:33:31.675267] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:33:31.843270] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-19T18:33:32.162549] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T18:33:32.498219] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:33:32.643294] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-19T18:33:33.443266] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-19T18:33:33.501384] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T18:33:33.829234] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:33:34.243272] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-19T18:33:34.979039] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T18:33:35.043232] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-19T18:33:35.181604] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T18:33:35.843274] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-19T18:33:36.643277] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-19T18:33:36.745438] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:33:36.834475] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T18:33:37.443285] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-19T18:33:37.888022] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T18:33:38.243271] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-19T18:33:38.859346] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T18:33:38.867401] [INFO ] [REMOTE ] EGO: Full fetch complete (73259 records). [2025-09-19T18:33:38.867581] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-19T18:33:39.052469] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-19T18:33:39.274286] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-19T18:33:39.274386] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-19T18:33:39.275306] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-19T18:33:39.275385] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-19T18:33:39.276914] [DEBUG] [LOCAL ] EGO: Trimmed 73259 records to 52165 (keeping 200 days of data) [2025-09-19T18:33:39.419121] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T18:33:39.652915] [DEBUG] [LOCAL ] EGO: Primary data saved (52165 records). [2025-09-19T18:33:39.653211] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-19T18:33:39.654732] [INFO ] [MAIN ] Update Progress: 708/2372 symbols completed. EGO took 33.4s. Estimated remaining: 3h 39m 58s. Rate: 7.6 symbols/min [2025-09-19T18:33:39.831302] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:39.843298] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-19T18:33:39.899098] [DEBUG] [LOCAL ] EHC: Loaded 41881 existing records from primary storage. [2025-09-19T18:33:39.899265] [INFO ] [MAIN ] EHC: Loaded 41881 existing records. [2025-09-19T18:33:40.087175] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:40.087749] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-19T18:33:40.087892] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-19T18:33:40.097015] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-19T18:33:40.097132] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-19T18:33:40.144964] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T18:33:40.496837] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:40.643284] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-19T18:33:41.308399] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T18:33:41.443285] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-19T18:33:42.237032] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T18:33:42.244510] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-19T18:33:42.730694] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T18:33:43.043290] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-19T18:33:43.621271] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T18:33:43.843292] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-19T18:33:44.643263] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-19T18:33:44.748639] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T18:33:45.373150] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:33:45.443289] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-19T18:33:46.243275] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-19T18:33:46.800934] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T18:33:47.043270] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-19T18:33:47.338329] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T18:33:47.635419] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T18:33:47.843266] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-19T18:33:47.993589] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T18:33:48.643267] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-19T18:33:49.109937] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T18:33:49.443281] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-19T18:33:50.243279] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-19T18:33:50.825070] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T18:33:51.042260] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T18:33:51.044492] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-19T18:33:51.288843] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T18:33:51.843280] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-19T18:33:52.232046] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T18:33:52.643283] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-19T18:33:52.982803] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T18:33:53.443227] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-19T18:33:53.672302] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T18:33:53.676424] [INFO ] [REMOTE ] EHAB: Full fetch complete (41729 records). [2025-09-19T18:33:53.676559] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-19T18:33:54.055741] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-19T18:33:54.055845] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-19T18:33:54.056485] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-19T18:33:54.056531] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-19T18:33:54.058205] [DEBUG] [LOCAL ] EHAB: Trimmed 41729 records to 30600 (keeping 200 days of data) [2025-09-19T18:33:54.241894] [DEBUG] [LOCAL ] EHAB: Primary data saved (30600 records). [2025-09-19T18:33:54.242047] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-19T18:33:54.242181] [INFO ] [MAIN ] Update Progress: 709/2372 symbols completed. EHAB took 24.1s. Estimated remaining: 3h 40m 5s. Rate: 7.6 symbols/min [2025-09-19T18:33:54.248518] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-19T18:33:54.435206] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:54.435598] [DEBUG] [LOCAL ] EHI: No existing data file found in primary storage. [2025-09-19T18:33:54.435686] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-09-19T18:33:54.435895] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-19T18:33:54.435948] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-19T18:33:54.435993] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-09-19T18:33:54.436100] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-19T18:33:54.792440] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:55.043250] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-19T18:33:55.231555] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:33:55.819857] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T18:33:55.843222] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-19T18:33:56.355725] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T18:33:56.643267] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-19T18:33:57.443265] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-19T18:33:57.648792] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T18:33:57.653853] [INFO ] [REMOTE ] EGP: Full fetch complete (45198 records). [2025-09-19T18:33:57.653947] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-19T18:33:58.070372] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-19T18:33:58.070524] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-19T18:33:58.071215] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-19T18:33:58.071279] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-19T18:33:58.072372] [DEBUG] [LOCAL ] EGP: Trimmed 45198 records to 31908 (keeping 200 days of data) [2025-09-19T18:33:58.244757] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-19T18:33:58.288368] [DEBUG] [LOCAL ] EGP: Primary data saved (31908 records). [2025-09-19T18:33:58.288521] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-19T18:33:58.288703] [INFO ] [MAIN ] Update Progress: 710/2372 symbols completed. EGP took 30.5s. Estimated remaining: 3h 39m 48s. Rate: 7.6 symbols/min [2025-09-19T18:33:58.476203] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:58.509898] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T18:33:58.539723] [DEBUG] [LOCAL ] EIC: Loaded 24772 existing records from primary storage. [2025-09-19T18:33:58.539886] [INFO ] [MAIN ] EIC: Loaded 24772 existing records. [2025-09-19T18:33:58.724775] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:58.725050] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-19T18:33:58.725101] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-19T18:33:58.726024] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-19T18:33:58.726099] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-19T18:33:59.062053] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-19T18:33:59.115947] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:59.127139] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T18:33:59.136458] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T18:33:59.843307] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-19T18:34:00.643276] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-19T18:34:00.856968] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T18:34:01.095396] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T18:34:01.443284] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-19T18:34:02.243255] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-19T18:34:02.477672] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T18:34:02.747313] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T18:34:03.043264] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-19T18:34:03.308323] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T18:34:03.843266] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-19T18:34:04.643271] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-19T18:34:04.910279] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T18:34:04.943988] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T18:34:05.443274] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-19T18:34:06.243240] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-19T18:34:06.473239] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T18:34:06.479224] [INFO ] [REMOTE ] EGY: Full fetch complete (61902 records). [2025-09-19T18:34:06.479334] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-19T18:34:06.880224] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-19T18:34:06.880405] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-19T18:34:06.881260] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-19T18:34:06.881406] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-19T18:34:06.896202] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:34:06.901412] [DEBUG] [LOCAL ] EGY: Trimmed 61902 records to 43031 (keeping 200 days of data) [2025-09-19T18:34:07.083515] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-19T18:34:07.181482] [DEBUG] [LOCAL ] EGY: Primary data saved (43031 records). [2025-09-19T18:34:07.181661] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-19T18:34:07.181795] [INFO ] [MAIN ] Update Progress: 711/2372 symbols completed. EGY took 38.5s. Estimated remaining: 3h 39m 43s. Rate: 7.6 symbols/min [2025-09-19T18:34:07.362925] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:07.363098] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-19T18:34:07.363134] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-19T18:34:07.363276] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-19T18:34:07.363318] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-19T18:34:07.363358] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-19T18:34:07.363389] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-19T18:34:07.741310] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:07.843240] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-19T18:34:07.978331] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T18:34:08.006498] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T18:34:08.463674] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-19T18:34:08.643260] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-19T18:34:09.182196] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T18:34:09.443265] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-19T18:34:10.243272] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-19T18:34:10.380403] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T18:34:10.547909] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-19T18:34:11.043269] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-19T18:34:11.843281] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-19T18:34:12.161441] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-19T18:34:12.643284] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-19T18:34:12.799759] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T18:34:12.806215] [INFO ] [REMOTE ] EHC: Full fetch complete (58896 records). [2025-09-19T18:34:12.806347] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-19T18:34:13.200886] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-19T18:34:13.201012] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-19T18:34:13.201898] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-19T18:34:13.201975] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-19T18:34:13.203453] [DEBUG] [LOCAL ] EHC: Trimmed 58896 records to 42121 (keeping 200 days of data) [2025-09-19T18:34:13.443635] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-19T18:34:13.469117] [DEBUG] [LOCAL ] EHC: Primary data saved (42121 records). [2025-09-19T18:34:13.469251] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-19T18:34:13.470029] [INFO ] [MAIN ] Update Progress: 712/2372 symbols completed. EHC took 33.8s. Estimated remaining: 3h 39m 31s. Rate: 7.6 symbols/min [2025-09-19T18:34:13.643151] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:13.643320] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-19T18:34:13.643358] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-19T18:34:13.643503] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-19T18:34:13.643545] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-19T18:34:13.643588] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-19T18:34:13.643621] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-19T18:34:14.010788] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:14.243240] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-19T18:34:14.322814] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T18:34:14.479115] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T18:34:14.777180] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T18:34:15.043293] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-19T18:34:15.843286] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-19T18:34:16.022782] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T18:34:16.168288] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-19T18:34:16.643292] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-19T18:34:17.443291] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-19T18:34:17.740045] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T18:34:17.766564] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-19T18:34:18.243265] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-19T18:34:18.760338] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T18:34:19.043307] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-19T18:34:19.410670] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-19T18:34:19.843279] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-19T18:34:20.372041] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T18:34:20.643277] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-19T18:34:21.289884] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T18:34:21.443279] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-19T18:34:22.243250] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-19T18:34:22.826716] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T18:34:22.843133] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-19T18:34:23.043329] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-19T18:34:23.843316] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-19T18:34:23.950414] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T18:34:24.643270] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-19T18:34:24.750771] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T18:34:25.329726] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T18:34:25.443309] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-19T18:34:25.852407] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-19T18:34:26.243304] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-19T18:34:27.043306] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-19T18:34:27.296732] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T18:34:27.299364] [INFO ] [REMOTE ] EHI: Full fetch complete (16438 records). [2025-09-19T18:34:27.299472] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-19T18:34:27.711260] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-19T18:34:27.711369] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-19T18:34:27.711828] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-19T18:34:27.711928] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-19T18:34:27.712877] [DEBUG] [LOCAL ] EHI: Trimmed 16438 records to 10346 (keeping 200 days of data) [2025-09-19T18:34:27.778986] [DEBUG] [LOCAL ] EHI: Primary data saved (10346 records). [2025-09-19T18:34:27.779147] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-19T18:34:27.779234] [INFO ] [MAIN ] Update Progress: 713/2372 symbols completed. EHI took 33.5s. Estimated remaining: 3h 39m 38s. Rate: 7.6 symbols/min [2025-09-19T18:34:27.848552] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-19T18:34:27.974108] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:27.974352] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-19T18:34:27.974412] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-19T18:34:27.974601] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-19T18:34:27.974730] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-19T18:34:27.974813] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-19T18:34:27.974863] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-19T18:34:28.287406] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-19T18:34:28.375481] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:28.393230] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T18:34:28.643296] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-19T18:34:29.157513] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-19T18:34:29.443264] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-19T18:34:29.841477] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-19T18:34:29.842303] [INFO ] [REMOTE ] EICA: Full fetch complete (1262 records). [2025-09-19T18:34:29.842375] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-19T18:34:30.045582] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-19T18:34:30.045787] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:34:30.045872] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:34:30.045946] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-19T18:34:30.046009] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-19T18:34:30.046057] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-19T18:34:30.046146] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-19T18:34:30.046226] [INFO ] [MAIN ] Update Progress: 714/2372 symbols completed. EICA took 22.9s. Estimated remaining: 3h 39m 17s. Rate: 7.6 symbols/min [2025-09-19T18:34:30.215299] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:30.238346] [DEBUG] [LOCAL ] EIG: Loaded 20425 existing records from primary storage. [2025-09-19T18:34:30.238478] [INFO ] [MAIN ] EIG: Loaded 20425 existing records. [2025-09-19T18:34:30.249275] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-19T18:34:30.418691] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:34:30.418928] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-19T18:34:30.418976] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-19T18:34:30.419763] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-19T18:34:30.419824] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-19T18:34:30.776086] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:31.043297] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-19T18:34:31.141583] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T18:34:31.843254] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-19T18:34:32.326860] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:34:32.643278] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-19T18:34:33.101479] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-19T18:34:33.126720] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T18:34:33.443285] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-19T18:34:34.243265] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-19T18:34:34.687859] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-19T18:34:34.771478] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:34:34.774703] [INFO ] [REMOTE ] EIC: Full fetch complete (35716 records). [2025-09-19T18:34:34.774795] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-19T18:34:35.048342] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-19T18:34:35.148989] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-19T18:34:35.149073] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-19T18:34:35.149759] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-19T18:34:35.149825] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-19T18:34:35.150756] [DEBUG] [LOCAL ] EIC: Trimmed 35716 records to 24897 (keeping 200 days of data) [2025-09-19T18:34:35.304039] [DEBUG] [LOCAL ] EIC: Primary data saved (24897 records). [2025-09-19T18:34:35.304323] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-19T18:34:35.304476] [INFO ] [MAIN ] Update Progress: 715/2372 symbols completed. EIC took 37.0s. Estimated remaining: 3h 39m 3s. Rate: 7.6 symbols/min [2025-09-19T18:34:35.475828] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:35.530684] [DEBUG] [LOCAL ] EIX: Loaded 53743 existing records from primary storage. [2025-09-19T18:34:35.530836] [INFO ] [MAIN ] EIX: Loaded 53743 existing records. [2025-09-19T18:34:35.707577] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:34:35.707828] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-19T18:34:35.707876] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-19T18:34:35.709102] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-19T18:34:35.709162] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-19T18:34:35.849780] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-19T18:34:36.123033] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:36.241761] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:34:36.643272] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-19T18:34:36.750111] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T18:34:37.443288] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-19T18:34:38.091669] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T18:34:38.243264] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-19T18:34:38.579835] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T18:34:38.646493] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-19T18:34:39.043278] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-19T18:34:39.824337] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T18:34:39.843224] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-19T18:34:40.643273] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-19T18:34:41.426352] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T18:34:41.443325] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-19T18:34:41.560635] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T18:34:41.972225] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T18:34:42.243323] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-19T18:34:43.043268] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-19T18:34:43.843283] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-19T18:34:44.206419] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T18:34:44.207373] [INFO ] [REMOTE ] EICB: Full fetch complete (2673 records). [2025-09-19T18:34:44.207442] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-19T18:34:44.393834] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T18:34:44.394104] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:34:44.394289] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:34:44.394432] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-19T18:34:44.394573] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-19T18:34:44.394668] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-19T18:34:44.394841] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-19T18:34:44.394930] [INFO ] [MAIN ] Update Progress: 716/2372 symbols completed. EICB took 30.9s. Estimated remaining: 3h 38m 57s. Rate: 7.6 symbols/min [2025-09-19T18:34:44.513745] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T18:34:44.622599] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:44.627370] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T18:34:44.643254] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-19T18:34:44.689505] [DEBUG] [LOCAL ] EL: Loaded 53826 existing records from primary storage. [2025-09-19T18:34:44.689672] [INFO ] [MAIN ] EL: Loaded 53826 existing records. [2025-09-19T18:34:44.864733] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:34:44.864932] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-19T18:34:44.864979] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-19T18:34:44.866179] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-19T18:34:44.866240] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-19T18:34:45.228829] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:45.387870] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T18:34:45.443214] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-19T18:34:46.243269] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-19T18:34:47.043456] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-19T18:34:47.585008] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T18:34:47.832428] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T18:34:47.843210] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-19T18:34:48.101844] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-19T18:34:48.620955] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-19T18:34:48.643216] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-19T18:34:49.386181] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T18:34:49.388098] [INFO ] [REMOTE ] EICC: Full fetch complete (7763 records). [2025-09-19T18:34:49.388174] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-19T18:34:49.388808] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:34:49.388901] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:34:49.388942] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:34:49.388980] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-19T18:34:49.389037] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-19T18:34:49.389119] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-19T18:34:49.389202] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-19T18:34:49.389281] [INFO ] [MAIN ] Update Progress: 717/2372 symbols completed. EICC took 21.6s. Estimated remaining: 3h 38m 43s. Rate: 7.6 symbols/min [2025-09-19T18:34:49.443263] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-19T18:34:50.243274] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-19T18:34:51.022516] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T18:34:51.043209] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-19T18:34:51.843263] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-19T18:34:52.017350] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:34:52.643272] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-19T18:34:52.737323] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T18:34:53.303590] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-19T18:34:53.443253] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-19T18:34:54.243258] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-19T18:34:54.296602] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T18:34:54.827148] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T18:34:55.043260] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-19T18:34:55.843258] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-19T18:34:55.856309] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T18:34:56.545614] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T18:34:56.643275] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-19T18:34:57.443280] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-19T18:34:57.826219] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:34:58.243289] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-19T18:34:58.386548] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T18:34:58.429757] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:34:59.043313] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-19T18:34:59.843304] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-19T18:35:00.433104] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T18:35:00.643271] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-19T18:35:01.024057] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:35:01.282732] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T18:35:01.443323] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-19T18:35:02.243341] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-19T18:35:02.967280] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:35:02.989992] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:35:02.993717] [INFO ] [REMOTE ] EIG: Full fetch complete (26861 records). [2025-09-19T18:35:02.993804] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-19T18:35:03.055475] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-19T18:35:03.415690] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-19T18:35:03.415786] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-19T18:35:03.416370] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-19T18:35:03.416413] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-19T18:35:03.417437] [DEBUG] [LOCAL ] EIG: Trimmed 26861 records to 20564 (keeping 200 days of data) [2025-09-19T18:35:03.548600] [DEBUG] [LOCAL ] EIG: Primary data saved (20564 records). [2025-09-19T18:35:03.548759] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-19T18:35:03.548864] [INFO ] [MAIN ] Update Progress: 718/2372 symbols completed. EIG took 33.5s. Estimated remaining: 3h 38m 49s. Rate: 7.6 symbols/min [2025-09-19T18:35:04.414050] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T18:35:04.426026] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-19T18:35:05.348217] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T18:35:05.361204] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-19T18:35:06.899245] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-19T18:35:06.911354] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-19T18:35:07.483796] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T18:35:07.491103] [INFO ] [REMOTE ] EIX: Full fetch complete (76552 records). [2025-09-19T18:35:07.491250] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-19T18:35:07.492263] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:35:07.492369] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:35:07.492413] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:35:07.492478] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-19T18:35:07.492545] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-19T18:35:07.492581] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-19T18:35:07.493056] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-09-19T18:35:07.493211] [INFO ] [MAIN ] Update Progress: 719/2372 symbols completed. EIX took 32.2s. Estimated remaining: 3h 38m 32s. Rate: 7.6 symbols/min [2025-09-19T18:35:09.379588] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T18:35:09.391992] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-19T18:35:11.628354] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-19T18:35:11.636083] [INFO ] [REMOTE ] EL: Full fetch complete (77360 records). [2025-09-19T18:35:11.636212] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-19T18:35:12.033535] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-19T18:35:12.033636] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-19T18:35:12.034539] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-19T18:35:12.034586] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-19T18:35:12.036147] [DEBUG] [LOCAL ] EL: Trimmed 77360 records to 54205 (keeping 200 days of data) [2025-09-19T18:35:12.368010] [DEBUG] [LOCAL ] EL: Primary data saved (54205 records). [2025-09-19T18:35:12.368161] [INFO ] [MAIN ] EL: Full history saved. [2025-09-19T18:35:12.368906] [INFO ] [MAIN ] Update Progress: 720/2372 symbols completed. EL took 28.0s. Estimated remaining: 3h 38m 17s. Rate: 7.6 symbols/min [2025-09-19T18:35:13.042839] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:13.021413] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:13.063237] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-09-19T18:35:13.099768] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:13.120322] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:13.121786] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-09-19T18:35:13.122315] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-19T18:35:13.122391] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-19T18:35:13.122689] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-09-19T18:35:13.123000] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-19T18:35:13.140869] [DEBUG] [LOCAL ] ELC: Loaded 3546 existing records from primary storage. [2025-09-19T18:35:13.173577] [INFO ] [MAIN ] ELC: Loaded 3546 existing records. [2025-09-19T18:35:13.589351] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:13.605323] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-19T18:35:13.613595] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-19T18:35:13.665384] [DEBUG] [LOCAL ] ELF: Loaded 52723 existing records from primary storage. [2025-09-19T18:35:13.707042] [INFO ] [MAIN ] ELF: Loaded 52723 existing records. [2025-09-19T18:35:13.712603] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-19T18:35:13.719420] [DEBUG] [LOCAL ] ELAN: Loaded 53570 existing records from primary storage. [2025-09-19T18:35:13.725330] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-19T18:35:13.730718] [INFO ] [MAIN ] ELAN: Loaded 53570 existing records. [2025-09-19T18:35:13.906608] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:13.979140] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-19T18:35:14.245140] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:14.322046] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-19T18:35:14.348150] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-19T18:35:14.391333] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-19T18:35:14.391560] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:14.443473] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-19T18:35:14.443343] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-19T18:35:14.523927] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-19T18:35:14.586567] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-19T18:35:14.618133] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-19T18:35:14.820433] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:14.855622] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-19T18:35:15.279664] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:15.283797] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-19T18:35:15.365729] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:15.366050] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-19T18:35:16.031606] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T18:35:16.033278] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-19T18:35:16.362713] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-19T18:35:16.370589] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-19T18:35:16.786930] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T18:35:16.788404] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-19T18:35:17.027933] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:35:17.038791] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-19T18:35:17.162769] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-19T18:35:17.164108] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-19T18:35:17.890296] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T18:35:17.897954] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-19T18:35:17.915279] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T18:35:17.916736] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-19T18:35:18.024463] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-19T18:35:18.034862] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-19T18:35:18.665787] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T18:35:18.667487] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-19T18:35:18.864154] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T18:35:18.883700] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-19T18:35:19.242993] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T18:35:19.259457] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-19T18:35:19.271530] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T18:35:19.280344] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-19T18:35:20.021429] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T18:35:20.023300] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-19T18:35:20.597837] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-19T18:35:20.651751] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-19T18:35:20.676535] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T18:35:20.677593] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T18:35:21.049860] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:35:21.443274] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-19T18:35:21.889424] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-19T18:35:22.243280] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-19T18:35:22.537523] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T18:35:22.765782] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-19T18:35:22.767004] [INFO ] [REMOTE ] ELC: Full fetch complete (5177 records). [2025-09-19T18:35:22.767076] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-19T18:35:23.048492] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-19T18:35:23.160116] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-19T18:35:23.160203] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-19T18:35:23.160372] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-19T18:35:23.160435] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-19T18:35:23.160891] [DEBUG] [LOCAL ] ELC: Trimmed 5177 records to 3562 (keeping 200 days of data) [2025-09-19T18:35:23.184152] [DEBUG] [LOCAL ] ELC: Primary data saved (3562 records). [2025-09-19T18:35:23.184221] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-19T18:35:23.184294] [INFO ] [MAIN ] Update Progress: 721/2372 symbols completed. ELC took 10.8s. Estimated remaining: 3h 38m 16s. Rate: 7.6 symbols/min [2025-09-19T18:35:23.360972] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:23.387319] [DEBUG] [LOCAL ] ELP: Loaded 26172 existing records from primary storage. [2025-09-19T18:35:23.387461] [INFO ] [MAIN ] ELP: Loaded 26172 existing records. [2025-09-19T18:35:23.571472] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:23.571984] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-19T18:35:23.572088] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-19T18:35:23.572921] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-19T18:35:23.572982] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-19T18:35:23.848736] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-19T18:35:23.940129] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:24.643311] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-19T18:35:25.443309] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-19T18:35:25.514195] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T18:35:25.654167] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T18:35:26.243304] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-19T18:35:26.449458] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T18:35:27.043282] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-19T18:35:27.429597] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T18:35:27.843281] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-19T18:35:28.388927] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:35:28.643230] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-19T18:35:28.719569] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T18:35:28.799362] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T18:35:29.443348] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-19T18:35:30.201344] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T18:35:30.243242] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-19T18:35:31.043280] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-19T18:35:31.636545] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T18:35:31.741239] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:35:31.843288] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-19T18:35:31.877637] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T18:35:32.643320] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-19T18:35:33.443305] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-19T18:35:34.003539] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T18:35:34.243331] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-19T18:35:34.409949] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-19T18:35:34.700417] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T18:35:35.043268] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-19T18:35:35.709884] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T18:35:35.843271] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-19T18:35:36.643258] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-19T18:35:37.022008] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:35:37.411549] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T18:35:37.443209] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-19T18:35:37.888961] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T18:35:37.895319] [INFO ] [REMOTE ] ELME: Full fetch complete (55743 records). [2025-09-19T18:35:37.895421] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-19T18:35:38.253560] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-19T18:35:38.274272] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-19T18:35:38.274364] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-19T18:35:38.275241] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-19T18:35:38.275442] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-19T18:35:38.276748] [DEBUG] [LOCAL ] ELME: Trimmed 55743 records to 39870 (keeping 200 days of data) [2025-09-19T18:35:38.517756] [DEBUG] [LOCAL ] ELME: Primary data saved (39870 records). [2025-09-19T18:35:38.517890] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-19T18:35:38.517979] [INFO ] [MAIN ] Update Progress: 722/2372 symbols completed. ELME took 26.1s. Estimated remaining: 3h 38m 25s. Rate: 7.6 symbols/min [2025-09-19T18:35:38.688260] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:38.688483] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-19T18:35:38.688556] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-19T18:35:38.689147] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-19T18:35:38.689253] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-19T18:35:38.689370] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-19T18:35:38.689563] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-19T18:35:38.868375] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:35:39.051739] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-19T18:35:39.084528] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:39.843316] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-19T18:35:40.031669] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T18:35:40.328140] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-19T18:35:40.643292] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-19T18:35:40.839563] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:35:41.443324] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-19T18:35:41.842971] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-19T18:35:42.018711] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:35:42.243268] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-19T18:35:42.895357] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T18:35:43.043275] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-19T18:35:43.476243] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-19T18:35:43.843277] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-19T18:35:44.643270] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-19T18:35:45.208113] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T18:35:45.443256] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-19T18:35:45.860710] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-19T18:35:46.159228] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:35:46.243272] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-19T18:35:47.043274] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-19T18:35:47.203403] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T18:35:47.446408] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T18:35:47.843262] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-19T18:35:48.643258] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-19T18:35:49.443256] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-19T18:35:50.011061] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T18:35:50.014750] [INFO ] [REMOTE ] ELP: Full fetch complete (37678 records). [2025-09-19T18:35:50.014858] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-19T18:35:50.251307] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-19T18:35:50.421025] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:35:50.469381] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-19T18:35:50.469498] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-19T18:35:50.470474] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-19T18:35:50.470575] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-19T18:35:50.472186] [DEBUG] [LOCAL ] ELP: Trimmed 37678 records to 26324 (keeping 200 days of data) [2025-09-19T18:35:50.628433] [DEBUG] [LOCAL ] ELP: Primary data saved (26324 records). [2025-09-19T18:35:50.628590] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-19T18:35:50.628706] [INFO ] [MAIN ] Update Progress: 723/2372 symbols completed. ELP took 27.4s. Estimated remaining: 3h 38m 26s. Rate: 7.5 symbols/min [2025-09-19T18:35:50.818328] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:50.864094] [DEBUG] [LOCAL ] ELS: Loaded 49743 existing records from primary storage. [2025-09-19T18:35:50.864262] [INFO ] [MAIN ] ELS: Loaded 49743 existing records. [2025-09-19T18:35:50.938018] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T18:35:51.062452] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-19T18:35:51.068861] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:51.070299] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-19T18:35:51.070383] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-19T18:35:51.071861] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-19T18:35:51.071941] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-19T18:35:51.269376] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T18:35:51.405377] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-19T18:35:51.484207] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:51.843257] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-19T18:35:52.196402] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-19T18:35:52.197142] [INFO ] [REMOTE ] ELPC: Full fetch complete (1500 records). [2025-09-19T18:35:52.197213] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-19T18:35:52.377456] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-19T18:35:52.377619] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:35:52.377726] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:35:52.377802] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-19T18:35:52.377880] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-19T18:35:52.377937] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-19T18:35:52.378007] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-19T18:35:52.378087] [INFO ] [MAIN ] Update Progress: 724/2372 symbols completed. ELPC took 13.9s. Estimated remaining: 3h 38m 4s. Rate: 7.6 symbols/min [2025-09-19T18:35:52.589779] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:52.647841] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-19T18:35:52.649984] [DEBUG] [LOCAL ] ELV: Loaded 50849 existing records from primary storage. [2025-09-19T18:35:52.650224] [INFO ] [MAIN ] ELV: Loaded 50849 existing records. [2025-09-19T18:35:52.835080] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:52.835341] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-19T18:35:52.835389] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-19T18:35:52.837042] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-19T18:35:52.837104] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-19T18:35:53.206096] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:53.443279] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-19T18:35:54.243273] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-19T18:35:55.043251] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-19T18:35:55.110493] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-19T18:35:55.164057] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T18:35:55.843284] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-19T18:35:56.341354] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T18:35:56.349927] [INFO ] [REMOTE ] ELAN: Full fetch complete (76859 records). [2025-09-19T18:35:56.350106] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-19T18:35:56.648436] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-19T18:35:56.774578] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-19T18:35:56.774719] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-19T18:35:56.775739] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-19T18:35:56.775807] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-19T18:35:56.777777] [DEBUG] [LOCAL ] ELAN: Trimmed 76859 records to 53959 (keeping 200 days of data) [2025-09-19T18:35:57.024186] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T18:35:57.141693] [DEBUG] [LOCAL ] ELAN: Primary data saved (53959 records). [2025-09-19T18:35:57.141831] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-19T18:35:57.141962] [INFO ] [MAIN ] Update Progress: 725/2372 symbols completed. ELAN took 44.8s. Estimated remaining: 3h 37m 49s. Rate: 7.6 symbols/min [2025-09-19T18:35:57.310259] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:57.310400] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-19T18:35:57.310436] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-19T18:35:57.310574] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-19T18:35:57.310687] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-19T18:35:57.310746] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-19T18:35:57.310780] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-19T18:35:57.448444] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-19T18:35:57.671247] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:57.918894] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T18:35:58.243343] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-19T18:35:58.434849] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T18:35:58.444117] [INFO ] [REMOTE ] ELF: Full fetch complete (75407 records). [2025-09-19T18:35:58.444293] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-19T18:35:58.872518] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-19T18:35:58.872614] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-19T18:35:58.873542] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-19T18:35:58.873610] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-19T18:35:58.876332] [DEBUG] [LOCAL ] ELF: Trimmed 75407 records to 53101 (keeping 200 days of data) [2025-09-19T18:35:59.059422] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-19T18:35:59.219912] [DEBUG] [LOCAL ] ELF: Primary data saved (53101 records). [2025-09-19T18:35:59.220265] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-19T18:35:59.220428] [INFO ] [MAIN ] Update Progress: 726/2372 symbols completed. ELF took 46.9s. Estimated remaining: 3h 37m 28s. Rate: 7.6 symbols/min [2025-09-19T18:35:59.329195] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:35:59.330066] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-19T18:35:59.407311] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T18:35:59.443156] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:59.464497] [DEBUG] [LOCAL ] EMD: Loaded 21570 existing records from primary storage. [2025-09-19T18:35:59.464637] [INFO ] [MAIN ] EMD: Loaded 21570 existing records. [2025-09-19T18:35:59.645833] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:59.646168] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-19T18:35:59.646242] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-19T18:35:59.646996] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-19T18:35:59.647058] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-19T18:35:59.851953] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-19T18:36:00.014808] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:36:00.068606] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:00.643276] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-19T18:36:00.875635] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:36:00.876104] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-19T18:36:01.443300] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-19T18:36:01.766491] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:36:02.243357] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-19T18:36:03.043328] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-19T18:36:03.843389] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-19T18:36:05.991717] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:36:05.992114] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-19T18:36:05.993135] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-19T18:36:10.578926] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:36:10.579265] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-19T18:36:10.579783] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-19T18:36:10.769049] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (6.93 seconds). [2025-09-19T18:36:10.779730] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-19T18:36:10.807709] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:36:10.808046] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-19T18:36:10.808615] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-19T18:36:10.893956] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (7.85 seconds). [2025-09-19T18:36:10.899274] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-19T18:36:11.188676] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (8.95 seconds). [2025-09-19T18:36:11.199394] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-19T18:36:11.231706] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-19T18:36:11.232860] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-19T18:36:12.494864] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T18:36:12.499521] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-19T18:36:12.772372] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T18:36:12.783280] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-19T18:36:13.027370] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T18:36:13.030436] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-19T18:36:14.653281] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (3.75 seconds). [2025-09-19T18:36:14.658247] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-19T18:36:15.127974] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T18:36:15.132299] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-19T18:36:15.422007] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (4.64 seconds). [2025-09-19T18:36:15.432662] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-19T18:36:16.201420] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (3.42 seconds). [2025-09-19T18:36:16.212000] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-19T18:36:17.014741] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T18:36:17.017531] [INFO ] [REMOTE ] EMA: Full fetch complete (7699 records). [2025-09-19T18:36:17.017638] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-19T18:36:17.213065] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 80 unique days, need 200 days [2025-09-19T18:36:17.213309] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:36:17.213566] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:36:17.213693] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-19T18:36:17.239965] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-19T18:36:17.240389] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-19T18:36:17.240717] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-19T18:36:17.241243] [INFO ] [MAIN ] Update Progress: 727/2372 symbols completed. EMA took 20.1s. Estimated remaining: 3h 37m 43s. Rate: 7.6 symbols/min [2025-09-19T18:36:17.243118] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T18:36:17.353788] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-19T18:36:17.442183] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:17.458889] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-19T18:36:17.465307] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-19T18:36:17.509434] [DEBUG] [LOCAL ] EME: Loaded 32125 existing records from primary storage. [2025-09-19T18:36:17.509579] [INFO ] [MAIN ] EME: Loaded 32125 existing records. [2025-09-19T18:36:17.706534] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:17.707030] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-19T18:36:17.707118] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-19T18:36:17.708184] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-19T18:36:17.708263] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-19T18:36:18.089567] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:18.090085] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-19T18:36:18.125238] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:36:18.243222] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-19T18:36:18.274394] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T18:36:19.043278] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-19T18:36:19.498596] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T18:36:19.562429] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-19T18:36:19.787131] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T18:36:19.843233] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-19T18:36:20.078680] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T18:36:20.643280] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-19T18:36:21.377587] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:36:21.443232] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-19T18:36:21.839231] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:36:22.169236] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T18:36:22.243241] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-19T18:36:23.043276] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-19T18:36:23.843290] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-19T18:36:23.844849] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T18:36:24.643278] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-19T18:36:25.316986] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-19T18:36:25.443288] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-19T18:36:25.495548] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T18:36:25.794474] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T18:36:26.243282] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-19T18:36:27.043368] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-19T18:36:27.429196] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T18:36:27.514968] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:36:27.518362] [INFO ] [REMOTE ] EMD: Full fetch complete (32150 records). [2025-09-19T18:36:27.518472] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-19T18:36:27.519159] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:36:27.519248] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:36:27.519293] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:36:27.519361] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-19T18:36:27.519429] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-09-19T18:36:27.519498] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-09-19T18:36:27.519985] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-09-19T18:36:27.520115] [INFO ] [MAIN ] Update Progress: 728/2372 symbols completed. EMD took 28.3s. Estimated remaining: 3h 37m 40s. Rate: 7.6 symbols/min [2025-09-19T18:36:27.697979] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:27.707264] [DEBUG] [LOCAL ] EMF: Loaded 3712 existing records from primary storage. [2025-09-19T18:36:27.707383] [INFO ] [MAIN ] EMF: Loaded 3712 existing records. [2025-09-19T18:36:27.848428] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-19T18:36:27.890677] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:27.890948] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-19T18:36:27.891002] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-19T18:36:27.891305] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-19T18:36:27.891366] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-19T18:36:28.250678] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:28.643268] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-19T18:36:29.443238] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-19T18:36:29.474117] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-19T18:36:30.110609] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T18:36:30.243230] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-19T18:36:30.766638] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (2.92 seconds). [2025-09-19T18:36:30.776608] [INFO ] [REMOTE ] ELS: Full fetch complete (70058 records). [2025-09-19T18:36:30.776779] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-19T18:36:30.780458] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:36:30.780566] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:36:30.780617] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:36:30.780703] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-19T18:36:30.780790] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-19T18:36:30.780842] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-09-19T18:36:30.781425] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-09-19T18:36:30.781541] [INFO ] [MAIN ] Update Progress: 729/2372 symbols completed. ELS took 40.2s. Estimated remaining: 3h 37m 22s. Rate: 7.6 symbols/min [2025-09-19T18:36:30.956117] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:31.017476] [DEBUG] [LOCAL ] EMN: Loaded 50622 existing records from primary storage. [2025-09-19T18:36:31.017678] [INFO ] [MAIN ] EMN: Loaded 50622 existing records. [2025-09-19T18:36:31.048592] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-19T18:36:31.201276] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:31.201772] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-19T18:36:31.201991] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-19T18:36:31.203179] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-19T18:36:31.203240] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-19T18:36:31.326352] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T18:36:31.409733] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T18:36:31.599000] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:31.843217] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-19T18:36:32.643226] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-19T18:36:32.807214] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T18:36:32.815543] [INFO ] [REMOTE ] ELV: Full fetch complete (72845 records). [2025-09-19T18:36:32.815687] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-19T18:36:32.816494] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:36:32.816596] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:36:32.816701] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:36:32.816795] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-19T18:36:32.816877] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-19T18:36:32.816958] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-19T18:36:32.817298] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-09-19T18:36:32.818275] [INFO ] [MAIN ] Update Progress: 730/2372 symbols completed. ELV took 40.4s. Estimated remaining: 3h 37m 0s. Rate: 7.6 symbols/min [2025-09-19T18:36:32.987846] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:33.013767] [DEBUG] [LOCAL ] EMO: Loaded 12366 existing records from primary storage. [2025-09-19T18:36:33.013893] [INFO ] [MAIN ] EMO: Loaded 12366 existing records. [2025-09-19T18:36:33.190969] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:33.191186] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-19T18:36:33.191232] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-19T18:36:33.191635] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-19T18:36:33.191724] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-19T18:36:33.445047] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-19T18:36:33.566946] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:33.594472] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T18:36:34.002324] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:36:34.243240] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-19T18:36:34.304258] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-19T18:36:35.043280] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-19T18:36:35.726749] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T18:36:35.843291] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-19T18:36:36.172130] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T18:36:36.643276] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-19T18:36:36.742319] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T18:36:37.443267] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-19T18:36:37.830671] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T18:36:38.243270] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-19T18:36:38.407573] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T18:36:39.043291] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-19T18:36:39.843287] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-19T18:36:40.262822] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T18:36:40.319572] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T18:36:40.643279] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-19T18:36:40.813238] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T18:36:41.443286] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-19T18:36:42.243257] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-19T18:36:42.584516] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T18:36:42.856484] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T18:36:42.869735] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-19T18:36:43.043257] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-19T18:36:43.843269] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-19T18:36:44.372584] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T18:36:44.643281] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-19T18:36:45.084827] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T18:36:45.216884] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T18:36:45.443268] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-19T18:36:46.243263] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-19T18:36:46.476499] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T18:36:47.043296] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-19T18:36:47.600509] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T18:36:47.843266] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-19T18:36:48.643267] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-19T18:36:48.915879] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:36:49.011773] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T18:36:49.016816] [INFO ] [REMOTE ] EME: Full fetch complete (46779 records). [2025-09-19T18:36:49.016903] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-19T18:36:49.288226] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-19T18:36:49.397685] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-19T18:36:49.397805] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-19T18:36:49.398562] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-19T18:36:49.398702] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-19T18:36:49.403129] [DEBUG] [LOCAL ] EME: Trimmed 46779 records to 32382 (keeping 200 days of data) [2025-09-19T18:36:49.466544] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-19T18:36:49.620357] [DEBUG] [LOCAL ] EME: Primary data saved (32382 records). [2025-09-19T18:36:49.620535] [INFO ] [MAIN ] EME: Full history saved. [2025-09-19T18:36:49.620687] [INFO ] [MAIN ] Update Progress: 731/2372 symbols completed. EME took 32.4s. Estimated remaining: 3h 37m 12s. Rate: 7.6 symbols/min [2025-09-19T18:36:49.789815] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:49.795203] [DEBUG] [LOCAL ] EMP: Loaded 3023 existing records from primary storage. [2025-09-19T18:36:49.795288] [INFO ] [MAIN ] EMP: Loaded 3023 existing records. [2025-09-19T18:36:49.972827] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:49.973088] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-19T18:36:49.973135] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-19T18:36:49.973393] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-19T18:36:49.973452] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-19T18:36:50.249764] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-19T18:36:50.345110] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:51.043306] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-19T18:36:51.071176] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T18:36:51.636460] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T18:36:51.843294] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-19T18:36:52.116493] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T18:36:52.297486] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-19T18:36:52.643324] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-19T18:36:53.443260] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-19T18:36:53.492575] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T18:36:54.012428] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T18:36:54.243270] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-19T18:36:54.974055] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T18:36:55.043271] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-19T18:36:55.433563] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:36:55.843264] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-19T18:36:56.643305] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-19T18:36:56.822978] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T18:36:57.205104] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T18:36:57.443308] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-19T18:36:58.243296] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-19T18:36:59.032862] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T18:36:59.043223] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-19T18:36:59.333141] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T18:36:59.843341] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-19T18:36:59.958462] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T18:37:00.643316] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-19T18:37:01.443381] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-19T18:37:01.453247] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T18:37:01.454949] [INFO ] [REMOTE ] EMF: Full fetch complete (7400 records). [2025-09-19T18:37:01.455057] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-19T18:37:01.947004] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-19T18:37:01.947120] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-19T18:37:01.947477] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-19T18:37:01.947520] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-19T18:37:01.948051] [DEBUG] [LOCAL ] EMF: Trimmed 7400 records to 3735 (keeping 200 days of data) [2025-09-19T18:37:01.975849] [DEBUG] [LOCAL ] EMF: Primary data saved (3735 records). [2025-09-19T18:37:01.976146] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-19T18:37:01.976416] [INFO ] [MAIN ] Update Progress: 732/2372 symbols completed. EMF took 34.5s. Estimated remaining: 3h 37m 14s. Rate: 7.5 symbols/min [2025-09-19T18:37:02.169799] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:02.195860] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-19T18:37:02.204399] [INFO ] [REMOTE ] EMN: Full fetch complete (71875 records). [2025-09-19T18:37:02.204693] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-19T18:37:02.248585] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-19T18:37:02.500595] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T18:37:02.633915] [DEBUG] [LOCAL ] EMR: Loaded 53650 existing records from primary storage. [2025-09-19T18:37:02.644536] [INFO ] [MAIN ] EMR: Loaded 53650 existing records. [2025-09-19T18:37:02.828162] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-19T18:37:02.842694] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-19T18:37:02.846727] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-19T18:37:02.846821] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-19T18:37:02.907371] [DEBUG] [LOCAL ] EMN: Trimmed 71875 records to 50995 (keeping 200 days of data) [2025-09-19T18:37:02.932057] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:02.932817] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-19T18:37:02.932914] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-19T18:37:02.934306] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-19T18:37:02.934372] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-19T18:37:03.063893] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-19T18:37:03.147905] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T18:37:03.595220] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:03.680092] [DEBUG] [LOCAL ] EMN: Primary data saved (50995 records). [2025-09-19T18:37:03.680260] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-19T18:37:03.680347] [INFO ] [MAIN ] Update Progress: 733/2372 symbols completed. EMN took 32.9s. Estimated remaining: 3h 36m 52s. Rate: 7.6 symbols/min [2025-09-19T18:37:03.853500] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-19T18:37:03.858472] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:03.917199] [DEBUG] [LOCAL ] ENB: Loaded 53914 existing records from primary storage. [2025-09-19T18:37:03.917370] [INFO ] [MAIN ] ENB: Loaded 53914 existing records. [2025-09-19T18:37:04.137365] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:04.138103] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-19T18:37:04.138307] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-19T18:37:04.149482] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-19T18:37:04.151351] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:37:04.150459] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-19T18:37:04.650580] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-19T18:37:04.657880] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:05.443308] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-19T18:37:05.756600] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T18:37:05.822806] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T18:37:05.825918] [INFO ] [REMOTE ] EMO: Full fetch complete (17189 records). [2025-09-19T18:37:05.825989] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-19T18:37:06.192507] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-19T18:37:06.192631] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-19T18:37:06.193016] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-19T18:37:06.193080] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-19T18:37:06.193624] [DEBUG] [LOCAL ] EMO: Trimmed 17189 records to 12458 (keeping 200 days of data) [2025-09-19T18:37:06.248723] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-19T18:37:06.271219] [DEBUG] [LOCAL ] EMO: Primary data saved (12458 records). [2025-09-19T18:37:06.271352] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-19T18:37:06.271462] [INFO ] [MAIN ] Update Progress: 734/2372 symbols completed. EMO took 33.5s. Estimated remaining: 3h 36m 32s. Rate: 7.6 symbols/min [2025-09-19T18:37:06.368065] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T18:37:06.448483] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:06.453337] [DEBUG] [LOCAL ] ENFY: Loaded 3075 existing records from primary storage. [2025-09-19T18:37:06.453420] [INFO ] [MAIN ] ENFY: Loaded 3075 existing records. [2025-09-19T18:37:06.627867] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:06.628135] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-19T18:37:06.628183] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-19T18:37:06.628403] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-19T18:37:06.628461] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-19T18:37:06.978625] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:07.043390] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-19T18:37:07.621637] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T18:37:07.843283] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-19T18:37:08.282731] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T18:37:08.643261] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-19T18:37:09.246302] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T18:37:09.443309] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-19T18:37:10.078239] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T18:37:10.243301] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-19T18:37:10.413853] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T18:37:10.967140] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T18:37:10.968246] [INFO ] [REMOTE ] EMP: Full fetch complete (4282 records). [2025-09-19T18:37:10.968316] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-19T18:37:11.048431] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-19T18:37:11.360451] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-19T18:37:11.360568] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-19T18:37:11.360757] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-19T18:37:11.360819] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-19T18:37:11.361233] [DEBUG] [LOCAL ] EMP: Trimmed 4282 records to 3035 (keeping 200 days of data) [2025-09-19T18:37:11.379992] [DEBUG] [LOCAL ] EMP: Primary data saved (3035 records). [2025-09-19T18:37:11.380072] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-19T18:37:11.380156] [INFO ] [MAIN ] Update Progress: 735/2372 symbols completed. EMP took 21.8s. Estimated remaining: 3h 36m 18s. Rate: 7.6 symbols/min [2025-09-19T18:37:11.547800] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:11.591530] [DEBUG] [LOCAL ] ENIC: Loaded 37105 existing records from primary storage. [2025-09-19T18:37:11.591752] [INFO ] [MAIN ] ENIC: Loaded 37105 existing records. [2025-09-19T18:37:11.782020] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:11.782378] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-19T18:37:11.782476] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-19T18:37:11.783724] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-19T18:37:11.783797] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-19T18:37:11.848497] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-19T18:37:12.205573] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:12.643269] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-19T18:37:13.133417] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T18:37:13.186382] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T18:37:13.443247] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-19T18:37:14.175873] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T18:37:14.243298] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-19T18:37:14.980815] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T18:37:15.043298] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-19T18:37:15.843318] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-19T18:37:16.643290] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-19T18:37:16.673149] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T18:37:16.737928] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-19T18:37:17.055106] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-19T18:37:17.443316] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-19T18:37:18.243258] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-19T18:37:18.591457] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-19T18:37:18.785360] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-19T18:37:19.043248] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-19T18:37:19.722680] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T18:37:19.843230] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-19T18:37:20.501956] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-19T18:37:20.572254] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T18:37:20.643246] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-19T18:37:21.443281] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-19T18:37:21.865199] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T18:37:22.243295] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-19T18:37:22.920237] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:37:23.043303] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-19T18:37:23.680898] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T18:37:23.843265] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-19T18:37:24.011679] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:37:24.643277] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-19T18:37:25.201262] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T18:37:25.443265] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-19T18:37:26.005814] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T18:37:26.101182] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T18:37:26.102319] [INFO ] [REMOTE ] ENFY: Full fetch complete (5655 records). [2025-09-19T18:37:26.102404] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-19T18:37:26.252344] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-19T18:37:26.499044] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-19T18:37:26.499145] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-19T18:37:26.499392] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-19T18:37:26.499454] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-19T18:37:26.499889] [DEBUG] [LOCAL ] ENFY: Trimmed 5655 records to 3085 (keeping 200 days of data) [2025-09-19T18:37:26.518141] [DEBUG] [LOCAL ] ENFY: Primary data saved (3085 records). [2025-09-19T18:37:26.518256] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-19T18:37:26.518356] [INFO ] [MAIN ] Update Progress: 736/2372 symbols completed. ENFY took 20.2s. Estimated remaining: 3h 36m 26s. Rate: 7.6 symbols/min [2025-09-19T18:37:26.700906] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:26.704770] [DEBUG] [LOCAL ] ENO: Loaded 2006 existing records from primary storage. [2025-09-19T18:37:26.704857] [INFO ] [MAIN ] ENO: Loaded 2006 existing records. [2025-09-19T18:37:26.893245] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:26.893531] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-19T18:37:26.893580] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-19T18:37:26.893824] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-19T18:37:26.893886] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-19T18:37:27.046700] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-19T18:37:27.255111] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:27.843263] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-19T18:37:28.474106] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-19T18:37:28.637434] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T18:37:28.648537] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-19T18:37:28.755555] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T18:37:29.443272] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-19T18:37:29.907527] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T18:37:30.243267] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-19T18:37:30.445301] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:37:31.043282] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-19T18:37:31.829624] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:37:31.843218] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-19T18:37:32.643284] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-19T18:37:33.443277] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-19T18:37:33.557634] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-19T18:37:33.829771] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:37:33.831547] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T18:37:34.243261] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-19T18:37:34.844544] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T18:37:35.043249] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-19T18:37:35.205557] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (3.36 seconds). [2025-09-19T18:37:35.843367] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-19T18:37:36.643267] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-19T18:37:37.140238] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:37:37.443270] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-19T18:37:37.582720] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:37:38.195433] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:37:38.203611] [INFO ] [REMOTE ] EMR: Full fetch complete (77110 records). [2025-09-19T18:37:38.203829] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-19T18:37:38.252185] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-19T18:37:38.626807] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-19T18:37:38.626909] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-19T18:37:38.628003] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-19T18:37:38.628082] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-19T18:37:38.629832] [DEBUG] [LOCAL ] EMR: Trimmed 77110 records to 54035 (keeping 200 days of data) [2025-09-19T18:37:38.864549] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T18:37:38.992963] [DEBUG] [LOCAL ] EMR: Primary data saved (54035 records). [2025-09-19T18:37:38.993168] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-19T18:37:38.994918] [INFO ] [MAIN ] Update Progress: 737/2372 symbols completed. EMR took 37.0s. Estimated remaining: 3h 36m 28s. Rate: 7.6 symbols/min [2025-09-19T18:37:39.051034] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-19T18:37:39.173600] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:39.218803] [DEBUG] [LOCAL ] ENOV: Loaded 45663 existing records from primary storage. [2025-09-19T18:37:39.218979] [INFO ] [MAIN ] ENOV: Loaded 45663 existing records. [2025-09-19T18:37:39.398929] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:39.399194] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-19T18:37:39.399254] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-19T18:37:39.400452] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-19T18:37:39.400512] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-19T18:37:39.551361] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T18:37:39.778103] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:39.811018] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-19T18:37:39.843223] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-19T18:37:40.643271] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-19T18:37:41.413898] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:37:41.443225] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-19T18:37:41.765258] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T18:37:42.243256] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-19T18:37:43.043234] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-19T18:37:43.394019] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T18:37:43.578960] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T18:37:43.586827] [INFO ] [REMOTE ] ENB: Full fetch complete (77492 records). [2025-09-19T18:37:43.586991] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-19T18:37:43.848339] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-19T18:37:43.975479] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-19T18:37:43.975562] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-19T18:37:43.976465] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-19T18:37:43.976530] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-19T18:37:43.978053] [DEBUG] [LOCAL ] ENB: Trimmed 77492 records to 54299 (keeping 200 days of data) [2025-09-19T18:37:44.226505] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-19T18:37:44.325568] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:37:44.353501] [DEBUG] [LOCAL ] ENB: Primary data saved (54299 records). [2025-09-19T18:37:44.353670] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-19T18:37:44.353797] [INFO ] [MAIN ] Update Progress: 738/2372 symbols completed. ENB took 40.7s. Estimated remaining: 3h 36m 15s. Rate: 7.6 symbols/min [2025-09-19T18:37:44.526631] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:44.566387] [DEBUG] [LOCAL ] ENR: Loaded 42861 existing records from primary storage. [2025-09-19T18:37:44.566530] [INFO ] [MAIN ] ENR: Loaded 42861 existing records. [2025-09-19T18:37:44.648454] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-19T18:37:44.744964] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:44.745327] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-19T18:37:44.745375] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-19T18:37:44.746374] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-19T18:37:44.746436] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-19T18:37:45.102516] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:45.443258] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-19T18:37:45.865833] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T18:37:45.870945] [INFO ] [REMOTE ] ENIC: Full fetch complete (51162 records). [2025-09-19T18:37:45.871048] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-19T18:37:46.241592] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-19T18:37:46.241698] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-19T18:37:46.242395] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-19T18:37:46.242456] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-19T18:37:46.243223] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-19T18:37:46.244400] [DEBUG] [LOCAL ] ENIC: Trimmed 51162 records to 37334 (keeping 200 days of data) [2025-09-19T18:37:46.460187] [DEBUG] [LOCAL ] ENIC: Primary data saved (37334 records). [2025-09-19T18:37:46.460438] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-19T18:37:46.460799] [INFO ] [MAIN ] Update Progress: 739/2372 symbols completed. ENIC took 35.1s. Estimated remaining: 3h 35m 54s. Rate: 7.6 symbols/min [2025-09-19T18:37:46.639435] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:46.669385] [DEBUG] [LOCAL ] ENS: Loaded 29560 existing records from primary storage. [2025-09-19T18:37:46.669527] [INFO ] [MAIN ] ENS: Loaded 29560 existing records. [2025-09-19T18:37:46.844078] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:46.844342] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-19T18:37:46.844399] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-19T18:37:46.845243] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-19T18:37:46.845312] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-19T18:37:47.050591] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-19T18:37:47.220608] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:47.245696] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T18:37:47.765666] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T18:37:47.843219] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-19T18:37:48.021394] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T18:37:48.370067] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-19T18:37:48.643348] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-19T18:37:49.443359] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-19T18:37:50.243238] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-19T18:37:50.246153] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T18:37:50.247864] [INFO ] [REMOTE ] ENO: Full fetch complete (3221 records). [2025-09-19T18:37:50.248024] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-19T18:37:50.449959] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T18:37:50.657388] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-19T18:37:50.657466] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-19T18:37:50.657586] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-19T18:37:50.657625] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-19T18:37:50.658014] [DEBUG] [LOCAL ] ENO: Trimmed 3221 records to 2016 (keeping 200 days of data) [2025-09-19T18:37:50.670661] [DEBUG] [LOCAL ] ENO: Primary data saved (2016 records). [2025-09-19T18:37:50.670730] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-19T18:37:50.670801] [INFO ] [MAIN ] Update Progress: 740/2372 symbols completed. ENO took 24.2s. Estimated remaining: 3h 35m 38s. Rate: 7.6 symbols/min [2025-09-19T18:37:50.886225] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:50.913943] [DEBUG] [LOCAL ] ENVA: Loaded 25959 existing records from primary storage. [2025-09-19T18:37:50.914078] [INFO ] [MAIN ] ENVA: Loaded 25959 existing records. [2025-09-19T18:37:51.055122] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-19T18:37:51.096389] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:51.097429] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-19T18:37:51.097482] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-19T18:37:51.098272] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-19T18:37:51.098339] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-19T18:37:51.469418] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:51.490045] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T18:37:51.843281] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-19T18:37:52.643276] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-19T18:37:52.973214] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T18:37:53.363428] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T18:37:53.443319] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-19T18:37:53.736346] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:37:54.243233] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-19T18:37:54.786670] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T18:37:55.043264] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-19T18:37:55.826129] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T18:37:55.843214] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-19T18:37:56.643291] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-19T18:37:56.852089] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T18:37:57.443283] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-19T18:37:58.162522] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T18:37:58.243252] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-19T18:37:58.732822] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-09-19T18:37:58.763320] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T18:37:59.043308] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-19T18:37:59.843268] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-19T18:38:00.190992] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T18:38:00.643246] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-19T18:38:00.733063] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T18:38:01.276195] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T18:38:01.443251] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-19T18:38:02.243257] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-19T18:38:02.639248] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T18:38:02.914265] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T18:38:03.043261] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-19T18:38:03.803238] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:38:03.843249] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-19T18:38:04.643312] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-19T18:38:05.096595] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:38:05.440325] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:38:05.446239] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-19T18:38:06.243252] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-19T18:38:06.386855] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T18:38:06.842555] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:38:07.043254] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-19T18:38:07.390680] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T18:38:07.843284] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-19T18:38:08.643308] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-19T18:38:08.900060] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T18:38:09.443245] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-19T18:38:09.482875] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T18:38:09.964848] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T18:38:10.243268] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-19T18:38:10.838142] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:38:11.043293] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-19T18:38:11.843301] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-19T18:38:11.866998] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T18:38:11.873472] [INFO ] [REMOTE ] ENR: Full fetch complete (57679 records). [2025-09-19T18:38:11.873676] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-19T18:38:11.875518] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:38:11.875613] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:38:11.875709] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:38:11.875800] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-19T18:38:11.875916] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-19T18:38:11.875985] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-19T18:38:11.876562] [DEBUG] [LOCAL ] ENR: Deleted derivative data file. [2025-09-19T18:38:11.876721] [INFO ] [MAIN ] Update Progress: 741/2372 symbols completed. ENR took 27.5s. Estimated remaining: 3h 35m 59s. Rate: 7.6 symbols/min [2025-09-19T18:38:12.056351] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:12.076712] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T18:38:12.092921] [DEBUG] [LOCAL ] EOD: Loaded 14253 existing records from primary storage. [2025-09-19T18:38:12.093102] [INFO ] [MAIN ] EOD: Loaded 14253 existing records. [2025-09-19T18:38:12.273834] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:12.274156] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-19T18:38:12.274239] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-19T18:38:12.275006] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-19T18:38:12.275070] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-19T18:38:12.642916] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:12.643235] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-19T18:38:13.443268] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-19T18:38:13.643000] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T18:38:13.725093] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T18:38:14.243282] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-19T18:38:14.870142] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T18:38:15.043276] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-19T18:38:15.325171] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T18:38:15.843277] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-19T18:38:16.643286] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-19T18:38:16.972990] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:38:17.204311] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T18:38:17.216758] [INFO ] [REMOTE ] ENOV: Full fetch complete (63002 records). [2025-09-19T18:38:17.216997] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-19T18:38:17.463070] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-19T18:38:17.761078] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-19T18:38:17.761193] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-19T18:38:17.762390] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-19T18:38:17.762469] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-19T18:38:17.764277] [DEBUG] [LOCAL ] ENOV: Trimmed 63002 records to 45945 (keeping 200 days of data) [2025-09-19T18:38:18.050356] [DEBUG] [LOCAL ] ENOV: Primary data saved (45945 records). [2025-09-19T18:38:18.050534] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-19T18:38:18.050684] [INFO ] [MAIN ] Update Progress: 742/2372 symbols completed. ENOV took 39.1s. Estimated remaining: 3h 35m 47s. Rate: 7.6 symbols/min [2025-09-19T18:38:18.229235] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:18.243271] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-19T18:38:18.284911] [DEBUG] [LOCAL ] EOG: Loaded 53731 existing records from primary storage. [2025-09-19T18:38:18.285061] [INFO ] [MAIN ] EOG: Loaded 53731 existing records. [2025-09-19T18:38:18.472390] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:18.472798] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-19T18:38:18.472879] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-19T18:38:18.483978] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-19T18:38:18.486456] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-19T18:38:18.493514] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T18:38:18.609447] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T18:38:18.903729] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:19.043279] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-19T18:38:19.337920] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:38:19.843283] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-19T18:38:20.635046] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T18:38:20.645359] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-19T18:38:21.182565] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T18:38:21.443286] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-19T18:38:21.673908] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T18:38:22.243283] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-19T18:38:23.043312] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-19T18:38:23.357379] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T18:38:23.404173] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T18:38:23.843277] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-19T18:38:24.450525] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:38:24.454871] [INFO ] [REMOTE ] ENVA: Full fetch complete (36527 records). [2025-09-19T18:38:24.454958] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-19T18:38:24.652747] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-19T18:38:24.835022] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-19T18:38:24.835119] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-19T18:38:24.835996] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-19T18:38:24.836058] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-19T18:38:24.836982] [DEBUG] [LOCAL ] ENVA: Trimmed 36527 records to 26160 (keeping 200 days of data) [2025-09-19T18:38:24.942625] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T18:38:25.010604] [DEBUG] [LOCAL ] ENVA: Primary data saved (26160 records). [2025-09-19T18:38:25.010765] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-19T18:38:25.010871] [INFO ] [MAIN ] Update Progress: 743/2372 symbols completed. ENVA took 34.3s. Estimated remaining: 3h 35m 37s. Rate: 7.6 symbols/min [2025-09-19T18:38:25.180084] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:25.191274] [DEBUG] [LOCAL ] EOI: Loaded 10796 existing records from primary storage. [2025-09-19T18:38:25.191407] [INFO ] [MAIN ] EOI: Loaded 10796 existing records. [2025-09-19T18:38:25.371580] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:25.371943] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-19T18:38:25.372029] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-19T18:38:25.372466] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-19T18:38:25.372529] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-19T18:38:25.448390] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-19T18:38:25.741631] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:26.243302] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-19T18:38:26.298671] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T18:38:26.675775] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T18:38:27.043279] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-19T18:38:27.843322] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-19T18:38:27.892410] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T18:38:27.898976] [INFO ] [REMOTE ] ENS: Full fetch complete (41765 records). [2025-09-19T18:38:27.899076] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-19T18:38:28.096698] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T18:38:28.287268] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-19T18:38:28.287358] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-19T18:38:28.288056] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-19T18:38:28.288122] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-19T18:38:28.290599] [DEBUG] [LOCAL ] ENS: Trimmed 41765 records to 29761 (keeping 200 days of data) [2025-09-19T18:38:28.487122] [DEBUG] [LOCAL ] ENS: Primary data saved (29761 records). [2025-09-19T18:38:28.487353] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-19T18:38:28.487483] [INFO ] [MAIN ] Update Progress: 744/2372 symbols completed. ENS took 42.0s. Estimated remaining: 3h 35m 19s. Rate: 7.6 symbols/min [2025-09-19T18:38:28.660242] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:28.656756] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-19T18:38:28.681554] [DEBUG] [LOCAL ] EOS: Loaded 15700 existing records from primary storage. [2025-09-19T18:38:28.681715] [INFO ] [MAIN ] EOS: Loaded 15700 existing records. [2025-09-19T18:38:28.865454] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:28.865737] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-19T18:38:28.865795] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-19T18:38:28.866265] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-19T18:38:28.866337] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-19T18:38:29.235026] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:29.443266] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-19T18:38:30.000379] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T18:38:30.066845] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:38:30.243246] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-19T18:38:30.437777] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T18:38:31.043261] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-19T18:38:31.448037] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T18:38:31.843286] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-19T18:38:32.643301] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-19T18:38:32.898769] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T18:38:32.901104] [INFO ] [REMOTE ] EOD: Full fetch complete (19727 records). [2025-09-19T18:38:32.901233] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-19T18:38:33.309431] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-19T18:38:33.309688] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-19T18:38:33.310380] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-19T18:38:33.310523] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-19T18:38:33.311830] [DEBUG] [LOCAL ] EOD: Trimmed 19727 records to 14342 (keeping 200 days of data) [2025-09-19T18:38:33.367072] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T18:38:33.416738] [DEBUG] [LOCAL ] EOD: Primary data saved (14342 records). [2025-09-19T18:38:33.417085] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-19T18:38:33.417258] [INFO ] [MAIN ] Update Progress: 745/2372 symbols completed. EOD took 21.5s. Estimated remaining: 3h 35m 5s. Rate: 7.6 symbols/min [2025-09-19T18:38:33.454077] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-19T18:38:33.638549] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:33.641049] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T18:38:33.663427] [DEBUG] [LOCAL ] EOT: Loaded 6898 existing records from primary storage. [2025-09-19T18:38:33.663565] [INFO ] [MAIN ] EOT: Loaded 6898 existing records. [2025-09-19T18:38:33.851621] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:33.851938] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-19T18:38:33.852025] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-19T18:38:33.852410] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-19T18:38:33.852480] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-19T18:38:34.214777] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:34.243234] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-19T18:38:34.463240] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T18:38:34.930154] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-19T18:38:35.043265] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-19T18:38:35.843262] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-19T18:38:35.923446] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:38:36.643294] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-19T18:38:37.176480] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T18:38:37.188944] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T18:38:37.443299] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-19T18:38:38.243262] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-19T18:38:38.485547] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T18:38:39.043271] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-19T18:38:39.184607] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T18:38:39.843266] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-19T18:38:40.151756] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T18:38:40.643234] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-19T18:38:41.161010] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T18:38:41.257274] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T18:38:41.443291] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-19T18:38:42.243284] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-19T18:38:43.043283] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-19T18:38:43.087019] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T18:38:43.666084] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T18:38:43.674386] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-19T18:38:43.843276] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-19T18:38:44.643269] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-19T18:38:44.799054] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T18:38:45.437348] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T18:38:45.443217] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-19T18:38:46.243258] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-19T18:38:46.534993] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T18:38:47.043273] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-19T18:38:47.281558] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T18:38:47.843272] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-19T18:38:48.587763] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:38:48.643227] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-19T18:38:48.836977] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T18:38:49.443231] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-19T18:38:49.774910] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:38:50.243260] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-19T18:38:51.043271] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-19T18:38:51.290248] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T18:38:51.697960] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T18:38:51.843238] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-19T18:38:52.107510] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T18:38:52.643285] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-19T18:38:53.334603] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T18:38:53.443220] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-19T18:38:53.696515] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T18:38:54.243269] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-19T18:38:54.681140] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T18:38:54.684965] [INFO ] [REMOTE ] EOS: Full fetch complete (23094 records). [2025-09-19T18:38:54.685270] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-19T18:38:55.051188] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-19T18:38:55.063191] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-19T18:38:55.063300] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-19T18:38:55.063961] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-19T18:38:55.064025] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-19T18:38:55.064727] [DEBUG] [LOCAL ] EOS: Trimmed 23094 records to 15784 (keeping 200 days of data) [2025-09-19T18:38:55.175311] [DEBUG] [LOCAL ] EOS: Primary data saved (15784 records). [2025-09-19T18:38:55.178517] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-19T18:38:55.178777] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T18:38:55.179062] [INFO ] [MAIN ] Update Progress: 746/2372 symbols completed. EOS took 26.7s. Estimated remaining: 3h 35m 27s. Rate: 7.5 symbols/min [2025-09-19T18:38:55.353725] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:55.382523] [DEBUG] [LOCAL ] EPAC: Loaded 27231 existing records from primary storage. [2025-09-19T18:38:55.382693] [INFO ] [MAIN ] EPAC: Loaded 27231 existing records. [2025-09-19T18:38:55.574612] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:55.574960] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-19T18:38:55.575019] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-19T18:38:55.575952] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-19T18:38:55.576020] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-19T18:38:55.848734] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-19T18:38:55.957956] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:56.643246] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-19T18:38:56.882036] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T18:38:57.303986] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T18:38:57.313660] [INFO ] [REMOTE ] EOG: Full fetch complete (77267 records). [2025-09-19T18:38:57.313852] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-19T18:38:57.455218] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-19T18:38:57.629106] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T18:38:57.736429] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-19T18:38:57.736526] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-19T18:38:57.737672] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-19T18:38:57.737766] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-19T18:38:57.739426] [DEBUG] [LOCAL ] EOG: Trimmed 77267 records to 54121 (keeping 200 days of data) [2025-09-19T18:38:58.090445] [DEBUG] [LOCAL ] EOG: Primary data saved (54121 records). [2025-09-19T18:38:58.090591] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-19T18:38:58.092296] [INFO ] [MAIN ] Update Progress: 747/2372 symbols completed. EOG took 40.0s. Estimated remaining: 3h 35m 8s. Rate: 7.6 symbols/min [2025-09-19T18:38:58.247367] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-19T18:38:58.264893] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:58.315905] [DEBUG] [LOCAL ] EPAM: Loaded 40056 existing records from primary storage. [2025-09-19T18:38:58.316062] [INFO ] [MAIN ] EPAM: Loaded 40056 existing records. [2025-09-19T18:38:58.499033] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:58.500487] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-19T18:38:58.500556] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-19T18:38:58.502319] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-19T18:38:58.502380] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-19T18:38:58.777557] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T18:38:58.804227] [INFO ] [REMOTE ] EOI: Full fetch complete (15988 records). [2025-09-19T18:38:58.820163] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-19T18:38:58.970792] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:59.052426] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-19T18:38:59.270137] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-19T18:38:59.270221] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-19T18:38:59.270568] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-19T18:38:59.270606] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-19T18:38:59.271163] [DEBUG] [LOCAL ] EOI: Trimmed 15988 records to 10854 (keeping 200 days of data) [2025-09-19T18:38:59.346701] [DEBUG] [LOCAL ] EOI: Primary data saved (10854 records). [2025-09-19T18:38:59.346857] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-19T18:38:59.346945] [INFO ] [MAIN ] Update Progress: 748/2372 symbols completed. EOI took 34.3s. Estimated remaining: 3h 34m 46s. Rate: 7.6 symbols/min [2025-09-19T18:38:59.519848] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:59.574354] [DEBUG] [LOCAL ] EPC: Loaded 40244 existing records from primary storage. [2025-09-19T18:38:59.574494] [INFO ] [MAIN ] EPC: Loaded 40244 existing records. [2025-09-19T18:38:59.750260] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:59.750483] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-19T18:38:59.750551] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-19T18:38:59.751761] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-19T18:38:59.751821] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-19T18:38:59.849910] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-19T18:39:00.119619] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T18:39:00.154815] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:00.155923] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T18:39:00.158067] [INFO ] [REMOTE ] EOT: Full fetch complete (10887 records). [2025-09-19T18:39:00.158140] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-19T18:39:00.518193] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-19T18:39:00.518304] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-19T18:39:00.518611] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-19T18:39:00.518672] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-19T18:39:00.519122] [DEBUG] [LOCAL ] EOT: Trimmed 10887 records to 6926 (keeping 200 days of data) [2025-09-19T18:39:00.562492] [DEBUG] [LOCAL ] EOT: Primary data saved (6926 records). [2025-09-19T18:39:00.562596] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-19T18:39:00.562706] [INFO ] [MAIN ] Update Progress: 749/2372 symbols completed. EOT took 27.1s. Estimated remaining: 3h 34m 23s. Rate: 7.6 symbols/min [2025-09-19T18:39:00.652423] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-19T18:39:00.735776] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:00.799729] [DEBUG] [LOCAL ] EPD: Loaded 54006 existing records from primary storage. [2025-09-19T18:39:00.799876] [INFO ] [MAIN ] EPD: Loaded 54006 existing records. [2025-09-19T18:39:00.975397] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:00.975706] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-19T18:39:00.975763] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-19T18:39:00.977603] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-19T18:39:00.977688] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-19T18:39:01.357613] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:01.443246] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-19T18:39:01.541937] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:39:01.986264] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:39:02.243290] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-19T18:39:03.043287] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-19T18:39:03.843278] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-19T18:39:04.636356] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T18:39:04.643308] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-19T18:39:04.906669] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (3.46 seconds). [2025-09-19T18:39:05.069431] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-09-19T18:39:05.443270] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-19T18:39:05.744266] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T18:39:06.243304] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-19T18:39:06.522999] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T18:39:07.043313] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-19T18:39:07.553105] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T18:39:07.843241] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-19T18:39:07.909305] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:39:08.077746] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T18:39:08.643293] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-19T18:39:09.443349] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-19T18:39:09.857417] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T18:39:10.243301] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-19T18:39:10.576391] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T18:39:10.940796] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T18:39:11.043244] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-19T18:39:11.605582] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:39:11.843295] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-19T18:39:12.643306] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-19T18:39:13.022139] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:39:13.140887] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T18:39:13.443269] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-19T18:39:14.243276] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-19T18:39:14.316034] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T18:39:15.043274] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-19T18:39:15.827091] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T18:39:15.843227] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-19T18:39:16.643312] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-19T18:39:16.704241] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T18:39:17.419908] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-09-19T18:39:17.453052] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-19T18:39:17.460435] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:39:18.243298] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-19T18:39:18.866342] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:39:19.043333] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-19T18:39:19.178322] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T18:39:19.391914] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:39:19.843272] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-19T18:39:20.643279] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-19T18:39:21.443250] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-19T18:39:21.779828] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-19T18:39:21.883835] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T18:39:22.243295] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-19T18:39:22.622747] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:39:23.043247] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-19T18:39:23.276864] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T18:39:23.843285] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-19T18:39:23.980287] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T18:39:24.643354] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-19T18:39:25.268711] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T18:39:25.275005] [INFO ] [REMOTE ] EPAM: Full fetch complete (56001 records). [2025-09-19T18:39:25.275126] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-19T18:39:25.445695] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-19T18:39:25.680790] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-19T18:39:25.681025] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-19T18:39:25.681862] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-19T18:39:25.681969] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-19T18:39:25.683512] [DEBUG] [LOCAL ] EPAM: Trimmed 56001 records to 40338 (keeping 200 days of data) [2025-09-19T18:39:25.798851] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:39:25.961032] [DEBUG] [LOCAL ] EPAM: Primary data saved (40338 records). [2025-09-19T18:39:25.961177] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-19T18:39:25.961263] [INFO ] [MAIN ] Update Progress: 750/2372 symbols completed. EPAM took 27.9s. Estimated remaining: 3h 34m 53s. Rate: 7.5 symbols/min [2025-09-19T18:39:26.134271] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:26.175254] [DEBUG] [LOCAL ] EPR: Loaded 44723 existing records from primary storage. [2025-09-19T18:39:26.175400] [INFO ] [MAIN ] EPR: Loaded 44723 existing records. [2025-09-19T18:39:26.244453] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-19T18:39:26.368416] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:26.368868] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-19T18:39:26.368996] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-19T18:39:26.371138] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-19T18:39:26.371223] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-19T18:39:26.587623] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T18:39:26.781729] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:27.043337] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-19T18:39:27.263460] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T18:39:27.267595] [INFO ] [REMOTE ] EPAC: Full fetch complete (38760 records). [2025-09-19T18:39:27.267727] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-19T18:39:27.268241] [FATAL] [VALIDATOR ] EPAC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:39:27.268326] [FATAL] [MAIN ] EPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:39:27.268368] [WARN ] [MAIN ] EPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:39:27.268438] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-19T18:39:27.268501] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-09-19T18:39:27.268536] [INFO ] [LOCAL ] EPAC: Starting deletion of derivative data. [2025-09-19T18:39:27.269021] [DEBUG] [LOCAL ] EPAC: Deleted derivative data file. [2025-09-19T18:39:27.269115] [INFO ] [MAIN ] Update Progress: 751/2372 symbols completed. EPAC took 32.1s. Estimated remaining: 3h 34m 31s. Rate: 7.6 symbols/min [2025-09-19T18:39:27.442450] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:27.494711] [DEBUG] [LOCAL ] EPRT: Loaded 49084 existing records from primary storage. [2025-09-19T18:39:27.494862] [INFO ] [MAIN ] EPRT: Loaded 49084 existing records. [2025-09-19T18:39:27.695523] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:27.695817] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-19T18:39:27.695872] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-19T18:39:27.697030] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-19T18:39:27.697098] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-19T18:39:27.849956] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-19T18:39:28.073768] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:28.101572] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T18:39:28.433681] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T18:39:28.643263] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-19T18:39:29.443304] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-19T18:39:30.248891] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-19T18:39:30.263426] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-19T18:39:30.622601] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T18:39:31.043236] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-19T18:39:31.135297] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:39:31.811301] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:39:31.843249] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-19T18:39:32.165992] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:39:32.643302] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-19T18:39:33.443302] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-19T18:39:33.686174] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T18:39:34.243254] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-19T18:39:34.412258] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:39:35.043253] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-19T18:39:35.659723] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T18:39:35.722499] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T18:39:35.843221] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-19T18:39:36.643261] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-19T18:39:37.043082] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T18:39:37.172037] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:39:37.443277] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-19T18:39:38.243268] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-19T18:39:38.314917] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T18:39:38.322808] [INFO ] [REMOTE ] EPD: Full fetch complete (77643 records). [2025-09-19T18:39:38.322947] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-19T18:39:38.734753] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-19T18:39:38.734951] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-19T18:39:38.735966] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-19T18:39:38.736056] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-19T18:39:38.755191] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T18:39:38.761322] [DEBUG] [LOCAL ] EPD: Trimmed 77643 records to 54396 (keeping 200 days of data) [2025-09-19T18:39:38.762462] [INFO ] [REMOTE ] EPC: Full fetch complete (56704 records). [2025-09-19T18:39:38.762588] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-19T18:39:39.052903] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-19T18:39:39.307062] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-19T18:39:39.307723] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-19T18:39:39.309754] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-19T18:39:39.310102] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-19T18:39:39.317207] [DEBUG] [LOCAL ] EPC: Trimmed 56704 records to 40556 (keeping 200 days of data) [2025-09-19T18:39:39.803178] [DEBUG] [LOCAL ] EPC: Primary data saved (40556 records). [2025-09-19T18:39:39.803751] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-19T18:39:39.805452] [INFO ] [MAIN ] Update Progress: 752/2372 symbols completed. EPC took 40.5s. Estimated remaining: 3h 34m 33s. Rate: 7.6 symbols/min [2025-09-19T18:39:39.808475] [DEBUG] [LOCAL ] EPD: Primary data saved (54396 records). [2025-09-19T18:39:39.820420] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-19T18:39:39.820580] [INFO ] [MAIN ] Update Progress: 753/2372 symbols completed. EPD took 39.3s. Estimated remaining: 3h 34m 8s. Rate: 7.6 symbols/min [2025-09-19T18:39:40.143584] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:40.172244] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:40.211342] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:39:40.224044] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-19T18:39:40.229190] [DEBUG] [LOCAL ] EQBK: Loaded 10975 existing records from primary storage. [2025-09-19T18:39:40.232355] [INFO ] [MAIN ] EQBK: Loaded 10975 existing records. [2025-09-19T18:39:40.431576] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:40.432509] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-19T18:39:40.432748] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-19T18:39:40.450888] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-19T18:39:40.453269] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-19T18:39:40.498339] [DEBUG] [LOCAL ] EQH: Loaded 53057 existing records from primary storage. [2025-09-19T18:39:40.546387] [INFO ] [MAIN ] EQH: Loaded 53057 existing records. [2025-09-19T18:39:40.864691] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:40.942774] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-19T18:39:40.946188] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-19T18:39:40.962762] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-19T18:39:40.962881] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-19T18:39:41.064882] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:41.098031] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-19T18:39:41.175428] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T18:39:41.460014] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:41.454158] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-19T18:39:42.122119] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T18:39:42.149012] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T18:39:42.243230] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-19T18:39:43.043265] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-19T18:39:43.562489] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T18:39:43.768436] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:39:43.843281] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-19T18:39:44.471520] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T18:39:44.643299] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-19T18:39:45.443273] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-19T18:39:45.885715] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T18:39:46.010510] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T18:39:46.243264] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-19T18:39:46.988474] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T18:39:47.043217] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-19T18:39:47.843279] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-19T18:39:48.206311] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:39:48.643276] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-19T18:39:48.952630] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:39:49.191404] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T18:39:49.198295] [INFO ] [REMOTE ] EPR: Full fetch complete (62874 records). [2025-09-19T18:39:49.198424] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-19T18:39:49.448430] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-19T18:39:49.610614] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-19T18:39:49.610741] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-19T18:39:49.611535] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-19T18:39:49.611581] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-19T18:39:49.613063] [DEBUG] [LOCAL ] EPR: Trimmed 62874 records to 45037 (keeping 200 days of data) [2025-09-19T18:39:49.918218] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T18:39:49.966550] [DEBUG] [LOCAL ] EPR: Primary data saved (45037 records). [2025-09-19T18:39:49.966713] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-19T18:39:49.966812] [INFO ] [MAIN ] Update Progress: 754/2372 symbols completed. EPR took 24.0s. Estimated remaining: 3h 34m 5s. Rate: 7.6 symbols/min [2025-09-19T18:39:50.146261] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:50.155164] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T18:39:50.204194] [DEBUG] [LOCAL ] EQNR: Loaded 53434 existing records from primary storage. [2025-09-19T18:39:50.204342] [INFO ] [MAIN ] EQNR: Loaded 53434 existing records. [2025-09-19T18:39:50.248357] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-19T18:39:50.388790] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:50.389039] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-19T18:39:50.389087] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-19T18:39:50.390677] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-19T18:39:50.390738] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-19T18:39:50.740707] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:51.043319] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-19T18:39:51.305485] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T18:39:51.843320] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-19T18:39:52.643273] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-19T18:39:53.023958] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:39:53.443328] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-19T18:39:53.777244] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T18:39:53.784601] [INFO ] [REMOTE ] EPRT: Full fetch complete (68629 records). [2025-09-19T18:39:53.784770] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-19T18:39:54.185074] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-19T18:39:54.185161] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-19T18:39:54.186053] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-19T18:39:54.186116] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-19T18:39:54.187504] [DEBUG] [LOCAL ] EPRT: Trimmed 68629 records to 49420 (keeping 200 days of data) [2025-09-19T18:39:54.248325] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-19T18:39:54.494620] [DEBUG] [LOCAL ] EPRT: Primary data saved (49420 records). [2025-09-19T18:39:54.494800] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-19T18:39:54.494909] [INFO ] [MAIN ] Update Progress: 755/2372 symbols completed. EPRT took 27.2s. Estimated remaining: 3h 33m 49s. Rate: 7.6 symbols/min [2025-09-19T18:39:54.666017] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:54.715031] [DEBUG] [LOCAL ] EQR: Loaded 51751 existing records from primary storage. [2025-09-19T18:39:54.715178] [INFO ] [MAIN ] EQR: Loaded 51751 existing records. [2025-09-19T18:39:54.904269] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:54.905274] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-19T18:39:54.905404] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-19T18:39:54.913122] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-19T18:39:54.925083] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-19T18:39:54.930745] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T18:39:55.047284] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-19T18:39:55.049303] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-19T18:39:55.317288] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:55.615560] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T18:39:55.843276] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-19T18:39:56.201437] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T18:39:56.643300] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-19T18:39:57.443328] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-19T18:39:57.797316] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T18:39:58.243278] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-19T18:39:58.371333] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T18:39:58.753187] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T18:39:59.043278] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-19T18:39:59.743780] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T18:39:59.843268] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-19T18:40:00.643277] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-19T18:40:00.946512] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:40:01.009870] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T18:40:01.443308] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-19T18:40:02.243335] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-19T18:40:02.264558] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T18:40:02.759827] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T18:40:03.043339] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-19T18:40:03.808707] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T18:40:03.828573] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-19T18:40:03.843214] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-19T18:40:04.643276] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-19T18:40:04.966823] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T18:40:04.969229] [INFO ] [REMOTE ] EQBK: Full fetch complete (15505 records). [2025-09-19T18:40:04.969314] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-19T18:40:05.355028] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-19T18:40:05.355141] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-19T18:40:05.355505] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-19T18:40:05.355566] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-19T18:40:05.356169] [DEBUG] [LOCAL ] EQBK: Trimmed 15505 records to 11059 (keeping 200 days of data) [2025-09-19T18:40:05.422503] [DEBUG] [LOCAL ] EQBK: Primary data saved (11059 records). [2025-09-19T18:40:05.422662] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-19T18:40:05.422832] [INFO ] [MAIN ] Update Progress: 756/2372 symbols completed. EQBK took 25.6s. Estimated remaining: 3h 33m 48s. Rate: 7.6 symbols/min [2025-09-19T18:40:05.452573] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-19T18:40:05.599777] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:05.599960] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-19T18:40:05.599999] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-19T18:40:05.600221] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-19T18:40:05.600275] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-19T18:40:05.600383] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-19T18:40:05.600449] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-19T18:40:05.951712] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:06.243335] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-19T18:40:06.591616] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T18:40:06.716349] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-19T18:40:07.043354] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-19T18:40:07.313600] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T18:40:07.492335] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-19T18:40:07.843258] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-19T18:40:08.643283] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-19T18:40:09.443310] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-19T18:40:10.065832] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:40:10.179865] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T18:40:10.243275] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-19T18:40:10.880229] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T18:40:11.043263] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-19T18:40:11.843271] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-19T18:40:12.276704] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-19T18:40:12.279597] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:40:12.643270] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-19T18:40:13.072807] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T18:40:13.443269] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-19T18:40:14.243297] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-19T18:40:14.572594] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-19T18:40:14.622954] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:40:14.800972] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:40:14.808848] [INFO ] [REMOTE ] EQH: Full fetch complete (75912 records). [2025-09-19T18:40:14.808992] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-19T18:40:14.809946] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:40:14.810037] [FATAL] [MAIN ] EQH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:40:14.810081] [WARN ] [MAIN ] EQH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:40:14.810125] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-19T18:40:14.810243] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-19T18:40:14.810309] [INFO ] [LOCAL ] EQH: Starting deletion of derivative data. [2025-09-19T18:40:14.810711] [DEBUG] [LOCAL ] EQH: Deleted derivative data file. [2025-09-19T18:40:14.810869] [INFO ] [MAIN ] Update Progress: 757/2372 symbols completed. EQH took 35.0s. Estimated remaining: 3h 33m 43s. Rate: 7.6 symbols/min [2025-09-19T18:40:15.043271] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-19T18:40:15.465983] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T18:40:15.843261] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-19T18:40:16.266847] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-19T18:40:16.643267] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-19T18:40:17.443268] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-19T18:40:17.596506] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T18:40:18.243272] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-19T18:40:18.824432] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-19T18:40:19.043328] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-19T18:40:19.843281] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-19T18:40:20.264769] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-19T18:40:20.600082] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T18:40:20.643338] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-19T18:40:21.145087] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:40:21.443261] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-19T18:40:22.250299] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-19T18:40:22.269632] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T18:40:22.857048] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T18:40:22.856904] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T18:40:22.858822] [INFO ] [REMOTE ] EQS: Full fetch complete (2528 records). [2025-09-19T18:40:22.872718] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-19T18:40:23.048826] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-19T18:40:23.054326] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-19T18:40:23.055201] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:40:23.055276] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:40:23.055350] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-19T18:40:23.055409] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-19T18:40:23.055445] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-19T18:40:23.055502] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-19T18:40:23.055584] [INFO ] [MAIN ] Update Progress: 758/2372 symbols completed. EQS took 17.6s. Estimated remaining: 3h 33m 36s. Rate: 7.6 symbols/min [2025-09-19T18:40:23.843269] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-19T18:40:24.605057] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T18:40:24.643226] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-19T18:40:25.917180] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T18:40:25.928732] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-19T18:40:26.926498] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-19T18:40:26.938089] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-19T18:40:27.503261] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T18:40:27.510911] [INFO ] [REMOTE ] EQR: Full fetch complete (73682 records). [2025-09-19T18:40:27.511039] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-19T18:40:27.915548] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-19T18:40:27.915637] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-19T18:40:27.916627] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-19T18:40:27.916719] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-19T18:40:27.918301] [DEBUG] [LOCAL ] EQR: Trimmed 73682 records to 52136 (keeping 200 days of data) [2025-09-19T18:40:28.237996] [DEBUG] [LOCAL ] EQR: Primary data saved (52136 records). [2025-09-19T18:40:28.238169] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-19T18:40:28.238269] [INFO ] [MAIN ] Update Progress: 759/2372 symbols completed. EQR took 33.7s. Estimated remaining: 3h 33m 22s. Rate: 7.6 symbols/min [2025-09-19T18:40:28.588375] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T18:40:28.596215] [INFO ] [REMOTE ] EQNR: Full fetch complete (76744 records). [2025-09-19T18:40:28.596347] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-19T18:40:29.004685] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-19T18:40:29.004846] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-19T18:40:29.005775] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-19T18:40:29.005839] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-19T18:40:29.007390] [DEBUG] [LOCAL ] EQNR: Trimmed 76744 records to 53821 (keeping 200 days of data) [2025-09-19T18:40:29.337215] [DEBUG] [LOCAL ] EQNR: Primary data saved (53821 records). [2025-09-19T18:40:29.337359] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-19T18:40:29.337461] [INFO ] [MAIN ] Update Progress: 760/2372 symbols completed. EQNR took 39.4s. Estimated remaining: 3h 32m 60s. Rate: 7.6 symbols/min [2025-09-19T18:40:29.891107] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:30.046876] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:30.075363] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:30.097084] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:30.103084] [DEBUG] [LOCAL ] EQV: Loaded 2930 existing records from primary storage. [2025-09-19T18:40:30.103274] [INFO ] [MAIN ] EQV: Loaded 2930 existing records. [2025-09-19T18:40:30.263090] [DEBUG] [LOCAL ] ERO: Loaded 41425 existing records from primary storage. [2025-09-19T18:40:30.294434] [INFO ] [MAIN ] ERO: Loaded 41425 existing records. [2025-09-19T18:40:30.353596] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:30.400463] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-19T18:40:30.423173] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-19T18:40:30.447896] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-19T18:40:30.482530] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-09-19T18:40:30.497460] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-19T18:40:30.497767] [INFO ] [MAIN ] EQT: Loaded 54072 existing records. [2025-09-19T18:40:30.514107] [DEBUG] [LOCAL ] ERJ: Loaded 51280 existing records from primary storage. [2025-09-19T18:40:30.575631] [INFO ] [MAIN ] ERJ: Loaded 51280 existing records. [2025-09-19T18:40:30.838447] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:30.961373] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-19T18:40:31.006578] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-19T18:40:31.069815] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-19T18:40:31.080292] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-19T18:40:31.117789] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:31.210142] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-19T18:40:31.267159] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-19T18:40:31.415934] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-19T18:40:31.462449] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-19T18:40:31.354403] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:31.533536] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-19T18:40:31.623182] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-19T18:40:31.728269] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-19T18:40:31.769052] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-19T18:40:31.936970] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:31.973340] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-19T18:40:32.215497] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:32.246356] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-19T18:40:32.417760] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:32.433941] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-19T18:40:32.620603] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:32.620918] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-19T18:40:32.748847] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-19T18:40:32.750949] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-19T18:40:33.911884] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T18:40:33.914418] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-19T18:40:34.128492] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T18:40:34.136541] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-19T18:40:34.261400] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T18:40:34.271365] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-19T18:40:34.303891] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T18:40:34.314566] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-19T18:40:34.655322] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:40:34.657030] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-19T18:40:35.091574] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-19T18:40:35.093572] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-19T18:40:35.243448] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T18:40:35.607137] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-19T18:40:35.843271] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-19T18:40:36.186360] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T18:40:36.241069] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T18:40:36.378983] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T18:40:36.643276] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-19T18:40:37.443272] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-19T18:40:38.243264] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-19T18:40:38.596756] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T18:40:38.988203] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T18:40:39.043240] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-19T18:40:39.632479] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T18:40:39.843261] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-19T18:40:40.208027] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T18:40:40.643268] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-19T18:40:41.443261] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-19T18:40:41.568255] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T18:40:42.248414] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-19T18:40:42.274340] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-19T18:40:43.043258] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-19T18:40:43.206327] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T18:40:43.255949] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:40:43.843258] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-19T18:40:44.643283] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-19T18:40:45.003007] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T18:40:45.443266] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-19T18:40:45.543940] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T18:40:46.243243] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-19T18:40:46.897488] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T18:40:47.043276] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-19T18:40:47.320459] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T18:40:47.843241] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-19T18:40:47.972383] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T18:40:48.518164] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T18:40:48.519367] [INFO ] [REMOTE ] EQV: Full fetch complete (5709 records). [2025-09-19T18:40:48.519441] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-19T18:40:48.519898] [FATAL] [VALIDATOR ] EQV: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:40:48.519995] [FATAL] [MAIN ] EQV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:40:48.520064] [WARN ] [MAIN ] EQV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:40:48.520149] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-19T18:40:48.520233] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-09-19T18:40:48.520273] [INFO ] [LOCAL ] EQV: Starting deletion of derivative data. [2025-09-19T18:40:48.520721] [DEBUG] [LOCAL ] EQV: Deleted derivative data file. [2025-09-19T18:40:48.520844] [INFO ] [MAIN ] Update Progress: 761/2372 symbols completed. EQV took 19.2s. Estimated remaining: 3h 33m 15s. Rate: 7.6 symbols/min [2025-09-19T18:40:48.648384] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-19T18:40:48.728995] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:48.792223] [DEBUG] [LOCAL ] ES: Loaded 52905 existing records from primary storage. [2025-09-19T18:40:48.792386] [INFO ] [MAIN ] ES: Loaded 52905 existing records. [2025-09-19T18:40:48.981511] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:48.982118] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-19T18:40:48.982218] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-19T18:40:48.983794] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-19T18:40:48.983863] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-19T18:40:49.184095] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T18:40:49.424778] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:49.443220] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-19T18:40:49.997181] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:40:50.243276] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-19T18:40:51.043265] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-19T18:40:51.470816] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T18:40:51.843272] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-19T18:40:52.127123] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T18:40:52.643283] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-19T18:40:52.767618] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T18:40:53.316496] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T18:40:53.443324] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-19T18:40:54.243279] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-19T18:40:54.641297] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T18:40:54.916942] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T18:40:55.043399] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-19T18:40:55.549330] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T18:40:55.843316] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-19T18:40:56.643281] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-19T18:40:57.152705] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:40:57.443243] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-19T18:40:57.631139] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:40:58.243300] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-19T18:40:58.350268] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T18:40:59.043309] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-19T18:40:59.653264] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T18:40:59.843260] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-19T18:41:00.578357] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-19T18:41:00.643290] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-19T18:41:01.101934] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T18:41:01.443300] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-19T18:41:02.190590] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-19T18:41:02.199311] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-19T18:41:02.199531] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-19T18:41:02.266108] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-19T18:41:02.645022] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-19T18:41:02.645628] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-19T18:41:02.647572] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:41:02.658985] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-19T18:41:02.659601] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-19T18:41:02.661325] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 54462 (keeping 200 days of data) [2025-09-19T18:41:03.004147] [DEBUG] [LOCAL ] EQT: Primary data saved (54462 records). [2025-09-19T18:41:03.004343] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-19T18:41:03.004512] [INFO ] [MAIN ] Update Progress: 762/2372 symbols completed. EQT took 33.7s. Estimated remaining: 3h 33m 21s. Rate: 7.5 symbols/min [2025-09-19T18:41:03.048621] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-19T18:41:03.182515] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:03.210844] [DEBUG] [LOCAL ] ESAB: Loaded 25833 existing records from primary storage. [2025-09-19T18:41:03.210986] [INFO ] [MAIN ] ESAB: Loaded 25833 existing records. [2025-09-19T18:41:03.390342] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:03.390678] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-19T18:41:03.390753] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-19T18:41:03.391726] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-19T18:41:03.391811] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-19T18:41:03.784178] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T18:41:03.812541] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:03.842972] [INFO ] [REMOTE ] ERJ: Full fetch complete (72115 records). [2025-09-19T18:41:03.843581] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-19T18:41:03.843272] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-19T18:41:03.847235] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T18:41:03.926973] [INFO ] [REMOTE ] ERO: Full fetch complete (58908 records). [2025-09-19T18:41:03.938179] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-19T18:41:04.683189] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-19T18:41:04.708138] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-19T18:41:04.726598] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-19T18:41:04.730861] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-19T18:41:04.767091] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-19T18:41:04.767246] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-19T18:41:04.767930] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-19T18:41:04.768142] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-19T18:41:04.768452] [DEBUG] [LOCAL ] ERJ: Trimmed 72115 records to 51594 (keeping 200 days of data) [2025-09-19T18:41:04.770146] [DEBUG] [LOCAL ] ERO: Trimmed 58908 records to 41705 (keeping 200 days of data) [2025-09-19T18:41:05.311485] [DEBUG] [LOCAL ] ERO: Primary data saved (41705 records). [2025-09-19T18:41:05.327991] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-19T18:41:05.329383] [INFO ] [MAIN ] Update Progress: 763/2372 symbols completed. ERO took 36.0s. Estimated remaining: 3h 33m 1s. Rate: 7.6 symbols/min [2025-09-19T18:41:05.451709] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-19T18:41:05.479266] [DEBUG] [LOCAL ] ERJ: Primary data saved (51594 records). [2025-09-19T18:41:05.500533] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-19T18:41:05.514993] [INFO ] [MAIN ] Update Progress: 764/2372 symbols completed. ERJ took 36.2s. Estimated remaining: 3h 32m 37s. Rate: 7.6 symbols/min [2025-09-19T18:41:05.519998] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-19T18:41:05.609056] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T18:41:05.646474] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-19T18:41:05.709377] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:05.811305] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:05.819883] [DEBUG] [LOCAL ] ESE: Loaded 16775 existing records from primary storage. [2025-09-19T18:41:05.819996] [INFO ] [MAIN ] ESE: Loaded 16775 existing records. [2025-09-19T18:41:05.999984] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:06.013399] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-19T18:41:06.013477] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-19T18:41:06.014096] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-19T18:41:06.014156] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-19T18:41:06.159972] [DEBUG] [LOCAL ] ESI: Loaded 51232 existing records from primary storage. [2025-09-19T18:41:06.182866] [INFO ] [MAIN ] ESI: Loaded 51232 existing records. [2025-09-19T18:41:06.558535] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:06.577765] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-19T18:41:06.577704] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:06.578032] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-19T18:41:06.578120] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-19T18:41:06.580789] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-19T18:41:06.580877] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-19T18:41:06.939208] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:07.043220] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-19T18:41:07.072678] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T18:41:07.591301] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T18:41:07.690961] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T18:41:07.843242] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-19T18:41:08.643319] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-19T18:41:08.775266] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T18:41:08.860521] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T18:41:09.443248] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-19T18:41:09.604225] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T18:41:10.243284] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-19T18:41:10.853801] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T18:41:11.043288] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-19T18:41:11.843299] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-19T18:41:12.288192] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T18:41:12.643248] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-19T18:41:12.824412] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T18:41:13.155713] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T18:41:13.443306] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-19T18:41:14.243276] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-19T18:41:14.277923] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:41:14.810304] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:41:15.043257] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-19T18:41:15.843266] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-19T18:41:16.374146] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T18:41:16.545582] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T18:41:16.643219] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-19T18:41:17.443308] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-19T18:41:17.724211] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T18:41:17.886890] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T18:41:18.243284] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-19T18:41:18.691502] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T18:41:19.043307] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-19T18:41:19.843260] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-19T18:41:19.882742] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T18:41:20.643226] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-19T18:41:20.699474] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T18:41:20.710088] [INFO ] [REMOTE ] ES: Full fetch complete (76132 records). [2025-09-19T18:41:20.710226] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-19T18:41:21.120450] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-19T18:41:21.120582] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-19T18:41:21.121512] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-19T18:41:21.121576] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-19T18:41:21.123124] [DEBUG] [LOCAL ] ES: Trimmed 76132 records to 53295 (keeping 200 days of data) [2025-09-19T18:41:21.279146] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T18:41:21.455826] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-19T18:41:21.479831] [DEBUG] [LOCAL ] ES: Primary data saved (53295 records). [2025-09-19T18:41:21.479943] [INFO ] [MAIN ] ES: Full history saved. [2025-09-19T18:41:21.480115] [INFO ] [MAIN ] Update Progress: 765/2372 symbols completed. ES took 33.0s. Estimated remaining: 3h 32m 46s. Rate: 7.6 symbols/min [2025-09-19T18:41:21.653150] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:21.694696] [DEBUG] [LOCAL ] ESNT: Loaded 39104 existing records from primary storage. [2025-09-19T18:41:21.694929] [INFO ] [MAIN ] ESNT: Loaded 39104 existing records. [2025-09-19T18:41:21.888579] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:21.889150] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-19T18:41:21.889207] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-19T18:41:21.890402] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-19T18:41:21.890464] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-19T18:41:22.247510] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-19T18:41:22.273269] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:22.322672] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T18:41:22.817100] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T18:41:23.016986] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T18:41:23.043220] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-19T18:41:23.843280] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-19T18:41:24.191512] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:41:24.643280] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-19T18:41:25.325607] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T18:41:25.443293] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-19T18:41:25.868031] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T18:41:26.243296] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-19T18:41:26.854698] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T18:41:27.043291] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-19T18:41:27.843327] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-19T18:41:28.200288] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T18:41:28.205282] [INFO ] [REMOTE ] ESAB: Full fetch complete (35073 records). [2025-09-19T18:41:28.205377] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-19T18:41:28.640702] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-19T18:41:28.643761] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-19T18:41:28.643390] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-19T18:41:28.643568] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-19T18:41:28.644795] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-19T18:41:28.649030] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-19T18:41:28.667975] [DEBUG] [LOCAL ] ESAB: Trimmed 35073 records to 26149 (keeping 200 days of data) [2025-09-19T18:41:28.669342] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T18:41:28.673836] [INFO ] [REMOTE ] ESE: Full fetch complete (21800 records). [2025-09-19T18:41:28.673944] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-19T18:41:29.256848] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-19T18:41:29.258220] [DEBUG] [LOCAL ] ESAB: Primary data saved (26149 records). [2025-09-19T18:41:29.258322] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-19T18:41:29.258976] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-19T18:41:29.259057] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-19T18:41:29.259162] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-19T18:41:29.259503] [INFO ] [MAIN ] Update Progress: 766/2372 symbols completed. ESAB took 26.3s. Estimated remaining: 3h 32m 38s. Rate: 7.6 symbols/min [2025-09-19T18:41:29.305396] [DEBUG] [LOCAL ] ESE: Trimmed 21800 records to 16887 (keeping 200 days of data) [2025-09-19T18:41:29.446294] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-19T18:41:29.520341] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:29.567601] [DEBUG] [LOCAL ] ESE: Primary data saved (16887 records). [2025-09-19T18:41:29.567792] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-19T18:41:29.567892] [INFO ] [MAIN ] Update Progress: 767/2372 symbols completed. ESE took 24.2s. Estimated remaining: 3h 32m 14s. Rate: 7.6 symbols/min [2025-09-19T18:41:29.694858] [DEBUG] [LOCAL ] ESRT: Loaded 46741 existing records from primary storage. [2025-09-19T18:41:29.695451] [INFO ] [MAIN ] ESRT: Loaded 46741 existing records. [2025-09-19T18:41:29.887681] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:29.966986] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:29.967263] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-19T18:41:29.967311] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-19T18:41:29.968709] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-19T18:41:29.968773] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-19T18:41:30.263163] [DEBUG] [LOCAL ] ESS: Loaded 30329 existing records from primary storage. [2025-09-19T18:41:30.273913] [INFO ] [MAIN ] ESS: Loaded 30329 existing records. [2025-09-19T18:41:30.463050] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:30.466146] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-19T18:41:30.545461] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:30.545737] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-19T18:41:30.545795] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-19T18:41:30.546715] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-19T18:41:30.546777] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-19T18:41:30.906943] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:30.931243] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T18:41:31.043221] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-19T18:41:31.639612] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T18:41:31.843256] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-19T18:41:31.923209] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:41:32.643492] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-19T18:41:32.742903] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T18:41:33.443276] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-19T18:41:33.942253] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:41:34.044248] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T18:41:34.243246] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-19T18:41:35.043260] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-19T18:41:35.188107] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T18:41:35.843275] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-19T18:41:36.134897] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T18:41:36.142235] [INFO ] [REMOTE ] ESI: Full fetch complete (72267 records). [2025-09-19T18:41:36.142373] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-19T18:41:36.574161] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-19T18:41:36.574906] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-19T18:41:36.575896] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-19T18:41:36.576971] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T18:41:36.584911] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-19T18:41:36.587092] [DEBUG] [LOCAL ] ESI: Trimmed 72267 records to 51608 (keeping 200 days of data) [2025-09-19T18:41:36.643751] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-19T18:41:36.906318] [DEBUG] [LOCAL ] ESI: Primary data saved (51608 records). [2025-09-19T18:41:36.906482] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-19T18:41:36.906570] [INFO ] [MAIN ] Update Progress: 768/2372 symbols completed. ESI took 31.4s. Estimated remaining: 3h 32m 5s. Rate: 7.6 symbols/min [2025-09-19T18:41:37.075979] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:37.124289] [DEBUG] [LOCAL ] ESTC: Loaded 50598 existing records from primary storage. [2025-09-19T18:41:37.124428] [INFO ] [MAIN ] ESTC: Loaded 50598 existing records. [2025-09-19T18:41:37.301362] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:37.301615] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-19T18:41:37.301692] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-19T18:41:37.302888] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-19T18:41:37.302949] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-19T18:41:37.448473] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-19T18:41:37.678759] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:37.705912] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T18:41:38.243269] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-19T18:41:38.354344] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T18:41:39.043260] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-19T18:41:39.348270] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T18:41:39.668265] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:41:39.843262] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-19T18:41:40.643252] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-19T18:41:41.302119] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T18:41:41.443260] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-19T18:41:41.630225] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T18:41:42.243257] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-19T18:41:42.738247] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T18:41:43.043315] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-19T18:41:43.261023] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:41:43.776093] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T18:41:43.843226] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-19T18:41:44.371321] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T18:41:44.643268] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-19T18:41:45.443276] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-19T18:41:45.690636] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:41:46.243246] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-19T18:41:46.328361] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T18:41:47.043332] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-19T18:41:47.107021] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T18:41:47.693980] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T18:41:47.843261] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-19T18:41:48.643294] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-19T18:41:49.002575] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:41:49.234264] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:41:49.443289] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-19T18:41:49.813892] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T18:41:50.243278] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-19T18:41:50.945311] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T18:41:51.043271] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-19T18:41:51.843268] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-19T18:41:52.356843] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:41:52.408266] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T18:41:52.643256] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-19T18:41:53.443275] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-19T18:41:53.551438] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T18:41:54.243284] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-19T18:41:54.546474] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T18:41:55.043304] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-19T18:41:55.191134] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:41:55.843273] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-19T18:41:56.036739] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T18:41:56.643274] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-19T18:41:56.708958] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T18:41:56.714527] [INFO ] [REMOTE ] ESNT: Full fetch complete (57296 records). [2025-09-19T18:41:56.714633] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-19T18:41:57.167728] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-19T18:41:57.167817] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-19T18:41:57.168585] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-19T18:41:57.168625] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-19T18:41:57.169793] [DEBUG] [LOCAL ] ESNT: Trimmed 57296 records to 39389 (keeping 200 days of data) [2025-09-19T18:41:57.409155] [DEBUG] [LOCAL ] ESNT: Primary data saved (39389 records). [2025-09-19T18:41:57.409298] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-19T18:41:57.410217] [INFO ] [MAIN ] Update Progress: 769/2372 symbols completed. ESNT took 35.9s. Estimated remaining: 3h 32m 23s. Rate: 7.5 symbols/min [2025-09-19T18:41:57.453174] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-19T18:41:57.587402] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:57.648367] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-09-19T18:41:57.648514] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-09-19T18:41:57.827477] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:57.827837] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-19T18:41:57.828034] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-19T18:41:57.835205] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-19T18:41:57.848920] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T18:41:57.847844] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-19T18:41:57.946389] [INFO ] [REMOTE ] ESRT: Full fetch complete (66360 records). [2025-09-19T18:41:57.976101] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-19T18:41:58.497332] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:58.536979] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-19T18:41:58.660728] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-19T18:41:58.660907] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-19T18:41:58.661744] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-19T18:41:58.661823] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-19T18:41:58.692770] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T18:41:58.690787] [DEBUG] [LOCAL ] ESRT: Trimmed 66360 records to 47076 (keeping 200 days of data) [2025-09-19T18:41:58.984690] [DEBUG] [LOCAL ] ESRT: Primary data saved (47076 records). [2025-09-19T18:41:58.984830] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-19T18:41:58.984915] [INFO ] [MAIN ] Update Progress: 770/2372 symbols completed. ESRT took 29.7s. Estimated remaining: 3h 32m 2s. Rate: 7.6 symbols/min [2025-09-19T18:41:59.048870] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-19T18:41:59.157273] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:59.170851] [DEBUG] [LOCAL ] ETB: Loaded 12286 existing records from primary storage. [2025-09-19T18:41:59.170964] [INFO ] [MAIN ] ETB: Loaded 12286 existing records. [2025-09-19T18:41:59.353133] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:59.353504] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-19T18:41:59.353673] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-19T18:41:59.354173] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-19T18:41:59.354299] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-19T18:41:59.553407] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T18:41:59.741871] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:59.843226] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-19T18:42:00.643241] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-19T18:42:00.851743] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T18:42:00.859226] [INFO ] [REMOTE ] ESTC: Full fetch complete (72215 records). [2025-09-19T18:42:00.859349] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-19T18:42:01.162405] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T18:42:01.269842] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-19T18:42:01.270065] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-19T18:42:01.271107] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-19T18:42:01.271214] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-19T18:42:01.273546] [DEBUG] [LOCAL ] ESTC: Trimmed 72215 records to 50967 (keeping 200 days of data) [2025-09-19T18:42:01.426734] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-19T18:42:01.445429] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-19T18:42:01.624971] [DEBUG] [LOCAL ] ESTC: Primary data saved (50967 records). [2025-09-19T18:42:01.625122] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-19T18:42:01.625209] [INFO ] [MAIN ] Update Progress: 771/2372 symbols completed. ESTC took 24.7s. Estimated remaining: 3h 31m 43s. Rate: 7.6 symbols/min [2025-09-19T18:42:01.794821] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:01.823146] [DEBUG] [LOCAL ] ETD: Loaded 27603 existing records from primary storage. [2025-09-19T18:42:01.823290] [INFO ] [MAIN ] ETD: Loaded 27603 existing records. [2025-09-19T18:42:02.021348] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:02.021697] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-19T18:42:02.021789] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-19T18:42:02.022616] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-19T18:42:02.022724] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-19T18:42:02.254334] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-19T18:42:02.400186] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:02.610217] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:42:03.028822] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T18:42:03.043212] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-19T18:42:03.843258] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-19T18:42:04.241036] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T18:42:04.643243] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-19T18:42:05.204948] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-09-19T18:42:05.443289] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-19T18:42:05.818572] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T18:42:06.060449] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T18:42:06.243314] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-19T18:42:07.046007] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-19T18:42:07.331935] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:42:07.843278] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-19T18:42:08.207772] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T18:42:08.243528] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-19T18:42:08.652756] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-19T18:42:08.660306] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-19T18:42:09.443277] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-19T18:42:10.243230] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-19T18:42:10.408557] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T18:42:11.043304] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-19T18:42:11.367129] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-19T18:42:11.843276] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-19T18:42:11.876766] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T18:42:12.392423] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T18:42:12.643278] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-19T18:42:13.443292] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-19T18:42:14.243258] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-19T18:42:14.805988] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T18:42:14.964413] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-09-19T18:42:15.043274] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-19T18:42:15.234253] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:42:15.839150] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T18:42:15.843297] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-19T18:42:16.643319] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-19T18:42:16.967050] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T18:42:17.443291] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-19T18:42:17.639315] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:42:17.837189] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-19T18:42:18.243274] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-19T18:42:18.874050] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T18:42:18.878554] [INFO ] [REMOTE ] ESS: Full fetch complete (43309 records). [2025-09-19T18:42:18.878675] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-19T18:42:19.055686] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-19T18:42:19.271084] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-19T18:42:19.271220] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-19T18:42:19.271978] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-19T18:42:19.272048] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-19T18:42:19.273147] [DEBUG] [LOCAL ] ESS: Trimmed 43309 records to 30525 (keeping 200 days of data) [2025-09-19T18:42:19.466207] [DEBUG] [LOCAL ] ESS: Primary data saved (30525 records). [2025-09-19T18:42:19.466346] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-19T18:42:19.466434] [INFO ] [MAIN ] Update Progress: 772/2372 symbols completed. ESS took 49.9s. Estimated remaining: 3h 31m 55s. Rate: 7.5 symbols/min [2025-09-19T18:42:19.634737] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:19.652785] [DEBUG] [LOCAL ] ETG: Loaded 17132 existing records from primary storage. [2025-09-19T18:42:19.652917] [INFO ] [MAIN ] ETG: Loaded 17132 existing records. [2025-09-19T18:42:19.829637] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:19.829989] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-19T18:42:19.830048] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-19T18:42:19.830493] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-19T18:42:19.830552] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-19T18:42:19.861691] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-19T18:42:20.206145] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:20.236082] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:42:20.600584] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-19T18:42:20.643213] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-19T18:42:20.900499] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T18:42:21.443268] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-19T18:42:22.243268] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-19T18:42:22.956953] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T18:42:22.999582] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T18:42:23.043214] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-19T18:42:23.241792] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-19T18:42:23.843279] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-19T18:42:24.174910] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T18:42:24.179466] [INFO ] [REMOTE ] ETD: Full fetch complete (37901 records). [2025-09-19T18:42:24.179598] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-19T18:42:24.555805] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-19T18:42:24.555882] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-19T18:42:24.556517] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-19T18:42:24.556555] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-19T18:42:24.557390] [DEBUG] [LOCAL ] ETD: Trimmed 37901 records to 27755 (keeping 200 days of data) [2025-09-19T18:42:24.644281] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-19T18:42:24.722978] [DEBUG] [LOCAL ] ETD: Primary data saved (27755 records). [2025-09-19T18:42:24.723112] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-19T18:42:24.723196] [INFO ] [MAIN ] Update Progress: 773/2372 symbols completed. ETD took 23.1s. Estimated remaining: 3h 31m 42s. Rate: 7.6 symbols/min [2025-09-19T18:42:24.895410] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:24.913021] [DEBUG] [LOCAL ] ETJ: Loaded 17115 existing records from primary storage. [2025-09-19T18:42:24.913142] [INFO ] [MAIN ] ETJ: Loaded 17115 existing records. [2025-09-19T18:42:25.092390] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:25.092732] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-19T18:42:25.092910] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-19T18:42:25.098982] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-19T18:42:25.103451] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-19T18:42:25.136402] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T18:42:25.444597] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-19T18:42:25.466258] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:25.892893] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T18:42:26.243242] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-19T18:42:26.769126] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T18:42:27.043264] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-19T18:42:27.721017] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T18:42:27.722863] [INFO ] [REMOTE ] ETB: Full fetch complete (17781 records). [2025-09-19T18:42:27.722940] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-19T18:42:27.848377] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-19T18:42:28.096308] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-19T18:42:28.096388] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-19T18:42:28.096820] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-19T18:42:28.096880] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-19T18:42:28.097420] [DEBUG] [LOCAL ] ETB: Trimmed 17781 records to 12338 (keeping 200 days of data) [2025-09-19T18:42:28.172483] [DEBUG] [LOCAL ] ETB: Primary data saved (12338 records). [2025-09-19T18:42:28.172631] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-19T18:42:28.172765] [INFO ] [MAIN ] Update Progress: 774/2372 symbols completed. ETB took 29.2s. Estimated remaining: 3h 31m 25s. Rate: 7.6 symbols/min [2025-09-19T18:42:28.349754] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:28.405551] [DEBUG] [LOCAL ] ETN: Loaded 53258 existing records from primary storage. [2025-09-19T18:42:28.405729] [INFO ] [MAIN ] ETN: Loaded 53258 existing records. [2025-09-19T18:42:28.585692] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:28.586116] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-19T18:42:28.586187] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-19T18:42:28.587744] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-19T18:42:28.587808] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-19T18:42:28.643342] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-19T18:42:28.991166] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:28.993315] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-19T18:42:29.230434] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:42:29.443272] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-19T18:42:30.000346] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:42:30.243276] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-19T18:42:31.043236] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-19T18:42:31.480451] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T18:42:31.543525] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T18:42:31.843259] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-19T18:42:32.643270] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-19T18:42:33.443253] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-19T18:42:33.664163] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T18:42:33.694686] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-19T18:42:33.702843] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-19T18:42:33.702970] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-19T18:42:34.105512] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-19T18:42:34.105726] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-19T18:42:34.106815] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-19T18:42:34.118126] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T18:42:34.117765] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-19T18:42:34.129086] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54569 (keeping 200 days of data) [2025-09-19T18:42:34.135043] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T18:42:34.250694] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-19T18:42:34.467469] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-09-19T18:42:34.467604] [INFO ] [MAIN ] ET: Full history saved. [2025-09-19T18:42:34.467716] [INFO ] [MAIN ] Update Progress: 775/2372 symbols completed. ET took 37.1s. Estimated remaining: 3h 31m 13s. Rate: 7.6 symbols/min [2025-09-19T18:42:34.634635] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:34.642803] [DEBUG] [LOCAL ] ETO: Loaded 6678 existing records from primary storage. [2025-09-19T18:42:34.642901] [INFO ] [MAIN ] ETO: Loaded 6678 existing records. [2025-09-19T18:42:34.827074] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:34.827333] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-19T18:42:34.827391] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-19T18:42:34.827742] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-19T18:42:34.827802] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-19T18:42:35.048444] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-19T18:42:35.183281] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:35.738816] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:42:35.843218] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-19T18:42:36.643263] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-19T18:42:37.177667] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T18:42:37.417266] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-19T18:42:37.443227] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-19T18:42:37.693242] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T18:42:38.243232] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-19T18:42:38.265963] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T18:42:39.043275] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-19T18:42:39.636738] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:42:39.843275] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-19T18:42:40.643271] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-19T18:42:40.764809] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T18:42:40.941269] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:42:41.443267] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-19T18:42:42.247056] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-19T18:42:42.249426] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T18:42:43.043287] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-19T18:42:43.331527] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T18:42:43.411489] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T18:42:43.631583] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-19T18:42:43.843230] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-19T18:42:44.643300] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-19T18:42:45.175414] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:42:45.178389] [INFO ] [REMOTE ] ETG: Full fetch complete (25109 records). [2025-09-19T18:42:45.178482] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-19T18:42:45.448379] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-19T18:42:45.608263] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-19T18:42:45.608383] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-19T18:42:45.608963] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-19T18:42:45.609026] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-19T18:42:45.609961] [DEBUG] [LOCAL ] ETG: Trimmed 25109 records to 17227 (keeping 200 days of data) [2025-09-19T18:42:45.713493] [DEBUG] [LOCAL ] ETG: Primary data saved (17227 records). [2025-09-19T18:42:45.713633] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-19T18:42:45.713757] [INFO ] [MAIN ] Update Progress: 776/2372 symbols completed. ETG took 26.2s. Estimated remaining: 3h 31m 12s. Rate: 7.6 symbols/min [2025-09-19T18:42:45.851400] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T18:42:45.903576] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:45.960868] [DEBUG] [LOCAL ] ETR: Loaded 53626 existing records from primary storage. [2025-09-19T18:42:45.961010] [INFO ] [MAIN ] ETR: Loaded 53626 existing records. [2025-09-19T18:42:46.137639] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:46.137931] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-19T18:42:46.138004] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-19T18:42:46.139309] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-19T18:42:46.139375] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-19T18:42:46.248475] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-19T18:42:46.507497] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:47.043310] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-19T18:42:47.200370] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:42:47.572359] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T18:42:47.844980] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-19T18:42:47.846775] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T18:42:48.340393] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-19T18:42:48.643267] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-19T18:42:49.166818] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-19T18:42:49.443327] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-19T18:42:50.243265] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-19T18:42:50.331039] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T18:42:51.043300] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-19T18:42:51.843473] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-19T18:42:51.917172] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T18:42:51.929089] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:42:52.643309] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-19T18:42:53.443276] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-19T18:42:53.586610] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:42:53.628007] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T18:42:54.169463] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:42:54.172433] [INFO ] [REMOTE ] ETJ: Full fetch complete (24925 records). [2025-09-19T18:42:54.172511] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-19T18:42:54.248324] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-19T18:42:54.538408] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-19T18:42:54.538485] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-19T18:42:54.538989] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-19T18:42:54.539050] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-19T18:42:54.539722] [DEBUG] [LOCAL ] ETJ: Trimmed 24925 records to 17236 (keeping 200 days of data) [2025-09-19T18:42:54.639050] [DEBUG] [LOCAL ] ETJ: Primary data saved (17236 records). [2025-09-19T18:42:54.639186] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-19T18:42:54.639269] [INFO ] [MAIN ] Update Progress: 777/2372 symbols completed. ETJ took 29.9s. Estimated remaining: 3h 31m 6s. Rate: 7.6 symbols/min [2025-09-19T18:42:54.811328] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:54.833954] [DEBUG] [LOCAL ] ETV: Loaded 21803 existing records from primary storage. [2025-09-19T18:42:54.834074] [INFO ] [MAIN ] ETV: Loaded 21803 existing records. [2025-09-19T18:42:55.010566] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:55.010853] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-19T18:42:55.010901] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-19T18:42:55.011560] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-19T18:42:55.011620] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-19T18:42:55.053474] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-19T18:42:55.368973] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:55.843248] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-19T18:42:56.194544] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T18:42:56.643251] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-19T18:42:56.796924] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T18:42:57.148914] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T18:42:57.443269] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-19T18:42:57.649543] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T18:42:58.243265] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-19T18:42:59.043274] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-19T18:42:59.123239] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T18:42:59.843294] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-19T18:43:00.062717] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-19T18:43:00.643305] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-19T18:43:01.253495] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T18:43:01.396225] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T18:43:01.443222] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-19T18:43:02.243261] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-19T18:43:02.686143] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T18:43:02.695050] [INFO ] [REMOTE ] ETN: Full fetch complete (76560 records). [2025-09-19T18:43:02.695241] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-19T18:43:03.047738] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-19T18:43:03.114304] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T18:43:03.114556] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-19T18:43:03.116877] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-19T18:43:03.117958] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-19T18:43:03.118133] [INFO ] [REMOTE ] ETO: Full fetch complete (9281 records). [2025-09-19T18:43:03.118454] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-19T18:43:03.118373] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-19T18:43:03.221540] [DEBUG] [LOCAL ] ETN: Trimmed 76560 records to 53621 (keeping 200 days of data) [2025-09-19T18:43:03.522041] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T18:43:03.660911] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-19T18:43:03.661759] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-19T18:43:03.662499] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-19T18:43:03.662578] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-19T18:43:03.663937] [DEBUG] [LOCAL ] ETO: Trimmed 9281 records to 6704 (keeping 200 days of data) [2025-09-19T18:43:03.709064] [DEBUG] [LOCAL ] ETO: Primary data saved (6704 records). [2025-09-19T18:43:03.711254] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-19T18:43:03.711675] [INFO ] [MAIN ] Update Progress: 778/2372 symbols completed. ETO took 29.2s. Estimated remaining: 3h 31m 1s. Rate: 7.6 symbols/min [2025-09-19T18:43:03.847042] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-19T18:43:03.897940] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:04.030252] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T18:43:04.029476] [DEBUG] [LOCAL ] ETW: Loaded 25572 existing records from primary storage. [2025-09-19T18:43:04.035842] [INFO ] [MAIN ] ETW: Loaded 25572 existing records. [2025-09-19T18:43:04.231042] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:04.232115] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-19T18:43:04.232898] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-19T18:43:04.234539] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-19T18:43:04.235183] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-19T18:43:04.633904] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:04.644483] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-19T18:43:04.736540] [DEBUG] [LOCAL ] ETN: Primary data saved (53621 records). [2025-09-19T18:43:04.736878] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-19T18:43:04.737015] [INFO ] [MAIN ] Update Progress: 779/2372 symbols completed. ETN took 36.6s. Estimated remaining: 3h 30m 39s. Rate: 7.6 symbols/min [2025-09-19T18:43:04.920121] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:04.927018] [DEBUG] [LOCAL ] ETX: Loaded 4940 existing records from primary storage. [2025-09-19T18:43:04.927115] [INFO ] [MAIN ] ETX: Loaded 4940 existing records. [2025-09-19T18:43:05.100230] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:05.100472] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-19T18:43:05.100521] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-19T18:43:05.100861] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-19T18:43:05.100921] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-19T18:43:05.447995] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-19T18:43:05.472684] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:05.903951] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T18:43:06.221445] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T18:43:06.243210] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-19T18:43:07.043251] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-19T18:43:07.057962] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T18:43:07.129354] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T18:43:07.843243] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-19T18:43:08.024586] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T18:43:08.643237] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-19T18:43:09.199934] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:43:09.406432] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T18:43:09.443279] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-19T18:43:10.127899] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-19T18:43:10.243299] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-19T18:43:11.043274] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-19T18:43:11.843268] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-19T18:43:11.851155] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T18:43:11.872225] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T18:43:12.643228] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-19T18:43:13.148355] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:43:13.443310] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-19T18:43:14.188351] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T18:43:14.201017] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T18:43:14.243232] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-19T18:43:15.043278] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-19T18:43:15.239157] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:43:15.843246] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-19T18:43:16.643243] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-19T18:43:16.703094] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T18:43:17.113896] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-19T18:43:17.443253] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-19T18:43:17.650854] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T18:43:18.243278] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-19T18:43:18.951302] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T18:43:19.032496] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T18:43:19.043204] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-19T18:43:19.843270] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-19T18:43:20.314517] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T18:43:20.643274] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-19T18:43:21.324161] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:43:21.443332] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-19T18:43:21.872606] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T18:43:22.131025] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T18:43:22.243244] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-19T18:43:23.043272] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-19T18:43:23.848352] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-19T18:43:23.869629] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T18:43:24.346271] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T18:43:24.349873] [INFO ] [REMOTE ] ETV: Full fetch complete (31851 records). [2025-09-19T18:43:24.349957] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-19T18:43:24.648502] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-19T18:43:24.731924] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-19T18:43:24.732048] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-19T18:43:24.732835] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-19T18:43:24.732916] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-19T18:43:24.734057] [DEBUG] [LOCAL ] ETV: Trimmed 31851 records to 21937 (keeping 200 days of data) [2025-09-19T18:43:24.836746] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T18:43:24.886324] [DEBUG] [LOCAL ] ETV: Primary data saved (21937 records). [2025-09-19T18:43:24.886515] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-19T18:43:24.886671] [INFO ] [MAIN ] Update Progress: 780/2372 symbols completed. ETV took 30.2s. Estimated remaining: 3h 30m 56s. Rate: 7.5 symbols/min [2025-09-19T18:43:25.055322] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:25.082479] [DEBUG] [LOCAL ] ETY: Loaded 23221 existing records from primary storage. [2025-09-19T18:43:25.082626] [INFO ] [MAIN ] ETY: Loaded 23221 existing records. [2025-09-19T18:43:25.258187] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:25.258435] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-19T18:43:25.258483] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-19T18:43:25.259183] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-19T18:43:25.259280] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-19T18:43:25.454001] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-19T18:43:25.623423] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:25.667437] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:43:26.243282] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-19T18:43:26.429226] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T18:43:26.430768] [INFO ] [REMOTE ] ETX: Full fetch complete (6965 records). [2025-09-19T18:43:26.430840] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-19T18:43:26.806144] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-19T18:43:26.806247] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-19T18:43:26.806448] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-19T18:43:26.806489] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-19T18:43:26.806930] [DEBUG] [LOCAL ] ETX: Trimmed 6965 records to 4960 (keeping 200 days of data) [2025-09-19T18:43:26.842904] [DEBUG] [LOCAL ] ETX: Primary data saved (4960 records). [2025-09-19T18:43:26.843134] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-19T18:43:26.843297] [INFO ] [MAIN ] Update Progress: 781/2372 symbols completed. ETX took 22.1s. Estimated remaining: 3h 30m 35s. Rate: 7.6 symbols/min [2025-09-19T18:43:27.015406] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:27.035974] [DEBUG] [LOCAL ] EVC: Loaded 20499 existing records from primary storage. [2025-09-19T18:43:27.036096] [INFO ] [MAIN ] EVC: Loaded 20499 existing records. [2025-09-19T18:43:27.048746] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-19T18:43:27.216417] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:27.216720] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-19T18:43:27.216784] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-19T18:43:27.217421] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-19T18:43:27.217490] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-19T18:43:27.571060] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:27.843261] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-19T18:43:27.992914] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:43:28.360867] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T18:43:28.643268] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-19T18:43:28.892013] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T18:43:29.443243] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-19T18:43:29.460873] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T18:43:30.243270] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-19T18:43:31.043254] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-19T18:43:31.456878] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T18:43:31.469109] [INFO ] [REMOTE ] ETR: Full fetch complete (76955 records). [2025-09-19T18:43:31.469266] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-19T18:43:31.866760] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-19T18:43:31.894231] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:43:31.885400] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-19T18:43:31.894852] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-19T18:43:31.902563] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-19T18:43:31.902760] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-19T18:43:31.923438] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T18:43:31.928918] [DEBUG] [LOCAL ] ETR: Trimmed 76955 records to 54016 (keeping 200 days of data) [2025-09-19T18:43:32.290309] [DEBUG] [LOCAL ] ETR: Primary data saved (54016 records). [2025-09-19T18:43:32.290500] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-19T18:43:32.290710] [INFO ] [MAIN ] Update Progress: 782/2372 symbols completed. ETR took 46.6s. Estimated remaining: 3h 30m 22s. Rate: 7.6 symbols/min [2025-09-19T18:43:32.479431] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:32.510331] [DEBUG] [LOCAL ] EVEX: Loaded 29397 existing records from primary storage. [2025-09-19T18:43:32.510499] [INFO ] [MAIN ] EVEX: Loaded 29397 existing records. [2025-09-19T18:43:32.649262] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-19T18:43:32.698998] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:32.699267] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-19T18:43:32.699336] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-19T18:43:32.700251] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-19T18:43:32.700322] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-19T18:43:33.079759] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:33.297689] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T18:43:33.443231] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-19T18:43:34.243294] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-19T18:43:34.376097] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T18:43:34.545455] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T18:43:35.043256] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-19T18:43:35.609608] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:43:35.843277] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-19T18:43:35.952282] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T18:43:36.643276] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-19T18:43:36.952110] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T18:43:37.443273] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-19T18:43:38.100051] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T18:43:38.243217] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-19T18:43:38.663015] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T18:43:39.043282] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-19T18:43:39.843297] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-19T18:43:40.007256] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T18:43:40.467626] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T18:43:40.471410] [INFO ] [REMOTE ] ETW: Full fetch complete (36422 records). [2025-09-19T18:43:40.471533] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-19T18:43:40.693814] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-19T18:43:40.902765] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-19T18:43:40.902885] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-19T18:43:40.903755] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-19T18:43:40.903875] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-19T18:43:40.911673] [DEBUG] [LOCAL ] ETW: Trimmed 36422 records to 25741 (keeping 200 days of data) [2025-09-19T18:43:40.923067] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T18:43:41.098220] [DEBUG] [LOCAL ] ETW: Primary data saved (25741 records). [2025-09-19T18:43:41.098367] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-19T18:43:41.098485] [INFO ] [MAIN ] Update Progress: 783/2372 symbols completed. ETW took 37.4s. Estimated remaining: 3h 30m 16s. Rate: 7.6 symbols/min [2025-09-19T18:43:41.266567] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:41.277091] [DEBUG] [LOCAL ] EVF: Loaded 9156 existing records from primary storage. [2025-09-19T18:43:41.277206] [INFO ] [MAIN ] EVF: Loaded 9156 existing records. [2025-09-19T18:43:41.445407] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-19T18:43:41.459677] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:41.461213] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-19T18:43:41.461270] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-19T18:43:41.461779] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-19T18:43:41.461858] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-19T18:43:41.816299] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:42.229037] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T18:43:42.243241] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-19T18:43:42.871144] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:43:42.987048] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:43:43.043225] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-19T18:43:43.843234] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-19T18:43:43.924995] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T18:43:44.643284] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-19T18:43:45.113195] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T18:43:45.443289] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-19T18:43:46.059634] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T18:43:46.243229] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-19T18:43:46.333078] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T18:43:47.043303] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-19T18:43:47.226823] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T18:43:47.843275] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-19T18:43:48.075247] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T18:43:48.643294] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-19T18:43:48.684906] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T18:43:49.443283] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-19T18:43:49.662706] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:43:50.243238] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-19T18:43:50.670297] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:43:50.673502] [INFO ] [REMOTE ] ETY: Full fetch complete (34362 records). [2025-09-19T18:43:50.673580] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-19T18:43:51.050373] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-19T18:43:51.054766] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-19T18:43:51.054896] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-19T18:43:51.055590] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-19T18:43:51.055636] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-19T18:43:51.056705] [DEBUG] [LOCAL ] ETY: Trimmed 34362 records to 23320 (keeping 200 days of data) [2025-09-19T18:43:51.231771] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T18:43:51.231307] [DEBUG] [LOCAL ] ETY: Primary data saved (23320 records). [2025-09-19T18:43:51.236208] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-19T18:43:51.236525] [INFO ] [MAIN ] Update Progress: 784/2372 symbols completed. ETY took 26.3s. Estimated remaining: 3h 30m 13s. Rate: 7.6 symbols/min [2025-09-19T18:43:51.408134] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:51.416832] [DEBUG] [LOCAL ] EVG: Loaded 5860 existing records from primary storage. [2025-09-19T18:43:51.416948] [INFO ] [MAIN ] EVG: Loaded 5860 existing records. [2025-09-19T18:43:51.541132] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T18:43:51.610002] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:51.610317] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-19T18:43:51.610369] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-19T18:43:51.610810] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-19T18:43:51.610870] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-19T18:43:51.851598] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-19T18:43:51.984573] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:52.643310] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-19T18:43:52.723244] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T18:43:53.443284] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-19T18:43:53.829605] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:43:54.243267] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-19T18:43:54.635892] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T18:43:55.043303] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-19T18:43:55.653747] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T18:43:55.746457] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T18:43:55.843266] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-19T18:43:56.643282] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-19T18:43:57.058568] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T18:43:57.061691] [INFO ] [REMOTE ] EVC: Full fetch complete (31320 records). [2025-09-19T18:43:57.061798] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-19T18:43:57.437373] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-19T18:43:57.437729] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-19T18:43:57.438364] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-19T18:43:57.438408] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-19T18:43:57.439482] [DEBUG] [LOCAL ] EVC: Trimmed 31320 records to 20566 (keeping 200 days of data) [2025-09-19T18:43:57.443278] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-19T18:43:57.581171] [DEBUG] [LOCAL ] EVC: Primary data saved (20566 records). [2025-09-19T18:43:57.581308] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-19T18:43:57.581414] [INFO ] [MAIN ] Update Progress: 785/2372 symbols completed. EVC took 30.7s. Estimated remaining: 3h 30m 2s. Rate: 7.6 symbols/min [2025-09-19T18:43:57.761912] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:57.818577] [DEBUG] [LOCAL ] EVH: Loaded 49711 existing records from primary storage. [2025-09-19T18:43:57.818791] [INFO ] [MAIN ] EVH: Loaded 49711 existing records. [2025-09-19T18:43:57.939869] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T18:43:58.022047] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:58.022497] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-19T18:43:58.022572] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-19T18:43:58.031281] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-19T18:43:58.043727] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-19T18:43:58.109538] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:43:58.251932] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-19T18:43:58.412115] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:59.043279] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-19T18:43:59.432520] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:43:59.446935] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T18:43:59.843273] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-19T18:44:00.643299] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-19T18:44:01.435631] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T18:44:01.446054] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-19T18:44:01.619100] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:44:02.243284] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-19T18:44:03.000571] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T18:44:03.043236] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-19T18:44:03.584886] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T18:44:03.843275] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-19T18:44:04.643272] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-19T18:44:04.664877] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-19T18:44:04.988171] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T18:44:04.996457] [INFO ] [REMOTE ] EVEX: Full fetch complete (41339 records). [2025-09-19T18:44:04.996698] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-19T18:44:05.381398] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-19T18:44:05.381550] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-19T18:44:05.386512] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-19T18:44:05.387049] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-19T18:44:05.387242] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T18:44:05.390105] [DEBUG] [LOCAL ] EVEX: Trimmed 41339 records to 29763 (keeping 200 days of data) [2025-09-19T18:44:05.449872] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-19T18:44:05.561343] [DEBUG] [LOCAL ] EVEX: Primary data saved (29763 records). [2025-09-19T18:44:05.561491] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-19T18:44:05.561577] [INFO ] [MAIN ] Update Progress: 786/2372 symbols completed. EVEX took 33.3s. Estimated remaining: 3h 29m 54s. Rate: 7.6 symbols/min [2025-09-19T18:44:05.733320] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:05.745762] [DEBUG] [LOCAL ] EVN: Loaded 11003 existing records from primary storage. [2025-09-19T18:44:05.745877] [INFO ] [MAIN ] EVN: Loaded 11003 existing records. [2025-09-19T18:44:05.923264] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:05.923538] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-19T18:44:05.923598] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-19T18:44:05.924089] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-19T18:44:05.924149] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-19T18:44:06.245237] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-19T18:44:06.284319] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:06.351985] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T18:44:07.043282] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-19T18:44:07.132207] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T18:44:07.843276] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-19T18:44:07.874518] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T18:44:08.353141] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T18:44:08.643272] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-19T18:44:09.252309] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T18:44:09.443267] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-19T18:44:10.243263] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-19T18:44:10.822467] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:44:11.043300] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-19T18:44:11.843267] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-19T18:44:12.022729] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:44:12.061817] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T18:44:12.355493] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T18:44:12.643267] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-19T18:44:13.443275] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-19T18:44:13.692619] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T18:44:14.243257] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-19T18:44:14.577342] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:44:14.847674] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T18:44:15.043271] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-19T18:44:15.753990] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T18:44:15.755466] [INFO ] [REMOTE ] EVG: Full fetch complete (8047 records). [2025-09-19T18:44:15.755557] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-19T18:44:15.848359] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-19T18:44:16.131119] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-19T18:44:16.131244] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-19T18:44:16.131474] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-19T18:44:16.131528] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-19T18:44:16.132046] [DEBUG] [LOCAL ] EVG: Trimmed 8047 records to 5883 (keeping 200 days of data) [2025-09-19T18:44:16.171555] [DEBUG] [LOCAL ] EVG: Primary data saved (5883 records). [2025-09-19T18:44:16.171742] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-19T18:44:16.171882] [INFO ] [MAIN ] Update Progress: 787/2372 symbols completed. EVG took 24.9s. Estimated remaining: 3h 29m 51s. Rate: 7.6 symbols/min [2025-09-19T18:44:16.347859] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:16.396627] [DEBUG] [LOCAL ] EVR: Loaded 36199 existing records from primary storage. [2025-09-19T18:44:16.396799] [INFO ] [MAIN ] EVR: Loaded 36199 existing records. [2025-09-19T18:44:16.581291] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:16.581553] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-19T18:44:16.581613] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-19T18:44:16.582816] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-19T18:44:16.582876] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-19T18:44:16.648354] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-19T18:44:16.974503] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:17.443300] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-19T18:44:17.613209] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T18:44:17.773513] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T18:44:18.243290] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-19T18:44:18.949080] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T18:44:19.043269] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-19T18:44:19.424109] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:44:19.843268] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-19T18:44:20.034234] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T18:44:20.643273] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-19T18:44:21.364461] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T18:44:21.443225] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-19T18:44:22.195415] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T18:44:22.243242] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-19T18:44:23.041553] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T18:44:23.051170] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-19T18:44:23.843252] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-19T18:44:23.892119] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T18:44:24.117586] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:44:24.119337] [INFO ] [REMOTE ] EVF: Full fetch complete (11668 records). [2025-09-19T18:44:24.119407] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-19T18:44:24.479460] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-19T18:44:24.479567] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-19T18:44:24.479862] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-19T18:44:24.479922] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-19T18:44:24.480397] [DEBUG] [LOCAL ] EVF: Trimmed 11668 records to 9194 (keeping 200 days of data) [2025-09-19T18:44:24.534848] [DEBUG] [LOCAL ] EVF: Primary data saved (9194 records). [2025-09-19T18:44:24.534969] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-19T18:44:24.535053] [INFO ] [MAIN ] Update Progress: 788/2372 symbols completed. EVF took 43.4s. Estimated remaining: 3h 29m 44s. Rate: 7.6 symbols/min [2025-09-19T18:44:24.648392] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-19T18:44:24.712971] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:24.721729] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T18:44:24.739263] [DEBUG] [LOCAL ] EVT: Loaded 17782 existing records from primary storage. [2025-09-19T18:44:24.739370] [INFO ] [MAIN ] EVT: Loaded 17782 existing records. [2025-09-19T18:44:24.915288] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:24.915579] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-19T18:44:24.915628] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-19T18:44:24.916233] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-19T18:44:24.916292] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-19T18:44:25.267873] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:25.443253] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-19T18:44:26.243241] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-19T18:44:26.521569] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:44:26.616123] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T18:44:27.043265] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-19T18:44:27.843301] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-19T18:44:27.996599] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T18:44:28.075746] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T18:44:28.462893] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-19T18:44:28.643248] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-19T18:44:29.443259] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-19T18:44:29.698397] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T18:44:30.169902] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:44:30.172107] [INFO ] [REMOTE ] EVN: Full fetch complete (17450 records). [2025-09-19T18:44:30.172180] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-19T18:44:30.248356] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-19T18:44:30.534369] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-19T18:44:30.534446] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-19T18:44:30.534834] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-19T18:44:30.534898] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-19T18:44:30.535429] [DEBUG] [LOCAL ] EVN: Trimmed 17450 records to 11051 (keeping 200 days of data) [2025-09-19T18:44:30.600842] [DEBUG] [LOCAL ] EVN: Primary data saved (11051 records). [2025-09-19T18:44:30.600987] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-19T18:44:30.601072] [INFO ] [MAIN ] Update Progress: 789/2372 symbols completed. EVN took 25.0s. Estimated remaining: 3h 29m 32s. Rate: 7.6 symbols/min [2025-09-19T18:44:30.768701] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:30.795169] [DEBUG] [LOCAL ] EVTC: Loaded 26890 existing records from primary storage. [2025-09-19T18:44:30.795298] [INFO ] [MAIN ] EVTC: Loaded 26890 existing records. [2025-09-19T18:44:30.975775] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:30.976114] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-19T18:44:30.976178] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-19T18:44:30.977017] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-19T18:44:30.977075] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-19T18:44:31.051779] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-19T18:44:31.331314] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:31.618900] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:44:31.843251] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-19T18:44:32.643241] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-19T18:44:32.954688] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T18:44:33.140583] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T18:44:33.443247] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-19T18:44:34.024832] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:44:34.243258] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-19T18:44:35.043248] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-19T18:44:35.215849] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T18:44:35.606336] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T18:44:35.843230] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-19T18:44:36.643230] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-19T18:44:36.705466] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:44:37.443239] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-19T18:44:37.495839] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T18:44:37.824056] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:44:38.243239] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-19T18:44:38.379217] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T18:44:39.043264] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-19T18:44:39.843267] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-19T18:44:40.011194] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:44:40.521491] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:44:40.529077] [INFO ] [REMOTE ] EVH: Full fetch complete (71724 records). [2025-09-19T18:44:40.529232] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-19T18:44:40.648432] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-19T18:44:40.942027] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-19T18:44:40.942174] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-19T18:44:40.943115] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-19T18:44:40.943181] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-19T18:44:40.944739] [DEBUG] [LOCAL ] EVH: Trimmed 71724 records to 50085 (keeping 200 days of data) [2025-09-19T18:44:41.235503] [DEBUG] [LOCAL ] EVH: Primary data saved (50085 records). [2025-09-19T18:44:41.235682] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-19T18:44:41.235793] [INFO ] [MAIN ] Update Progress: 790/2372 symbols completed. EVH took 43.7s. Estimated remaining: 3h 29m 30s. Rate: 7.6 symbols/min [2025-09-19T18:44:41.413785] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:41.436903] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T18:44:41.443981] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-19T18:44:41.476894] [DEBUG] [LOCAL ] EVTL: Loaded 36740 existing records from primary storage. [2025-09-19T18:44:41.477076] [INFO ] [MAIN ] EVTL: Loaded 36740 existing records. [2025-09-19T18:44:41.662559] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:41.662918] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-19T18:44:41.662987] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-19T18:44:41.663910] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-19T18:44:41.663978] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-19T18:44:42.055882] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:42.243289] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-19T18:44:42.266391] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:44:42.699538] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T18:44:43.043243] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-19T18:44:43.843283] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-19T18:44:43.880306] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T18:44:44.225134] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T18:44:44.643297] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-19T18:44:44.751527] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T18:44:45.443338] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-19T18:44:46.038422] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T18:44:46.243278] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-19T18:44:46.785984] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T18:44:47.043280] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-19T18:44:47.843260] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-19T18:44:47.886221] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T18:44:47.978315] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T18:44:48.643268] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-19T18:44:48.707676] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T18:44:49.443347] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-19T18:44:50.243276] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-19T18:44:50.363410] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T18:44:50.987879] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T18:44:51.043239] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-19T18:44:51.385797] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T18:44:51.388490] [INFO ] [REMOTE ] EVT: Full fetch complete (25507 records). [2025-09-19T18:44:51.388576] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-19T18:44:51.764323] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-19T18:44:51.764409] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-19T18:44:51.764950] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-19T18:44:51.765013] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-19T18:44:51.765802] [DEBUG] [LOCAL ] EVT: Trimmed 25507 records to 17841 (keeping 200 days of data) [2025-09-19T18:44:51.845512] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-19T18:44:51.878823] [DEBUG] [LOCAL ] EVT: Primary data saved (17841 records). [2025-09-19T18:44:51.878952] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-19T18:44:51.879038] [INFO ] [MAIN ] Update Progress: 791/2372 symbols completed. EVT took 27.3s. Estimated remaining: 3h 29m 27s. Rate: 7.5 symbols/min [2025-09-19T18:44:52.054921] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:52.077717] [DEBUG] [LOCAL ] EVTR: Loaded 23028 existing records from primary storage. [2025-09-19T18:44:52.077872] [INFO ] [MAIN ] EVTR: Loaded 23028 existing records. [2025-09-19T18:44:52.265302] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:52.265609] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-19T18:44:52.265690] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-19T18:44:52.266420] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-19T18:44:52.266481] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-19T18:44:52.633771] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:52.646446] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-19T18:44:52.650979] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T18:44:52.891285] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T18:44:53.443266] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-19T18:44:54.002460] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:44:54.243318] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-19T18:44:55.048552] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-19T18:44:55.050870] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T18:44:55.055882] [INFO ] [REMOTE ] EVR: Full fetch complete (50675 records). [2025-09-19T18:44:55.055980] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-19T18:44:55.461811] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-19T18:44:55.461955] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-19T18:44:55.462703] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-19T18:44:55.462785] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-19T18:44:55.464112] [DEBUG] [LOCAL ] EVR: Trimmed 50675 records to 36434 (keeping 200 days of data) [2025-09-19T18:44:55.703727] [DEBUG] [LOCAL ] EVR: Primary data saved (36434 records). [2025-09-19T18:44:55.703883] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-19T18:44:55.703983] [INFO ] [MAIN ] Update Progress: 792/2372 symbols completed. EVR took 39.5s. Estimated remaining: 3h 29m 11s. Rate: 7.6 symbols/min [2025-09-19T18:44:55.845087] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-19T18:44:55.882486] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:55.913976] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T18:44:55.960731] [DEBUG] [LOCAL ] EW: Loaded 53787 existing records from primary storage. [2025-09-19T18:44:55.960877] [INFO ] [MAIN ] EW: Loaded 53787 existing records. [2025-09-19T18:44:56.169741] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:56.171518] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T18:44:56.175978] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-19T18:44:56.176767] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-19T18:44:56.177860] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-19T18:44:56.177921] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-19T18:44:56.545051] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:56.643221] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-19T18:44:57.070113] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:44:57.075233] [INFO ] [REMOTE ] EVTC: Full fetch complete (37882 records). [2025-09-19T18:44:57.075342] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-19T18:44:57.448085] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-19T18:44:57.458035] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-19T18:44:57.459400] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-19T18:44:57.460097] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-19T18:44:57.460163] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-19T18:44:57.461145] [DEBUG] [LOCAL ] EVTC: Trimmed 37882 records to 27089 (keeping 200 days of data) [2025-09-19T18:44:57.625516] [DEBUG] [LOCAL ] EVTC: Primary data saved (27089 records). [2025-09-19T18:44:57.625692] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-19T18:44:57.625827] [INFO ] [MAIN ] Update Progress: 793/2372 symbols completed. EVTC took 27.0s. Estimated remaining: 3h 28m 51s. Rate: 7.6 symbols/min [2025-09-19T18:44:57.800436] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:57.836806] [DEBUG] [LOCAL ] EXG: Loaded 35077 existing records from primary storage. [2025-09-19T18:44:57.836951] [INFO ] [MAIN ] EXG: Loaded 35077 existing records. [2025-09-19T18:44:58.013268] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:58.013505] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-19T18:44:58.013551] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-19T18:44:58.014411] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-19T18:44:58.014471] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-19T18:44:58.244710] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-19T18:44:58.385131] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:58.471901] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T18:44:58.724935] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T18:44:58.907925] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T18:44:59.043231] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-19T18:44:59.843282] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-19T18:45:00.643228] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-19T18:45:01.301207] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T18:45:01.443274] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-19T18:45:01.640724] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T18:45:01.658839] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T18:45:02.243313] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-19T18:45:03.043328] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-19T18:45:03.843274] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-19T18:45:05.150498] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T18:45:05.161138] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-19T18:45:05.427110] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (3.98 seconds). [2025-09-19T18:45:05.443212] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-19T18:45:05.604439] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (3.36 seconds). [2025-09-19T18:45:06.018109] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T18:45:06.243287] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-19T18:45:06.816537] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T18:45:07.043294] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-19T18:45:07.442252] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:45:07.448770] [INFO ] [REMOTE ] EVTL: Full fetch complete (49658 records). [2025-09-19T18:45:07.448931] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-19T18:45:07.449680] [FATAL] [VALIDATOR ] EVTL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:45:07.449801] [FATAL] [MAIN ] EVTL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:45:07.449880] [WARN ] [MAIN ] EVTL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:45:07.449984] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-19T18:45:07.450068] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-09-19T18:45:07.450108] [INFO ] [LOCAL ] EVTL: Starting deletion of derivative data. [2025-09-19T18:45:07.450543] [DEBUG] [LOCAL ] EVTL: Deleted derivative data file. [2025-09-19T18:45:07.450673] [INFO ] [MAIN ] Update Progress: 794/2372 symbols completed. EVTL took 26.2s. Estimated remaining: 3h 28m 47s. Rate: 7.6 symbols/min [2025-09-19T18:45:07.627385] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:07.679388] [DEBUG] [LOCAL ] EXK: Loaded 53465 existing records from primary storage. [2025-09-19T18:45:07.679568] [INFO ] [MAIN ] EXK: Loaded 53465 existing records. [2025-09-19T18:45:07.857482] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-19T18:45:07.864057] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:07.865202] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-19T18:45:07.865286] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-19T18:45:07.866626] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-19T18:45:07.866722] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-19T18:45:08.304262] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:08.324707] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T18:45:08.643288] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-19T18:45:08.998765] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T18:45:09.435125] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-19T18:45:09.446995] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-19T18:45:10.243323] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-19T18:45:10.954797] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T18:45:11.018910] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-19T18:45:11.043219] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-19T18:45:11.469923] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T18:45:11.843293] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-19T18:45:12.643304] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-19T18:45:13.056791] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T18:45:13.443273] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-19T18:45:13.971250] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T18:45:14.243280] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-19T18:45:15.043298] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-19T18:45:16.397588] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (3.75 seconds). [2025-09-19T18:45:16.410616] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-19T18:45:16.687957] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T18:45:16.697343] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-19T18:45:16.715448] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T18:45:16.816552] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (3.37 seconds). [2025-09-19T18:45:17.443298] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-19T18:45:17.892234] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T18:45:18.024525] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T18:45:18.243293] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-19T18:45:18.595112] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:45:19.043265] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-19T18:45:19.843280] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-19T18:45:20.322600] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T18:45:20.643227] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-19T18:45:20.780295] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T18:45:21.443273] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-19T18:45:21.756039] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T18:45:22.243277] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-19T18:45:22.848953] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T18:45:23.043238] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-19T18:45:23.107722] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T18:45:23.723405] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T18:45:23.843266] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-19T18:45:24.643262] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-19T18:45:25.090871] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T18:45:25.443267] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-19T18:45:25.685024] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-19T18:45:26.243263] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-19T18:45:26.319282] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T18:45:27.043265] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-19T18:45:27.264232] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T18:45:27.269401] [INFO ] [REMOTE ] EVTR: Full fetch complete (31339 records). [2025-09-19T18:45:27.269504] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-19T18:45:27.651039] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-19T18:45:27.651119] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-19T18:45:27.651706] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-19T18:45:27.651767] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-19T18:45:27.652517] [DEBUG] [LOCAL ] EVTR: Trimmed 31339 records to 23278 (keeping 200 days of data) [2025-09-19T18:45:27.775450] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:45:27.791742] [INFO ] [REMOTE ] EXG: Full fetch complete (50143 records). [2025-09-19T18:45:27.799934] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-19T18:45:27.855430] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-19T18:45:27.904808] [DEBUG] [LOCAL ] EVTR: Primary data saved (23278 records). [2025-09-19T18:45:27.912005] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-19T18:45:27.917506] [INFO ] [MAIN ] Update Progress: 795/2372 symbols completed. EVTR took 36.0s. Estimated remaining: 3h 29m 4s. Rate: 7.5 symbols/min [2025-09-19T18:45:28.344210] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:28.436777] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-19T18:45:28.436858] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-19T18:45:28.437547] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-19T18:45:28.437621] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-19T18:45:28.440034] [DEBUG] [LOCAL ] EXG: Trimmed 50143 records to 35265 (keeping 200 days of data) [2025-09-19T18:45:28.464207] [DEBUG] [LOCAL ] EXP: Loaded 30581 existing records from primary storage. [2025-09-19T18:45:28.464358] [INFO ] [MAIN ] EXP: Loaded 30581 existing records. [2025-09-19T18:45:28.765018] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:28.770122] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-19T18:45:28.778347] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-19T18:45:28.823822] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-19T18:45:28.864819] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-19T18:45:28.873873] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T18:45:28.912508] [INFO ] [REMOTE ] EW: Full fetch complete (77348 records). [2025-09-19T18:45:28.936670] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-19T18:45:29.577220] [DEBUG] [LOCAL ] EXG: Primary data saved (35265 records). [2025-09-19T18:45:29.607449] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-19T18:45:29.623416] [INFO ] [MAIN ] Update Progress: 796/2372 symbols completed. EXG took 32.0s. Estimated remaining: 3h 28m 44s. Rate: 7.6 symbols/min [2025-09-19T18:45:29.612709] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:29.659638] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-19T18:45:29.932506] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-19T18:45:29.932693] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-19T18:45:29.934185] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-19T18:45:29.932150] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:29.934733] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-19T18:45:29.953341] [DEBUG] [LOCAL ] EW: Trimmed 77348 records to 54177 (keeping 200 days of data) [2025-09-19T18:45:29.968888] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T18:45:30.064324] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-19T18:45:30.118493] [DEBUG] [LOCAL ] EXPD: Loaded 48569 existing records from primary storage. [2025-09-19T18:45:30.119914] [INFO ] [MAIN ] EXPD: Loaded 48569 existing records. [2025-09-19T18:45:30.405527] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:30.406515] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-19T18:45:30.407168] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-19T18:45:30.409403] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-19T18:45:30.410020] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-19T18:45:30.790091] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:30.790959] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-19T18:45:30.893795] [DEBUG] [LOCAL ] EW: Primary data saved (54177 records). [2025-09-19T18:45:30.893935] [INFO ] [MAIN ] EW: Full history saved. [2025-09-19T18:45:30.895524] [INFO ] [MAIN ] Update Progress: 797/2372 symbols completed. EW took 35.2s. Estimated remaining: 3h 28m 22s. Rate: 7.6 symbols/min [2025-09-19T18:45:31.076853] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T18:45:31.084055] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-19T18:45:32.336705] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T18:45:32.351089] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-19T18:45:32.385983] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:45:32.642537] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:45:32.648244] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-19T18:45:33.443268] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-19T18:45:34.524710] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T18:45:34.534525] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-19T18:45:34.693070] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T18:45:34.999285] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T18:45:35.043228] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-19T18:45:35.843290] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-19T18:45:36.225804] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T18:45:36.380995] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:45:36.643273] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-19T18:45:37.443317] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-19T18:45:38.233168] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T18:45:38.241164] [INFO ] [REMOTE ] EXK: Full fetch complete (76429 records). [2025-09-19T18:45:38.241350] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-19T18:45:38.647310] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-19T18:45:38.647427] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-19T18:45:38.648399] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-19T18:45:38.648482] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-19T18:45:38.650172] [DEBUG] [LOCAL ] EXK: Trimmed 76429 records to 53855 (keeping 200 days of data) [2025-09-19T18:45:38.765693] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T18:45:38.778905] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-19T18:45:39.043721] [DEBUG] [LOCAL ] EXK: Primary data saved (53855 records). [2025-09-19T18:45:39.063147] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-19T18:45:39.063530] [INFO ] [MAIN ] Update Progress: 798/2372 symbols completed. EXK took 31.6s. Estimated remaining: 3h 28m 15s. Rate: 7.6 symbols/min [2025-09-19T18:45:39.065307] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:45:39.072305] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-19T18:45:40.664713] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T18:45:40.676709] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-19T18:45:40.698179] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T18:45:40.706121] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-19T18:45:41.792754] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T18:45:41.799807] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-19T18:45:42.627565] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T18:45:42.640325] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-19T18:45:42.852165] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T18:45:43.043269] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-19T18:45:43.984715] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T18:45:43.994728] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-19T18:45:44.442937] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T18:45:44.643255] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-19T18:45:46.001793] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T18:45:46.012740] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-19T18:45:46.180503] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T18:45:46.185112] [INFO ] [REMOTE ] EXP: Full fetch complete (43111 records). [2025-09-19T18:45:46.185259] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-19T18:45:46.616983] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-19T18:45:46.617068] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-19T18:45:46.617741] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-19T18:45:46.617803] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-19T18:45:46.618884] [DEBUG] [LOCAL ] EXP: Trimmed 43111 records to 30759 (keeping 200 days of data) [2025-09-19T18:45:46.819117] [DEBUG] [LOCAL ] EXP: Primary data saved (30759 records). [2025-09-19T18:45:46.819292] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-19T18:45:46.819445] [INFO ] [MAIN ] Update Progress: 799/2372 symbols completed. EXP took 18.9s. Estimated remaining: 3h 28m 7s. Rate: 7.6 symbols/min [2025-09-19T18:45:47.950415] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T18:45:47.961384] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-19T18:45:49.858627] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T18:45:49.866287] [INFO ] [REMOTE ] EXPD: Full fetch complete (69168 records). [2025-09-19T18:45:49.866416] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-19T18:45:50.262609] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-19T18:45:50.262722] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-19T18:45:50.263671] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-19T18:45:50.263735] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-19T18:45:50.265188] [DEBUG] [LOCAL ] EXPD: Trimmed 69168 records to 48955 (keeping 200 days of data) [2025-09-19T18:45:50.595682] [DEBUG] [LOCAL ] EXPD: Primary data saved (48955 records). [2025-09-19T18:45:50.595862] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-19T18:45:50.596003] [INFO ] [MAIN ] Update Progress: 800/2372 symbols completed. EXPD took 21.0s. Estimated remaining: 3h 27m 51s. Rate: 7.6 symbols/min [2025-09-19T18:45:51.244289] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:51.320707] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:51.319835] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:51.324766] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:51.429526] [DEBUG] [LOCAL ] FAF: Loaded 42390 existing records from primary storage. [2025-09-19T18:45:51.430003] [INFO ] [MAIN ] FAF: Loaded 42390 existing records. [2025-09-19T18:45:51.526931] [DEBUG] [LOCAL ] FBIN: Loaded 50823 existing records from primary storage. [2025-09-19T18:45:51.564714] [INFO ] [MAIN ] FBIN: Loaded 50823 existing records. [2025-09-19T18:45:51.559358] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-09-19T18:45:51.585163] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-09-19T18:45:51.781102] [DEBUG] [LOCAL ] EXR: Loaded 45952 existing records from primary storage. [2025-09-19T18:45:51.859505] [INFO ] [MAIN ] EXR: Loaded 45952 existing records. [2025-09-19T18:45:51.868471] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:51.936064] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-19T18:45:51.964189] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-19T18:45:52.008948] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-19T18:45:52.081243] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-19T18:45:52.107073] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:52.180703] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:52.185957] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-19T18:45:52.231714] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-19T18:45:52.256639] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-19T18:45:52.267017] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-19T18:45:52.272321] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-19T18:45:52.267137] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-19T18:45:52.418016] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:52.423239] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-19T18:45:52.439292] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-19T18:45:52.513589] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-19T18:45:52.562460] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-19T18:45:52.585710] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-19T18:45:52.617038] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-19T18:45:53.484581] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:53.563271] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-19T18:45:53.572042] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:53.615287] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-19T18:45:53.714310] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:53.738789] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-19T18:45:53.778781] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:53.779085] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-19T18:45:55.118733] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:45:55.128860] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-19T18:45:55.411142] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T18:45:55.418450] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-19T18:45:55.751554] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T18:45:55.761375] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-19T18:45:56.449393] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-19T18:45:56.468305] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-19T18:45:56.521518] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T18:45:56.537282] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-19T18:45:57.293424] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:45:57.301287] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-19T18:45:57.632794] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:45:57.643236] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-19T18:45:57.893732] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:45:57.905121] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-19T18:45:58.733620] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-19T18:45:58.744296] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-19T18:45:58.804993] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T18:45:58.812469] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-19T18:45:58.941871] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T18:45:58.952583] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-19T18:45:59.771480] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T18:45:59.782415] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-19T18:46:00.150688] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T18:46:00.159910] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-19T18:46:00.392009] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T18:46:00.643286] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-19T18:46:01.210960] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T18:46:01.448347] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-19T18:46:01.467574] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-19T18:46:01.933633] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T18:46:02.100962] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T18:46:02.243304] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-19T18:46:03.043287] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-19T18:46:03.356676] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T18:46:03.843266] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-19T18:46:04.027631] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T18:46:04.643304] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-19T18:46:05.144258] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T18:46:05.443301] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-19T18:46:05.859278] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-19T18:46:05.992518] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T18:46:06.243277] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-19T18:46:06.940007] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:46:07.043250] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-19T18:46:07.360125] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T18:46:07.843266] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-19T18:46:08.643275] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-19T18:46:09.126175] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T18:46:09.243792] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:46:09.443386] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-19T18:46:10.243303] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-19T18:46:11.043330] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-19T18:46:11.385205] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-19T18:46:11.448274] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:46:11.457197] [INFO ] [REMOTE ] FBIN: Full fetch complete (72591 records). [2025-09-19T18:46:11.457472] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-19T18:46:11.699636] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T18:46:11.856001] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-19T18:46:11.916799] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-19T18:46:11.916902] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-19T18:46:11.917892] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-19T18:46:11.917982] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-19T18:46:11.920110] [DEBUG] [LOCAL ] FBIN: Trimmed 72591 records to 51209 (keeping 200 days of data) [2025-09-19T18:46:12.247159] [DEBUG] [LOCAL ] FBIN: Primary data saved (51209 records). [2025-09-19T18:46:12.247317] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-19T18:46:12.247473] [INFO ] [MAIN ] Update Progress: 801/2372 symbols completed. FBIN took 21.6s. Estimated remaining: 3h 28m 10s. Rate: 7.5 symbols/min [2025-09-19T18:46:12.426452] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:12.455073] [DEBUG] [LOCAL ] FBK: Loaded 25471 existing records from primary storage. [2025-09-19T18:46:12.455217] [INFO ] [MAIN ] FBK: Loaded 25471 existing records. [2025-09-19T18:46:12.642759] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:12.643270] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-19T18:46:12.643368] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-19T18:46:12.643460] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-19T18:46:12.644634] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-19T18:46:12.644763] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-19T18:46:12.970325] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T18:46:13.064983] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:13.443277] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-19T18:46:13.750394] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:46:14.243278] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-19T18:46:15.043249] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-19T18:46:15.113093] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-19T18:46:15.352575] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T18:46:15.368252] [INFO ] [REMOTE ] EXR: Full fetch complete (65662 records). [2025-09-19T18:46:15.369359] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-19T18:46:15.773949] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-19T18:46:15.782466] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-19T18:46:15.796769] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-19T18:46:15.796913] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-19T18:46:15.799469] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T18:46:15.808745] [DEBUG] [LOCAL ] EXR: Trimmed 65662 records to 46271 (keeping 200 days of data) [2025-09-19T18:46:15.884306] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-19T18:46:16.119940] [DEBUG] [LOCAL ] EXR: Primary data saved (46271 records). [2025-09-19T18:46:16.120083] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-19T18:46:16.120197] [INFO ] [MAIN ] Update Progress: 802/2372 symbols completed. EXR took 25.5s. Estimated remaining: 3h 27m 54s. Rate: 7.6 symbols/min [2025-09-19T18:46:16.302220] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:16.313690] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T18:46:16.365753] [DEBUG] [LOCAL ] FBP: Loaded 46725 existing records from primary storage. [2025-09-19T18:46:16.365917] [INFO ] [MAIN ] FBP: Loaded 46725 existing records. [2025-09-19T18:46:16.555875] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:16.556154] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-19T18:46:16.556202] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-19T18:46:16.557419] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-19T18:46:16.557479] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-19T18:46:16.648406] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-19T18:46:16.917741] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:17.058099] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T18:46:17.066064] [INFO ] [REMOTE ] FAF: Full fetch complete (57507 records). [2025-09-19T18:46:17.066251] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-19T18:46:17.455967] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-19T18:46:17.452873] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-19T18:46:17.456163] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-19T18:46:17.457274] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-19T18:46:17.458099] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-19T18:46:17.459518] [DEBUG] [LOCAL ] FAF: Trimmed 57507 records to 42663 (keeping 200 days of data) [2025-09-19T18:46:17.733747] [DEBUG] [LOCAL ] FAF: Primary data saved (42663 records). [2025-09-19T18:46:17.734320] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-19T18:46:17.734471] [INFO ] [MAIN ] Update Progress: 803/2372 symbols completed. FAF took 27.1s. Estimated remaining: 3h 27m 33s. Rate: 7.6 symbols/min [2025-09-19T18:46:17.823060] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T18:46:17.924346] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:17.961388] [DEBUG] [LOCAL ] FBRT: Loaded 34575 existing records from primary storage. [2025-09-19T18:46:17.961525] [INFO ] [MAIN ] FBRT: Loaded 34575 existing records. [2025-09-19T18:46:18.137312] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:18.137597] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-19T18:46:18.137666] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-19T18:46:18.138792] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-19T18:46:18.138853] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-19T18:46:18.248409] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-19T18:46:18.509112] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:19.043256] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-19T18:46:19.456335] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T18:46:19.569350] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T18:46:19.843267] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-19T18:46:20.328036] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:46:20.643267] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-19T18:46:21.443284] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-19T18:46:21.508180] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:46:21.939030] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T18:46:22.243262] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-19T18:46:22.460028] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T18:46:23.043252] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-19T18:46:23.843297] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-19T18:46:24.066951] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T18:46:24.643265] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-19T18:46:25.287089] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T18:46:25.443263] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-19T18:46:25.517124] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T18:46:25.773575] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:46:26.243267] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-19T18:46:26.440716] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:46:26.863769] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T18:46:26.875349] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-19T18:46:26.875525] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-19T18:46:27.048385] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-19T18:46:27.274922] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-19T18:46:27.275033] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-19T18:46:27.275984] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-19T18:46:27.276047] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-19T18:46:27.277527] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-19T18:46:27.617934] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-09-19T18:46:27.618074] [INFO ] [MAIN ] F: Full history saved. [2025-09-19T18:46:27.618169] [INFO ] [MAIN ] Update Progress: 804/2372 symbols completed. F took 37.0s. Estimated remaining: 3h 27m 29s. Rate: 7.6 symbols/min [2025-09-19T18:46:27.786489] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:27.802596] [DEBUG] [LOCAL ] FC: Loaded 15561 existing records from primary storage. [2025-09-19T18:46:27.802740] [INFO ] [MAIN ] FC: Loaded 15561 existing records. [2025-09-19T18:46:27.848349] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-19T18:46:28.029521] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:28.029792] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-19T18:46:28.029844] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-19T18:46:28.030330] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-19T18:46:28.030390] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-19T18:46:28.381286] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:28.394110] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:46:28.643250] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-19T18:46:29.049604] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T18:46:29.443259] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-19T18:46:29.578352] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:46:30.243269] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-19T18:46:31.043261] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-19T18:46:31.102159] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T18:46:31.124485] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-19T18:46:31.825333] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-19T18:46:31.843247] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-19T18:46:32.643237] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-19T18:46:33.041780] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T18:46:33.443240] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-19T18:46:33.904264] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T18:46:34.243262] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-19T18:46:35.043280] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-19T18:46:35.189920] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T18:46:35.833532] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T18:46:35.843204] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-19T18:46:36.600478] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T18:46:36.643223] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-19T18:46:36.842228] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:46:37.443323] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-19T18:46:37.909630] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T18:46:38.243293] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-19T18:46:38.839832] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T18:46:39.043312] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-19T18:46:39.562708] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T18:46:39.843263] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-19T18:46:40.572691] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:46:40.643224] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-19T18:46:41.443316] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-19T18:46:41.603161] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T18:46:42.016175] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T18:46:42.212597] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T18:46:42.243263] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-19T18:46:43.043284] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-19T18:46:43.257377] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T18:46:43.843326] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-19T18:46:44.484955] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T18:46:44.488922] [INFO ] [REMOTE ] FBK: Full fetch complete (32691 records). [2025-09-19T18:46:44.489031] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-19T18:46:44.665906] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-19T18:46:44.866981] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-19T18:46:44.867060] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-19T18:46:44.867673] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-19T18:46:44.867734] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-19T18:46:44.868803] [DEBUG] [LOCAL ] FBK: Trimmed 32691 records to 25716 (keeping 200 days of data) [2025-09-19T18:46:45.025766] [DEBUG] [LOCAL ] FBK: Primary data saved (25716 records). [2025-09-19T18:46:45.025908] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-19T18:46:45.025998] [INFO ] [MAIN ] Update Progress: 805/2372 symbols completed. FBK took 32.8s. Estimated remaining: 3h 27m 40s. Rate: 7.5 symbols/min [2025-09-19T18:46:45.215298] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T18:46:45.214724] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:45.262533] [DEBUG] [LOCAL ] FCF: Loaded 40259 existing records from primary storage. [2025-09-19T18:46:45.262702] [INFO ] [MAIN ] FCF: Loaded 40259 existing records. [2025-09-19T18:46:45.437981] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:45.438243] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-19T18:46:45.438292] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-19T18:46:45.439301] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-19T18:46:45.439363] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-19T18:46:45.454237] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-19T18:46:45.799686] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:46.018811] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T18:46:46.243260] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-19T18:46:46.811899] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T18:46:47.043265] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-19T18:46:47.300765] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T18:46:47.791725] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T18:46:47.843270] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-19T18:46:48.486438] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-19T18:46:48.489106] [INFO ] [REMOTE ] FC: Full fetch complete (21521 records). [2025-09-19T18:46:48.489189] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-19T18:46:48.648926] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-19T18:46:48.866834] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-19T18:46:48.866926] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-19T18:46:48.867425] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-19T18:46:48.867465] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-19T18:46:48.868306] [DEBUG] [LOCAL ] FC: Trimmed 21521 records to 15640 (keeping 200 days of data) [2025-09-19T18:46:48.957569] [DEBUG] [LOCAL ] FC: Primary data saved (15640 records). [2025-09-19T18:46:48.957743] [INFO ] [MAIN ] FC: Full history saved. [2025-09-19T18:46:48.957855] [INFO ] [MAIN ] Update Progress: 806/2372 symbols completed. FC took 21.3s. Estimated remaining: 3h 27m 24s. Rate: 7.6 symbols/min [2025-09-19T18:46:49.131223] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:49.160707] [DEBUG] [LOCAL ] FCN: Loaded 26543 existing records from primary storage. [2025-09-19T18:46:49.160869] [INFO ] [MAIN ] FCN: Loaded 26543 existing records. [2025-09-19T18:46:49.424483] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:49.424916] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-19T18:46:49.425007] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-19T18:46:49.426065] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-19T18:46:49.426145] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-19T18:46:49.448506] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-19T18:46:50.004946] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:50.243325] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-19T18:46:50.630191] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:46:51.043278] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-19T18:46:51.205432] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T18:46:51.226930] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T18:46:51.843264] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-19T18:46:52.643276] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-19T18:46:52.669673] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:46:52.676333] [INFO ] [REMOTE ] FBP: Full fetch complete (66291 records). [2025-09-19T18:46:52.676491] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-19T18:46:53.069770] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-19T18:46:53.069926] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-19T18:46:53.070976] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-19T18:46:53.071071] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-19T18:46:53.072601] [DEBUG] [LOCAL ] FBP: Trimmed 66291 records to 47037 (keeping 200 days of data) [2025-09-19T18:46:53.338305] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T18:46:53.373112] [INFO ] [REMOTE ] FBRT: Full fetch complete (48116 records). [2025-09-19T18:46:53.374263] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-19T18:46:53.448401] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-19T18:46:53.695599] [DEBUG] [LOCAL ] FBP: Primary data saved (47037 records). [2025-09-19T18:46:53.701005] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-19T18:46:53.724362] [INFO ] [MAIN ] Update Progress: 807/2372 symbols completed. FBP took 37.6s. Estimated remaining: 3h 27m 10s. Rate: 7.6 symbols/min [2025-09-19T18:46:54.009692] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-19T18:46:54.036774] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-19T18:46:54.036665] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:54.037752] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-19T18:46:54.037898] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-19T18:46:54.040240] [DEBUG] [LOCAL ] FBRT: Trimmed 48116 records to 34817 (keeping 200 days of data) [2025-09-19T18:46:54.157288] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T18:46:54.210271] [DEBUG] [LOCAL ] FCPT: Loaded 37843 existing records from primary storage. [2025-09-19T18:46:54.211004] [INFO ] [MAIN ] FCPT: Loaded 37843 existing records. [2025-09-19T18:46:54.247133] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-19T18:46:54.428458] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:54.430400] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-19T18:46:54.430566] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-19T18:46:54.481329] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-19T18:46:54.490541] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T18:46:54.489284] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-19T18:46:54.903363] [DEBUG] [LOCAL ] FBRT: Primary data saved (34817 records). [2025-09-19T18:46:54.924027] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:54.919478] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-19T18:46:54.924171] [INFO ] [MAIN ] Update Progress: 808/2372 symbols completed. FBRT took 37.2s. Estimated remaining: 3h 26m 49s. Rate: 7.6 symbols/min [2025-09-19T18:46:55.048375] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-19T18:46:55.105292] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:55.105512] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-19T18:46:55.105569] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-19T18:46:55.105732] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-19T18:46:55.105785] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-19T18:46:55.105829] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-19T18:46:55.105862] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-19T18:46:55.485071] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:55.843283] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-19T18:46:55.886981] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T18:46:56.434722] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T18:46:56.643262] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-19T18:46:57.011038] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T18:46:57.038344] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-19T18:46:57.443301] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-19T18:46:57.965839] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T18:46:58.243271] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-19T18:46:58.781510] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T18:46:59.043282] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-19T18:46:59.843270] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-19T18:47:00.437258] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T18:47:00.643276] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-19T18:47:00.997387] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-19T18:47:01.135403] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T18:47:01.443265] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-19T18:47:02.243269] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-19T18:47:03.043284] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-19T18:47:03.090034] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T18:47:03.312233] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T18:47:03.843263] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-19T18:47:04.188607] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-19T18:47:04.228772] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T18:47:04.643263] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-19T18:47:05.443276] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-19T18:47:06.021098] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-19T18:47:06.042496] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-19T18:47:06.243274] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-19T18:47:07.043269] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-19T18:47:07.843270] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-19T18:47:07.894114] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T18:47:08.234180] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-19T18:47:08.290334] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T18:47:08.643269] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-19T18:47:09.443271] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-19T18:47:10.243291] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-19T18:47:10.376633] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T18:47:10.431472] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T18:47:10.658180] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-19T18:47:11.043268] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-19T18:47:11.843271] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-19T18:47:12.644121] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-19T18:47:12.644057] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T18:47:12.645627] [INFO ] [REMOTE ] FCRX: Full fetch complete (1636 records). [2025-09-19T18:47:12.646453] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-19T18:47:12.862727] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:47:12.868256] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-19T18:47:12.868393] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:47:12.875577] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:47:12.875891] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-19T18:47:12.875998] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-19T18:47:12.876168] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-19T18:47:12.876237] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-19T18:47:12.876312] [INFO ] [MAIN ] Update Progress: 809/2372 symbols completed. FCRX took 18.0s. Estimated remaining: 3h 27m 0s. Rate: 7.6 symbols/min [2025-09-19T18:47:13.052664] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:13.067353] [DEBUG] [LOCAL ] FCT: Loaded 14486 existing records from primary storage. [2025-09-19T18:47:13.067474] [INFO ] [MAIN ] FCT: Loaded 14486 existing records. [2025-09-19T18:47:13.251194] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:13.251494] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-19T18:47:13.251549] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-19T18:47:13.252083] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-19T18:47:13.252145] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-19T18:47:13.448380] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-19T18:47:13.622550] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:14.247010] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-19T18:47:14.250959] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T18:47:15.043276] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-19T18:47:15.147210] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T18:47:15.843259] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-19T18:47:15.913296] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T18:47:15.931185] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T18:47:16.643252] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-19T18:47:16.832359] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:47:17.443271] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-19T18:47:18.243263] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-19T18:47:18.643013] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T18:47:19.043274] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-19T18:47:19.097137] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T18:47:19.710892] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:47:19.843258] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-19T18:47:20.173402] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T18:47:20.643271] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-19T18:47:21.109970] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T18:47:21.443285] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-19T18:47:22.003445] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:47:22.009401] [INFO ] [REMOTE ] FCF: Full fetch complete (57699 records). [2025-09-19T18:47:22.009529] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-19T18:47:22.010400] [FATAL] [VALIDATOR ] FCF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:47:22.010494] [FATAL] [MAIN ] FCF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:47:22.010537] [WARN ] [MAIN ] FCF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:47:22.010578] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-19T18:47:22.010638] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-09-19T18:47:22.010720] [INFO ] [LOCAL ] FCF: Starting deletion of derivative data. [2025-09-19T18:47:22.011185] [DEBUG] [LOCAL ] FCF: Deleted derivative data file. [2025-09-19T18:47:22.011305] [INFO ] [MAIN ] Update Progress: 810/2372 symbols completed. FCF took 37.0s. Estimated remaining: 3h 26m 55s. Rate: 7.5 symbols/min [2025-09-19T18:47:22.192259] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:22.248385] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-19T18:47:22.251079] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-09-19T18:47:22.251293] [INFO ] [MAIN ] FCX: Loaded 54090 existing records. [2025-09-19T18:47:22.445159] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:22.445440] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-19T18:47:22.445517] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-19T18:47:22.446730] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-19T18:47:22.446791] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-19T18:47:22.832308] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T18:47:22.856132] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:23.043260] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-19T18:47:23.707117] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T18:47:23.712211] [INFO ] [REMOTE ] FCN: Full fetch complete (35504 records). [2025-09-19T18:47:23.712353] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-19T18:47:23.848439] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-19T18:47:24.215714] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-19T18:47:24.215823] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-19T18:47:24.216500] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-19T18:47:24.216541] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-19T18:47:24.217749] [DEBUG] [LOCAL ] FCN: Trimmed 35504 records to 26751 (keeping 200 days of data) [2025-09-19T18:47:24.328154] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T18:47:24.336518] [INFO ] [REMOTE ] FCPT: Full fetch complete (53177 records). [2025-09-19T18:47:24.338038] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-19T18:47:24.649063] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-19T18:47:24.783570] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-19T18:47:24.789276] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-19T18:47:24.799919] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-19T18:47:24.800440] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-19T18:47:24.802790] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:47:24.843461] [DEBUG] [LOCAL ] FCPT: Trimmed 53177 records to 38112 (keeping 200 days of data) [2025-09-19T18:47:24.950231] [DEBUG] [LOCAL ] FCN: Primary data saved (26751 records). [2025-09-19T18:47:24.952920] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-19T18:47:24.953607] [INFO ] [MAIN ] Update Progress: 811/2372 symbols completed. FCN took 36.0s. Estimated remaining: 3h 26m 37s. Rate: 7.6 symbols/min [2025-09-19T18:47:25.241764] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:25.311876] [DEBUG] [LOCAL ] FCPT: Primary data saved (38112 records). [2025-09-19T18:47:25.312059] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-19T18:47:25.312154] [INFO ] [MAIN ] Update Progress: 812/2372 symbols completed. FCPT took 31.6s. Estimated remaining: 3h 26m 14s. Rate: 7.6 symbols/min [2025-09-19T18:47:25.445054] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-19T18:47:25.487957] [DEBUG] [LOCAL ] FDP: Loaded 30690 existing records from primary storage. [2025-09-19T18:47:25.494703] [INFO ] [MAIN ] FDP: Loaded 30690 existing records. [2025-09-19T18:47:25.534079] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:25.730743] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:25.732029] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-19T18:47:25.732141] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-19T18:47:25.732591] [DEBUG] [LOCAL ] FDS: Loaded 25899 existing records from primary storage. [2025-09-19T18:47:25.732802] [INFO ] [MAIN ] FDS: Loaded 25899 existing records. [2025-09-19T18:47:25.764052] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-19T18:47:25.789748] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-19T18:47:26.086579] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:26.179608] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-19T18:47:26.186026] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-19T18:47:26.209407] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-19T18:47:26.220786] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-19T18:47:26.412158] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:26.423062] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-19T18:47:26.516230] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T18:47:26.700595] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:26.974795] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T18:47:27.043212] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-19T18:47:27.799989] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:47:27.843241] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-19T18:47:28.643282] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-19T18:47:28.886740] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T18:47:29.174102] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:47:29.443284] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-19T18:47:29.810811] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T18:47:30.243276] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-19T18:47:31.043303] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-19T18:47:31.210044] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:47:31.346029] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T18:47:31.843267] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-19T18:47:32.485914] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T18:47:32.643272] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-19T18:47:33.330058] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T18:47:33.443257] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-19T18:47:34.243287] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-19T18:47:34.292084] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T18:47:34.433414] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T18:47:35.043265] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-19T18:47:35.843273] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-19T18:47:36.076692] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:47:36.562553] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T18:47:36.643265] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-19T18:47:36.805159] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T18:47:37.443282] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-19T18:47:37.856222] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T18:47:38.243298] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-19T18:47:39.021266] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T18:47:39.043220] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-19T18:47:39.489842] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T18:47:39.843270] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-19T18:47:40.501522] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T18:47:40.643301] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-19T18:47:40.974958] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T18:47:41.443279] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-19T18:47:42.243269] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-19T18:47:42.499085] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T18:47:42.817069] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T18:47:42.883464] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:47:43.043296] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-19T18:47:43.843290] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-19T18:47:44.184327] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T18:47:44.187327] [INFO ] [REMOTE ] FCT: Full fetch complete (21229 records). [2025-09-19T18:47:44.187421] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-19T18:47:44.550521] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-19T18:47:44.550602] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-19T18:47:44.551045] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-19T18:47:44.551105] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-19T18:47:44.551687] [DEBUG] [LOCAL ] FCT: Trimmed 21229 records to 14568 (keeping 200 days of data) [2025-09-19T18:47:44.636959] [DEBUG] [LOCAL ] FCT: Primary data saved (14568 records). [2025-09-19T18:47:44.637153] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-19T18:47:44.637304] [INFO ] [MAIN ] Update Progress: 813/2372 symbols completed. FCT took 31.8s. Estimated remaining: 3h 26m 28s. Rate: 7.6 symbols/min [2025-09-19T18:47:44.649067] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-19T18:47:44.809965] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:44.863927] [DEBUG] [LOCAL ] FDX: Loaded 51948 existing records from primary storage. [2025-09-19T18:47:44.864070] [INFO ] [MAIN ] FDX: Loaded 51948 existing records. [2025-09-19T18:47:45.043174] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:45.043454] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-19T18:47:45.043514] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-19T18:47:45.044949] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-19T18:47:45.045038] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-19T18:47:45.407621] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:45.443259] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-19T18:47:45.689682] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:47:46.135845] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T18:47:46.243234] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-19T18:47:47.043294] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-19T18:47:47.398572] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T18:47:47.843233] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-19T18:47:47.860636] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T18:47:47.945803] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T18:47:47.950322] [INFO ] [REMOTE ] FDP: Full fetch complete (42783 records). [2025-09-19T18:47:47.950451] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-19T18:47:48.346233] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-19T18:47:48.346338] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-19T18:47:48.347010] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-19T18:47:48.347071] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-19T18:47:48.348038] [DEBUG] [LOCAL ] FDP: Trimmed 42783 records to 30932 (keeping 200 days of data) [2025-09-19T18:47:48.539555] [DEBUG] [LOCAL ] FDP: Primary data saved (30932 records). [2025-09-19T18:47:48.539734] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-19T18:47:48.539837] [INFO ] [MAIN ] Update Progress: 814/2372 symbols completed. FDP took 23.6s. Estimated remaining: 3h 26m 13s. Rate: 7.6 symbols/min [2025-09-19T18:47:48.646109] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-19T18:47:48.730025] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:48.784855] [DEBUG] [LOCAL ] FE: Loaded 53831 existing records from primary storage. [2025-09-19T18:47:48.785025] [INFO ] [MAIN ] FE: Loaded 53831 existing records. [2025-09-19T18:47:48.993116] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:48.993421] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-19T18:47:48.993502] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-19T18:47:48.994967] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-19T18:47:48.995050] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-19T18:47:49.381799] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:49.443282] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-19T18:47:49.711710] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:47:50.243277] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-19T18:47:50.596054] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T18:47:51.043279] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-19T18:47:51.215358] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T18:47:51.843282] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-19T18:47:52.188464] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T18:47:52.236584] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T18:47:52.643264] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-19T18:47:53.443222] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-19T18:47:53.581235] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T18:47:53.838473] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T18:47:54.243282] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-19T18:47:55.043307] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-19T18:47:55.198226] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T18:47:55.430343] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:47:55.843303] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-19T18:47:56.643267] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-19T18:47:57.015475] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T18:47:57.443280] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-19T18:47:57.908915] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:47:57.915997] [INFO ] [REMOTE ] FDS: Full fetch complete (36318 records). [2025-09-19T18:47:57.916269] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-19T18:47:58.156452] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T18:47:58.252805] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-19T18:47:58.381484] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-19T18:47:58.381571] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-19T18:47:58.382256] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-19T18:47:58.382319] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-19T18:47:58.383214] [DEBUG] [LOCAL ] FDS: Trimmed 36318 records to 26237 (keeping 200 days of data) [2025-09-19T18:47:58.550675] [DEBUG] [LOCAL ] FDS: Primary data saved (26237 records). [2025-09-19T18:47:58.550837] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-19T18:47:58.550930] [INFO ] [MAIN ] Update Progress: 815/2372 symbols completed. FDS took 33.2s. Estimated remaining: 3h 26m 9s. Rate: 7.6 symbols/min [2025-09-19T18:47:58.724951] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:58.725135] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-19T18:47:58.725241] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-19T18:47:58.725359] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-19T18:47:58.725399] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-19T18:47:58.725441] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-19T18:47:58.725473] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-19T18:47:59.051140] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-19T18:47:59.095056] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:59.213827] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:47:59.843293] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-19T18:47:59.914133] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:48:00.334422] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T18:48:00.643308] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-19T18:48:01.153077] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:48:01.443345] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-19T18:48:01.755540] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T18:48:02.243319] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-19T18:48:03.043270] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-19T18:48:03.843259] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-19T18:48:04.389816] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T18:48:04.643232] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-19T18:48:05.333037] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-19T18:48:05.362856] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (3.92 seconds). [2025-09-19T18:48:05.448456] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-19T18:48:05.465779] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-09-19T18:48:05.877864] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-09-19T18:48:06.243267] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-19T18:48:06.845027] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-19T18:48:07.043312] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-19T18:48:07.734392] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T18:48:07.843252] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-19T18:48:08.643288] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-19T18:48:09.443306] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-19T18:48:09.549054] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T18:48:09.621804] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:48:09.995029] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T18:48:10.152757] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T18:48:10.243312] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-19T18:48:10.647050] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T18:48:11.043268] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-19T18:48:11.476585] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-19T18:48:11.843263] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-19T18:48:12.643289] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-19T18:48:13.349832] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-19T18:48:13.443256] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-19T18:48:14.243264] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-19T18:48:14.949514] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-19T18:48:15.043237] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-19T18:48:15.051787] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T18:48:15.052704] [INFO ] [REMOTE ] FENG: Full fetch complete (2124 records). [2025-09-19T18:48:15.052778] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-19T18:48:15.232759] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T18:48:15.233008] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:48:15.233083] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:48:15.233196] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-19T18:48:15.233289] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-19T18:48:15.233345] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-19T18:48:15.233390] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-19T18:48:15.233450] [INFO ] [MAIN ] Update Progress: 816/2372 symbols completed. FENG took 16.7s. Estimated remaining: 3h 26m 17s. Rate: 7.5 symbols/min [2025-09-19T18:48:15.403355] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:15.458338] [DEBUG] [LOCAL ] FERG: Loaded 49429 existing records from primary storage. [2025-09-19T18:48:15.458496] [INFO ] [MAIN ] FERG: Loaded 49429 existing records. [2025-09-19T18:48:15.641086] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:15.641320] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-19T18:48:15.641367] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-19T18:48:15.642558] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-19T18:48:15.642617] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-19T18:48:15.854419] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-19T18:48:16.003477] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:16.612001] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T18:48:16.643212] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-19T18:48:16.951617] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-19T18:48:16.960211] [INFO ] [REMOTE ] FDX: Full fetch complete (74395 records). [2025-09-19T18:48:16.960356] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-19T18:48:17.373726] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-19T18:48:17.373820] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-19T18:48:17.374805] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-19T18:48:17.374868] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-19T18:48:17.376998] [DEBUG] [LOCAL ] FDX: Trimmed 74395 records to 52338 (keeping 200 days of data) [2025-09-19T18:48:17.467526] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-19T18:48:17.716187] [DEBUG] [LOCAL ] FDX: Primary data saved (52338 records). [2025-09-19T18:48:17.716394] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-19T18:48:17.716586] [INFO ] [MAIN ] Update Progress: 817/2372 symbols completed. FDX took 33.1s. Estimated remaining: 3h 25m 59s. Rate: 7.5 symbols/min [2025-09-19T18:48:17.894127] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:17.915574] [DEBUG] [LOCAL ] FET: Loaded 12836 existing records from primary storage. [2025-09-19T18:48:17.915746] [INFO ] [MAIN ] FET: Loaded 12836 existing records. [2025-09-19T18:48:18.109405] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:18.109867] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-19T18:48:18.109977] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-19T18:48:18.110502] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-19T18:48:18.110588] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-19T18:48:18.512848] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T18:48:18.534222] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:18.545168] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-19T18:48:18.954030] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T18:48:19.002380] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T18:48:19.043217] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-19T18:48:19.248156] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T18:48:19.843272] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-19T18:48:20.643268] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-19T18:48:20.934434] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T18:48:21.242124] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T18:48:21.443263] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-19T18:48:22.012015] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T18:48:22.021698] [INFO ] [REMOTE ] FCX: Full fetch complete (77739 records). [2025-09-19T18:48:22.021870] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-19T18:48:22.250485] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-19T18:48:22.326570] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T18:48:22.463277] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-19T18:48:22.463375] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-19T18:48:22.464669] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-19T18:48:22.464756] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-19T18:48:22.474415] [DEBUG] [LOCAL ] FCX: Trimmed 77739 records to 54480 (keeping 200 days of data) [2025-09-19T18:48:22.824235] [DEBUG] [LOCAL ] FCX: Primary data saved (54480 records). [2025-09-19T18:48:22.824401] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-19T18:48:22.824543] [INFO ] [MAIN ] Update Progress: 818/2372 symbols completed. FCX took 1m 1s. Estimated remaining: 3h 25m 46s. Rate: 7.6 symbols/min [2025-09-19T18:48:23.006006] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:23.036552] [DEBUG] [LOCAL ] FF: Loaded 26065 existing records from primary storage. [2025-09-19T18:48:23.036721] [INFO ] [MAIN ] FF: Loaded 26065 existing records. [2025-09-19T18:48:23.049690] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-19T18:48:23.220107] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:23.220363] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-19T18:48:23.220410] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-19T18:48:23.221207] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-19T18:48:23.221299] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-19T18:48:23.619135] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:23.843275] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-19T18:48:24.406165] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T18:48:24.416299] [INFO ] [REMOTE ] FE: Full fetch complete (77185 records). [2025-09-19T18:48:24.416457] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-19T18:48:24.653168] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-19T18:48:24.832376] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-19T18:48:24.832471] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-19T18:48:24.833479] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-19T18:48:24.833554] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-19T18:48:24.844244] [DEBUG] [LOCAL ] FE: Trimmed 77185 records to 54219 (keeping 200 days of data) [2025-09-19T18:48:25.189274] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T18:48:25.233831] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T18:48:25.255866] [DEBUG] [LOCAL ] FE: Primary data saved (54219 records). [2025-09-19T18:48:25.255997] [INFO ] [MAIN ] FE: Full history saved. [2025-09-19T18:48:25.256112] [INFO ] [MAIN ] Update Progress: 819/2372 symbols completed. FE took 36.7s. Estimated remaining: 3h 25m 27s. Rate: 7.6 symbols/min [2025-09-19T18:48:25.438323] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:25.446450] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-19T18:48:25.450518] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T18:48:25.458962] [DEBUG] [LOCAL ] FFA: Loaded 5628 existing records from primary storage. [2025-09-19T18:48:25.459050] [INFO ] [MAIN ] FFA: Loaded 5628 existing records. [2025-09-19T18:48:25.646541] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:25.646807] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-19T18:48:25.646860] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-19T18:48:25.647200] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-19T18:48:25.647261] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-19T18:48:26.011212] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:26.243235] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-19T18:48:27.038162] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T18:48:27.043221] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-19T18:48:27.506959] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T18:48:27.843256] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-19T18:48:28.262789] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T18:48:28.643276] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-19T18:48:29.329715] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-19T18:48:29.443280] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-19T18:48:29.536140] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T18:48:30.243265] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-19T18:48:30.949638] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T18:48:31.043261] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-19T18:48:31.148419] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:48:31.821119] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T18:48:31.843216] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-19T18:48:32.571017] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T18:48:32.643273] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-19T18:48:33.443285] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-19T18:48:34.243332] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-19T18:48:34.424035] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T18:48:34.550771] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T18:48:35.043275] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-19T18:48:35.127010] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T18:48:35.817410] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T18:48:35.843333] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-19T18:48:36.643281] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-19T18:48:37.444109] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-19T18:48:37.446958] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T18:48:37.611139] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T18:48:38.243289] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-19T18:48:39.043298] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-19T18:48:39.140356] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T18:48:39.573607] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T18:48:39.843237] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-19T18:48:39.974374] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T18:48:40.437345] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T18:48:40.643284] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-19T18:48:41.326896] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:48:41.443293] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-19T18:48:42.243281] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-19T18:48:42.441934] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:48:43.043301] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-19T18:48:43.323144] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T18:48:43.843289] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-19T18:48:44.643279] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-19T18:48:45.032031] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T18:48:45.118088] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T18:48:45.208927] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T18:48:45.443253] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-19T18:48:46.243282] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-19T18:48:46.684711] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T18:48:47.043309] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-19T18:48:47.468625] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:48:47.843275] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-19T18:48:48.643236] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-19T18:48:48.786941] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T18:48:48.790432] [INFO ] [REMOTE ] FF: Full fetch complete (37345 records). [2025-09-19T18:48:48.790517] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-19T18:48:49.060348] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T18:48:49.127449] [INFO ] [REMOTE ] FERG: Full fetch complete (71015 records). [2025-09-19T18:48:49.127752] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-19T18:48:49.289255] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T18:48:49.340736] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-19T18:48:49.351952] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-19T18:48:49.352751] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-19T18:48:49.357949] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-19T18:48:49.402934] [DEBUG] [LOCAL ] FF: Trimmed 37345 records to 26197 (keeping 200 days of data) [2025-09-19T18:48:49.444443] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-19T18:48:49.764088] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-19T18:48:49.764766] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-19T18:48:49.766048] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-19T18:48:49.766129] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-19T18:48:49.794705] [DEBUG] [LOCAL ] FERG: Trimmed 71015 records to 49797 (keeping 200 days of data) [2025-09-19T18:48:49.806369] [DEBUG] [LOCAL ] FF: Primary data saved (26197 records). [2025-09-19T18:48:49.806533] [INFO ] [MAIN ] FF: Full history saved. [2025-09-19T18:48:49.806665] [INFO ] [MAIN ] Update Progress: 820/2372 symbols completed. FF took 27.0s. Estimated remaining: 3h 25m 51s. Rate: 7.5 symbols/min [2025-09-19T18:48:50.074939] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:50.098034] [DEBUG] [LOCAL ] FFC: Loaded 16790 existing records from primary storage. [2025-09-19T18:48:50.099030] [INFO ] [MAIN ] FFC: Loaded 16790 existing records. [2025-09-19T18:48:50.245719] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-19T18:48:50.290019] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:50.290834] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-19T18:48:50.290888] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-19T18:48:50.291704] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-19T18:48:50.291806] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-19T18:48:50.793403] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:50.803240] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:48:50.806599] [INFO ] [REMOTE ] FET: Full fetch complete (18083 records). [2025-09-19T18:48:50.806940] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-19T18:48:51.047457] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-19T18:48:51.204062] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-19T18:48:51.204438] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-19T18:48:51.205099] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-19T18:48:51.205176] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-19T18:48:51.207132] [DEBUG] [LOCAL ] FET: Trimmed 18083 records to 12925 (keeping 200 days of data) [2025-09-19T18:48:51.332886] [DEBUG] [LOCAL ] FET: Primary data saved (12925 records). [2025-09-19T18:48:51.335689] [INFO ] [MAIN ] FET: Full history saved. [2025-09-19T18:48:51.336125] [INFO ] [MAIN ] Update Progress: 821/2372 symbols completed. FET took 33.6s. Estimated remaining: 3h 25m 31s. Rate: 7.5 symbols/min [2025-09-19T18:48:51.528684] [DEBUG] [LOCAL ] FERG: Primary data saved (49797 records). [2025-09-19T18:48:51.528561] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:51.528873] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-19T18:48:51.529016] [INFO ] [MAIN ] Update Progress: 822/2372 symbols completed. FERG took 36.3s. Estimated remaining: 3h 25m 8s. Rate: 7.6 symbols/min [2025-09-19T18:48:51.722608] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:51.736432] [DEBUG] [LOCAL ] FFWM: Loaded 36552 existing records from primary storage. [2025-09-19T18:48:51.736584] [INFO ] [MAIN ] FFWM: Loaded 36552 existing records. [2025-09-19T18:48:51.898933] [DEBUG] [LOCAL ] FG: Loaded 22428 existing records from primary storage. [2025-09-19T18:48:51.899350] [INFO ] [MAIN ] FG: Loaded 22428 existing records. [2025-09-19T18:48:52.036292] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:52.044690] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-19T18:48:52.049883] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-19T18:48:52.078822] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-19T18:48:52.089367] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-19T18:48:52.193298] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:52.238050] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-19T18:48:52.240851] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-19T18:48:52.247016] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-19T18:48:52.252223] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-19T18:48:52.480880] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-19T18:48:52.581165] [INFO ] [REMOTE ] FFA: Full fetch complete (8176 records). [2025-09-19T18:48:52.606949] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-19T18:48:52.881216] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:52.908218] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-19T18:48:53.076482] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:53.134200] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-19T18:48:53.179679] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T18:48:53.305072] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-19T18:48:53.305154] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-19T18:48:53.305416] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-19T18:48:53.305454] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-19T18:48:53.305891] [DEBUG] [LOCAL ] FFA: Trimmed 8176 records to 5687 (keeping 200 days of data) [2025-09-19T18:48:53.339564] [DEBUG] [LOCAL ] FFA: Primary data saved (5687 records). [2025-09-19T18:48:53.339678] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-19T18:48:53.339778] [INFO ] [MAIN ] Update Progress: 823/2372 symbols completed. FFA took 28.1s. Estimated remaining: 3h 24m 49s. Rate: 7.6 symbols/min [2025-09-19T18:48:53.448389] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-19T18:48:53.509861] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:53.518578] [DEBUG] [LOCAL ] FGN: Loaded 4071 existing records from primary storage. [2025-09-19T18:48:53.518721] [INFO ] [MAIN ] FGN: Loaded 4071 existing records. [2025-09-19T18:48:53.692469] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:53.692756] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-19T18:48:53.692812] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-19T18:48:53.693078] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-19T18:48:53.693137] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-19T18:48:54.050197] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:54.173456] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T18:48:54.243235] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-19T18:48:54.421909] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T18:48:54.652117] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:48:54.722933] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-19T18:48:55.043270] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-19T18:48:55.411333] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-19T18:48:55.843265] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-19T18:48:56.503796] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T18:48:56.643265] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-19T18:48:57.443283] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-19T18:48:58.143824] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T18:48:58.243276] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-19T18:48:58.274599] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T18:48:58.686356] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T18:48:59.043298] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-19T18:48:59.843272] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-19T18:49:00.529576] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T18:49:00.643235] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-19T18:49:01.036366] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T18:49:01.443259] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-19T18:49:01.885973] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:49:02.203204] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T18:49:02.243226] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-19T18:49:03.043310] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-19T18:49:03.190939] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T18:49:03.843273] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-19T18:49:04.599910] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T18:49:04.643219] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-19T18:49:04.716794] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T18:49:05.206854] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T18:49:05.443293] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-19T18:49:06.243260] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-19T18:49:06.906805] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-19T18:49:07.043280] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-19T18:49:07.277919] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T18:49:07.743277] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T18:49:07.843289] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-19T18:49:08.530609] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-19T18:49:08.531633] [INFO ] [REMOTE ] FGN: Full fetch complete (5769 records). [2025-09-19T18:49:08.531738] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-19T18:49:08.648358] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-19T18:49:08.904111] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-19T18:49:08.904222] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-19T18:49:08.904413] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-19T18:49:08.904466] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-19T18:49:08.904952] [DEBUG] [LOCAL ] FGN: Trimmed 5769 records to 4085 (keeping 200 days of data) [2025-09-19T18:49:08.930043] [DEBUG] [LOCAL ] FGN: Primary data saved (4085 records). [2025-09-19T18:49:08.930139] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-19T18:49:08.930220] [INFO ] [MAIN ] Update Progress: 824/2372 symbols completed. FGN took 15.6s. Estimated remaining: 3h 24m 55s. Rate: 7.6 symbols/min [2025-09-19T18:49:09.101773] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:09.101963] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-19T18:49:09.102006] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-19T18:49:09.102149] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-19T18:49:09.102190] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-19T18:49:09.102230] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-19T18:49:09.102261] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-19T18:49:09.451108] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-19T18:49:09.493730] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:10.243308] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-19T18:49:10.354330] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T18:49:10.518808] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:49:10.519347] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-19T18:49:11.043285] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-19T18:49:11.843266] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-19T18:49:11.979485] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T18:49:12.643270] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-19T18:49:13.007925] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T18:49:13.443263] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-19T18:49:14.243320] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-19T18:49:14.356166] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (4.91 seconds). [2025-09-19T18:49:14.420415] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:49:14.982231] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:49:15.043290] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-19T18:49:15.711176] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T18:49:15.843263] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-19T18:49:16.530135] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (3.09 seconds). [2025-09-19T18:49:16.643283] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-19T18:49:17.443275] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-19T18:49:18.243293] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-19T18:49:18.348671] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T18:49:18.879984] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-19T18:49:19.043279] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-19T18:49:19.558007] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T18:49:19.843267] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-19T18:49:20.091499] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T18:49:20.127527] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (3.48 seconds). [2025-09-19T18:49:20.423114] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T18:49:20.643287] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-19T18:49:21.443281] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-19T18:49:21.807504] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T18:49:22.243280] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-19T18:49:22.338669] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T18:49:23.043269] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-19T18:49:23.226349] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T18:49:23.843261] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-19T18:49:24.277829] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:49:24.628639] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T18:49:24.631546] [INFO ] [REMOTE ] FFC: Full fetch complete (24840 records). [2025-09-19T18:49:24.631623] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-19T18:49:24.653269] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-19T18:49:25.012140] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-19T18:49:25.012233] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-19T18:49:25.012783] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-19T18:49:25.012844] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-19T18:49:25.013537] [DEBUG] [LOCAL ] FFC: Trimmed 24840 records to 16868 (keeping 200 days of data) [2025-09-19T18:49:25.116246] [DEBUG] [LOCAL ] FFC: Primary data saved (16868 records). [2025-09-19T18:49:25.116388] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-19T18:49:25.116476] [INFO ] [MAIN ] Update Progress: 825/2372 symbols completed. FFC took 35.3s. Estimated remaining: 3h 25m 3s. Rate: 7.5 symbols/min [2025-09-19T18:49:25.288880] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:25.328944] [DEBUG] [LOCAL ] FHI: Loaded 41135 existing records from primary storage. [2025-09-19T18:49:25.329090] [INFO ] [MAIN ] FHI: Loaded 41135 existing records. [2025-09-19T18:49:25.448342] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-19T18:49:25.508781] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:25.509003] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-19T18:49:25.509067] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-19T18:49:25.510206] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-19T18:49:25.510427] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-19T18:49:25.868680] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:25.929998] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T18:49:26.243247] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-19T18:49:26.286264] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T18:49:27.043268] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-19T18:49:27.546551] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-19T18:49:27.843277] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-19T18:49:27.900169] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:49:28.643291] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-19T18:49:29.406795] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:49:29.411866] [INFO ] [REMOTE ] FFWM: Full fetch complete (51734 records). [2025-09-19T18:49:29.411968] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-19T18:49:29.448343] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-19T18:49:29.793053] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-19T18:49:29.793136] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-19T18:49:29.793896] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-19T18:49:29.793958] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-19T18:49:29.795088] [DEBUG] [LOCAL ] FFWM: Trimmed 51734 records to 36810 (keeping 200 days of data) [2025-09-19T18:49:30.011804] [DEBUG] [LOCAL ] FFWM: Primary data saved (36810 records). [2025-09-19T18:49:30.011999] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-19T18:49:30.012089] [INFO ] [MAIN ] Update Progress: 826/2372 symbols completed. FFWM took 38.7s. Estimated remaining: 3h 24m 49s. Rate: 7.5 symbols/min [2025-09-19T18:49:30.185791] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:30.247900] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-19T18:49:30.249899] [DEBUG] [LOCAL ] FHN: Loaded 53758 existing records from primary storage. [2025-09-19T18:49:30.249987] [INFO ] [MAIN ] FHN: Loaded 53758 existing records. [2025-09-19T18:49:30.443757] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:30.444586] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T18:49:30.447234] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-19T18:49:30.447345] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-19T18:49:30.448927] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-19T18:49:30.449031] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-19T18:49:30.595037] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:49:30.850146] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:31.043247] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-19T18:49:31.074717] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T18:49:31.078057] [INFO ] [REMOTE ] FG: Full fetch complete (27033 records). [2025-09-19T18:49:31.078135] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-19T18:49:31.444590] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-19T18:49:31.444737] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-19T18:49:31.445392] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-19T18:49:31.445449] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-19T18:49:31.446213] [DEBUG] [LOCAL ] FG: Trimmed 27033 records to 22587 (keeping 200 days of data) [2025-09-19T18:49:31.586265] [DEBUG] [LOCAL ] FG: Primary data saved (22587 records). [2025-09-19T18:49:31.586394] [INFO ] [MAIN ] FG: Full history saved. [2025-09-19T18:49:31.586478] [INFO ] [MAIN ] Update Progress: 827/2372 symbols completed. FG took 40.1s. Estimated remaining: 3h 24m 29s. Rate: 7.6 symbols/min [2025-09-19T18:49:31.754017] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:31.809362] [DEBUG] [LOCAL ] FI: Loaded 53888 existing records from primary storage. [2025-09-19T18:49:31.809505] [INFO ] [MAIN ] FI: Loaded 53888 existing records. [2025-09-19T18:49:31.851418] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-19T18:49:31.995669] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:31.996033] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-19T18:49:31.996109] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-19T18:49:31.997418] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-19T18:49:31.997487] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-19T18:49:32.360509] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:32.394569] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T18:49:32.594261] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T18:49:32.643301] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-19T18:49:33.443310] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-19T18:49:34.057048] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T18:49:34.058513] [INFO ] [REMOTE ] FGSN: Full fetch complete (7480 records). [2025-09-19T18:49:34.058587] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-19T18:49:34.261813] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-19T18:49:34.294912] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-19T18:49:34.295706] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:49:34.296242] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:49:34.296573] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-19T18:49:34.297187] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-19T18:49:34.300661] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:49:34.310597] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-19T18:49:34.316225] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-19T18:49:34.316374] [INFO ] [MAIN ] Update Progress: 828/2372 symbols completed. FGSN took 25.4s. Estimated remaining: 3h 24m 11s. Rate: 7.6 symbols/min [2025-09-19T18:49:34.502541] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:34.530400] [DEBUG] [LOCAL ] FICO: Loaded 20603 existing records from primary storage. [2025-09-19T18:49:34.530672] [INFO ] [MAIN ] FICO: Loaded 20603 existing records. [2025-09-19T18:49:34.730735] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:34.731121] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-19T18:49:34.731239] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-19T18:49:34.732144] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-19T18:49:34.732206] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-19T18:49:35.059260] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-19T18:49:35.101936] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:35.843272] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-19T18:49:35.950157] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T18:49:36.643249] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-19T18:49:37.229763] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T18:49:37.384349] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-19T18:49:37.443274] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-19T18:49:37.751694] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T18:49:38.243324] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-19T18:49:38.744049] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T18:49:39.043263] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-19T18:49:39.843276] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-19T18:49:39.965305] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T18:49:40.538962] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T18:49:40.610093] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T18:49:40.643215] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-19T18:49:41.443229] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-19T18:49:41.560461] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T18:49:42.243275] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-19T18:49:42.865433] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T18:49:43.043238] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-19T18:49:43.107611] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:49:43.843269] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-19T18:49:44.643282] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-19T18:49:44.861476] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:49:45.234312] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T18:49:45.443247] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-19T18:49:45.631781] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T18:49:46.243311] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-19T18:49:47.043351] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-19T18:49:47.532262] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T18:49:47.739176] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T18:49:47.843274] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-19T18:49:48.563441] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T18:49:48.643237] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-19T18:49:49.149425] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T18:49:49.443278] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-19T18:49:50.030200] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T18:49:50.243242] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-19T18:49:51.043250] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-19T18:49:51.144878] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T18:49:51.241780] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T18:49:51.843269] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-19T18:49:52.197407] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T18:49:52.643268] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-19T18:49:53.422214] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T18:49:53.443231] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-19T18:49:54.243293] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-19T18:49:54.307054] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T18:49:54.312677] [INFO ] [REMOTE ] FHI: Full fetch complete (57783 records). [2025-09-19T18:49:54.312802] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-19T18:49:54.695531] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-19T18:49:54.695614] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-19T18:49:54.696632] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-19T18:49:54.696738] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-19T18:49:54.698484] [DEBUG] [LOCAL ] FHI: Trimmed 57783 records to 41458 (keeping 200 days of data) [2025-09-19T18:49:54.955960] [DEBUG] [LOCAL ] FHI: Primary data saved (41458 records). [2025-09-19T18:49:54.956134] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-19T18:49:54.956273] [INFO ] [MAIN ] Update Progress: 829/2372 symbols completed. FHI took 29.8s. Estimated remaining: 3h 24m 27s. Rate: 7.5 symbols/min [2025-09-19T18:49:55.051736] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-19T18:49:55.137129] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:55.137336] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-19T18:49:55.137375] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-19T18:49:55.137536] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-19T18:49:55.137579] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-19T18:49:55.137620] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-19T18:49:55.137684] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-19T18:49:55.503192] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:55.627919] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T18:49:55.843259] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-19T18:49:56.612358] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T18:49:56.643225] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-19T18:49:57.201115] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T18:49:57.443266] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-19T18:49:58.243244] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-19T18:49:58.446434] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-19T18:49:58.836477] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:49:58.840195] [INFO ] [REMOTE ] FICO: Full fetch complete (28299 records). [2025-09-19T18:49:58.840277] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-19T18:49:58.923872] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-19T18:49:59.048503] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-19T18:49:59.175894] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T18:49:59.273727] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-19T18:49:59.273814] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-19T18:49:59.274391] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-19T18:49:59.274430] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-19T18:49:59.275225] [DEBUG] [LOCAL ] FICO: Trimmed 28299 records to 20784 (keeping 200 days of data) [2025-09-19T18:49:59.407813] [DEBUG] [LOCAL ] FICO: Primary data saved (20784 records). [2025-09-19T18:49:59.407945] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-19T18:49:59.408047] [INFO ] [MAIN ] Update Progress: 830/2372 symbols completed. FICO took 25.1s. Estimated remaining: 3h 24m 13s. Rate: 7.6 symbols/min [2025-09-19T18:49:59.577600] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:59.627058] [DEBUG] [LOCAL ] FIGS: Loaded 49441 existing records from primary storage. [2025-09-19T18:49:59.627255] [INFO ] [MAIN ] FIGS: Loaded 49441 existing records. [2025-09-19T18:49:59.845173] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-19T18:49:59.845422] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:59.846963] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-19T18:49:59.847034] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-19T18:49:59.848250] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-19T18:49:59.848311] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-19T18:50:00.216187] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-19T18:50:00.239375] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:00.643283] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-19T18:50:00.781866] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:50:01.018236] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-19T18:50:01.443324] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-19T18:50:02.115715] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T18:50:02.243308] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-19T18:50:03.043349] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-19T18:50:03.355988] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-19T18:50:03.771030] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T18:50:03.843322] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-19T18:50:04.643303] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-19T18:50:05.027913] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T18:50:05.443311] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-19T18:50:05.759576] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T18:50:06.243300] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-19T18:50:07.043374] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-19T18:50:07.467320] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:07.467808] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-19T18:50:07.496246] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T18:50:07.504633] [INFO ] [REMOTE ] FHN: Full fetch complete (77270 records). [2025-09-19T18:50:07.504820] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-19T18:50:07.843829] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-19T18:50:07.954106] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-19T18:50:07.954277] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-19T18:50:07.955688] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-19T18:50:07.955861] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-19T18:50:07.986489] [DEBUG] [LOCAL ] FHN: Trimmed 77270 records to 54148 (keeping 200 days of data) [2025-09-19T18:50:07.989188] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T18:50:08.357129] [DEBUG] [LOCAL ] FHN: Primary data saved (54148 records). [2025-09-19T18:50:08.357325] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-19T18:50:08.358101] [INFO ] [MAIN ] Update Progress: 831/2372 symbols completed. FHN took 38.3s. Estimated remaining: 3h 24m 7s. Rate: 7.5 symbols/min [2025-09-19T18:50:08.532053] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:08.576422] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-19T18:50:08.576570] [INFO ] [MAIN ] FIHL: Loaded 40851 existing records. [2025-09-19T18:50:08.650560] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-19T18:50:08.760251] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:08.760513] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-19T18:50:08.760564] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-19T18:50:08.761457] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-19T18:50:08.761518] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-19T18:50:09.112685] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:09.443294] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-19T18:50:09.999894] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T18:50:10.243311] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-19T18:50:10.376796] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:50:10.560032] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-19T18:50:11.043279] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-19T18:50:11.843265] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-19T18:50:12.466539] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T18:50:12.643319] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-19T18:50:12.931315] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (3.49 seconds). [2025-09-19T18:50:13.443262] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-19T18:50:14.243290] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-19T18:50:14.376356] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-19T18:50:15.043295] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-19T18:50:15.250703] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T18:50:15.843284] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-19T18:50:16.610416] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:50:16.643223] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-19T18:50:17.008397] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:50:17.365881] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T18:50:17.443266] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-19T18:50:18.111723] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (5.47 seconds). [2025-09-19T18:50:18.243281] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-19T18:50:19.043291] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-19T18:50:19.567979] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T18:50:19.808982] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T18:50:19.817088] [INFO ] [REMOTE ] FI: Full fetch complete (77156 records). [2025-09-19T18:50:19.817239] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-19T18:50:19.850013] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-19T18:50:20.232913] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-19T18:50:20.233024] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-19T18:50:20.234028] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-19T18:50:20.234114] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-19T18:50:20.235932] [DEBUG] [LOCAL ] FI: Trimmed 77156 records to 54278 (keeping 200 days of data) [2025-09-19T18:50:20.356215] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:50:20.601724] [DEBUG] [LOCAL ] FI: Primary data saved (54278 records). [2025-09-19T18:50:20.601899] [INFO ] [MAIN ] FI: Full history saved. [2025-09-19T18:50:20.601993] [INFO ] [MAIN ] Update Progress: 832/2372 symbols completed. FI took 49.0s. Estimated remaining: 3h 24m 7s. Rate: 7.5 symbols/min [2025-09-19T18:50:20.665991] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-19T18:50:20.778363] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:20.788783] [DEBUG] [LOCAL ] FINS: Loaded 8252 existing records from primary storage. [2025-09-19T18:50:20.788902] [INFO ] [MAIN ] FINS: Loaded 8252 existing records. [2025-09-19T18:50:20.984319] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:20.984832] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-19T18:50:20.984905] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-19T18:50:20.985467] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-19T18:50:20.985531] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-19T18:50:21.347173] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:21.378572] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:50:21.443235] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-19T18:50:22.059516] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:50:22.144206] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (5.50 seconds). [2025-09-19T18:50:22.152104] [INFO ] [REMOTE ] FIG: Full fetch complete (14248 records). [2025-09-19T18:50:22.152245] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-19T18:50:22.249227] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-19T18:50:22.340388] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-19T18:50:22.340729] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:50:22.340815] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:50:22.340914] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-19T18:50:22.340996] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-19T18:50:22.341036] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-19T18:50:22.341094] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-19T18:50:22.341179] [INFO ] [MAIN ] Update Progress: 833/2372 symbols completed. FIG took 27.4s. Estimated remaining: 3h 23m 47s. Rate: 7.6 symbols/min [2025-09-19T18:50:22.517237] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:22.562026] [DEBUG] [LOCAL ] FINV: Loaded 45289 existing records from primary storage. [2025-09-19T18:50:22.562174] [INFO ] [MAIN ] FINV: Loaded 45289 existing records. [2025-09-19T18:50:22.742323] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:22.742577] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-19T18:50:22.742688] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-19T18:50:22.743765] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-19T18:50:22.743833] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-19T18:50:23.048366] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-19T18:50:23.107376] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:23.484932] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T18:50:23.843262] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-19T18:50:24.643273] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-19T18:50:25.509100] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T18:50:25.517444] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-19T18:50:26.367183] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T18:50:26.375068] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-19T18:50:26.721783] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:50:27.043263] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-19T18:50:27.593963] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:50:27.843294] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-19T18:50:28.190036] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T18:50:28.643308] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-19T18:50:29.821378] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T18:50:29.830225] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-19T18:50:29.866802] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (8.42 seconds). [2025-09-19T18:50:29.910773] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:50:29.916966] [INFO ] [REMOTE ] FIHL: Full fetch complete (55757 records). [2025-09-19T18:50:29.917077] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-19T18:50:30.263434] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-19T18:50:30.325900] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-19T18:50:30.325994] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-19T18:50:30.326979] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-19T18:50:30.327073] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-19T18:50:30.328427] [DEBUG] [LOCAL ] FIHL: Trimmed 55757 records to 41125 (keeping 200 days of data) [2025-09-19T18:50:30.585327] [DEBUG] [LOCAL ] FIHL: Primary data saved (41125 records). [2025-09-19T18:50:30.585477] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-19T18:50:30.586726] [INFO ] [MAIN ] Update Progress: 834/2372 symbols completed. FIHL took 22.2s. Estimated remaining: 3h 23m 40s. Rate: 7.6 symbols/min [2025-09-19T18:50:30.771432] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:30.829129] [DEBUG] [LOCAL ] FIS: Loaded 53758 existing records from primary storage. [2025-09-19T18:50:30.829301] [INFO ] [MAIN ] FIS: Loaded 53758 existing records. [2025-09-19T18:50:31.021233] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:31.021538] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-19T18:50:31.028052] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-19T18:50:31.034734] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T18:50:31.037216] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-19T18:50:31.038265] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-19T18:50:31.069457] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-19T18:50:31.396148] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:31.607420] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T18:50:31.843289] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-19T18:50:32.097111] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (9.05 seconds). [2025-09-19T18:50:32.643264] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-19T18:50:33.235559] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:50:33.443239] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-19T18:50:34.243263] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-19T18:50:34.407541] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (3.34 seconds). [2025-09-19T18:50:34.628772] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T18:50:34.636304] [INFO ] [REMOTE ] FIGS: Full fetch complete (71107 records). [2025-09-19T18:50:34.636466] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-19T18:50:35.055040] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-19T18:50:35.080133] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T18:50:35.078845] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-19T18:50:35.087909] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-19T18:50:35.089212] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-19T18:50:35.089557] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-19T18:50:35.091392] [DEBUG] [LOCAL ] FIGS: Trimmed 71107 records to 49796 (keeping 200 days of data) [2025-09-19T18:50:35.376110] [DEBUG] [LOCAL ] FIGS: Primary data saved (49796 records). [2025-09-19T18:50:35.376316] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-19T18:50:35.376497] [INFO ] [MAIN ] Update Progress: 835/2372 symbols completed. FIGS took 36.0s. Estimated remaining: 3h 23m 26s. Rate: 7.6 symbols/min [2025-09-19T18:50:35.552340] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:35.586846] [DEBUG] [LOCAL ] FIX: Loaded 31219 existing records from primary storage. [2025-09-19T18:50:35.586998] [INFO ] [MAIN ] FIX: Loaded 31219 existing records. [2025-09-19T18:50:35.772440] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:35.772775] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-19T18:50:35.772859] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-19T18:50:35.773826] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-19T18:50:35.773889] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-19T18:50:35.852094] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-19T18:50:36.037887] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:50:36.157473] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:36.188497] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T18:50:36.643266] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-19T18:50:37.256276] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T18:50:37.443304] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-19T18:50:38.103620] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:50:38.243329] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-19T18:50:39.043536] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-19T18:50:39.146441] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T18:50:39.471269] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:50:39.843283] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-19T18:50:40.643268] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-19T18:50:41.038785] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T18:50:41.208075] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T18:50:41.443292] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-19T18:50:41.580218] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T18:50:42.243274] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-19T18:50:43.043248] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-19T18:50:43.170491] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T18:50:43.843262] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-19T18:50:43.983082] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T18:50:44.446523] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-19T18:50:44.643326] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-19T18:50:45.443279] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-19T18:50:45.529826] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T18:50:45.871712] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T18:50:45.879493] [INFO ] [REMOTE ] FINV: Full fetch complete (63561 records). [2025-09-19T18:50:45.879635] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-19T18:50:46.251245] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-19T18:50:46.311873] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-19T18:50:46.311974] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-19T18:50:46.312931] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-19T18:50:46.313033] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-19T18:50:46.314468] [DEBUG] [LOCAL ] FINV: Trimmed 63561 records to 45658 (keeping 200 days of data) [2025-09-19T18:50:46.592932] [DEBUG] [LOCAL ] FINV: Primary data saved (45658 records). [2025-09-19T18:50:46.593069] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-19T18:50:46.593198] [INFO ] [MAIN ] Update Progress: 836/2372 symbols completed. FINV took 24.3s. Estimated remaining: 3h 23m 24s. Rate: 7.6 symbols/min [2025-09-19T18:50:46.791200] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:46.791494] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-19T18:50:46.791567] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-19T18:50:46.791811] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-19T18:50:46.791905] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-19T18:50:46.791989] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-19T18:50:46.792065] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-19T18:50:47.068529] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-19T18:50:47.198995] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:47.258045] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:50:47.585592] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T18:50:47.630289] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:50:47.843305] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-19T18:50:48.643299] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-19T18:50:49.285946] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T18:50:49.443293] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-19T18:50:50.245970] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-19T18:50:50.250860] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T18:50:51.043292] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-19T18:50:51.242199] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T18:50:51.320033] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:50:51.321710] [INFO ] [REMOTE ] FINS: Full fetch complete (12849 records). [2025-09-19T18:50:51.321814] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-19T18:50:51.700390] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-19T18:50:51.700468] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-19T18:50:51.700786] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-19T18:50:51.700846] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-19T18:50:51.701519] [DEBUG] [LOCAL ] FINS: Trimmed 12849 records to 8288 (keeping 200 days of data) [2025-09-19T18:50:51.758355] [DEBUG] [LOCAL ] FINS: Primary data saved (8288 records). [2025-09-19T18:50:51.758488] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-19T18:50:51.758592] [INFO ] [MAIN ] Update Progress: 837/2372 symbols completed. FINS took 31.2s. Estimated remaining: 3h 23m 11s. Rate: 7.6 symbols/min [2025-09-19T18:50:51.843280] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-19T18:50:52.068758] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:52.069110] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-19T18:50:52.643268] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-19T18:50:53.108202] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T18:50:53.443264] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-19T18:50:53.870990] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:53.871381] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-19T18:50:54.079957] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T18:50:54.243279] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-19T18:50:55.043270] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-19T18:50:55.784602] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:50:55.843296] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-19T18:50:56.643290] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-19T18:50:56.936803] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T18:50:57.443258] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-19T18:50:57.453181] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:57.454091] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-19T18:50:57.480076] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T18:50:58.243268] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-19T18:50:58.480878] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:58.481220] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-19T18:50:59.043285] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-19T18:50:59.592315] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T18:50:59.843269] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-19T18:51:00.076143] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:51:00.076524] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-19T18:51:00.335728] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T18:51:00.643272] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-19T18:51:01.443299] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-19T18:51:02.243280] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-19T18:51:02.588844] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T18:51:02.595465] [INFO ] [REMOTE ] FIX: Full fetch complete (45665 records). [2025-09-19T18:51:02.595608] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-19T18:51:02.874419] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:51:02.907117] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-19T18:51:02.995983] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-19T18:51:02.996073] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-19T18:51:02.996791] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-19T18:51:02.996854] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-19T18:51:03.000034] [DEBUG] [LOCAL ] FIX: Trimmed 45665 records to 31371 (keeping 200 days of data) [2025-09-19T18:51:03.070615] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-19T18:51:03.214008] [DEBUG] [LOCAL ] FIX: Primary data saved (31371 records). [2025-09-19T18:51:03.214141] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-19T18:51:03.214260] [INFO ] [MAIN ] Update Progress: 838/2372 symbols completed. FIX took 27.8s. Estimated remaining: 3h 23m 10s. Rate: 7.6 symbols/min [2025-09-19T18:51:04.455965] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T18:51:04.457424] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-19T18:51:05.071951] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T18:51:05.073599] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-19T18:51:05.122488] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (3.68 seconds). [2025-09-19T18:51:05.443237] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-19T18:51:05.478355] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-19T18:51:06.243267] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-19T18:51:07.123124] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T18:51:07.124165] [INFO ] [REMOTE ] FIXT: Full fetch complete (1690 records). [2025-09-19T18:51:07.124238] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-19T18:51:07.311943] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-19T18:51:07.312169] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:51:07.312267] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:51:07.312343] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-19T18:51:07.312411] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-19T18:51:07.312460] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-19T18:51:07.312529] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-19T18:51:07.312605] [INFO ] [MAIN ] Update Progress: 839/2372 symbols completed. FIXT took 20.7s. Estimated remaining: 3h 22m 55s. Rate: 7.6 symbols/min [2025-09-19T18:51:07.474063] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T18:51:07.486201] [INFO ] [REMOTE ] FIS: Full fetch complete (77169 records). [2025-09-19T18:51:07.486355] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-19T18:51:07.890095] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-19T18:51:07.890192] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-19T18:51:07.891136] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-19T18:51:07.891203] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-19T18:51:07.892811] [DEBUG] [LOCAL ] FIS: Trimmed 77169 records to 54148 (keeping 200 days of data) [2025-09-19T18:51:08.248069] [DEBUG] [LOCAL ] FIS: Primary data saved (54148 records). [2025-09-19T18:51:08.248349] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-19T18:51:08.249588] [INFO ] [MAIN ] Update Progress: 840/2372 symbols completed. FIS took 37.7s. Estimated remaining: 3h 22m 34s. Rate: 7.6 symbols/min [2025-09-19T18:51:08.913832] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:08.934732] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:08.986892] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:09.028394] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:09.039269] [DEBUG] [LOCAL ] FLC: Loaded 5787 existing records from primary storage. [2025-09-19T18:51:09.045978] [INFO ] [MAIN ] FLC: Loaded 5787 existing records. [2025-09-19T18:51:09.285336] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:09.315800] [DEBUG] [LOCAL ] FLO: Loaded 52245 existing records from primary storage. [2025-09-19T18:51:09.316850] [INFO ] [MAIN ] FLO: Loaded 52245 existing records. [2025-09-19T18:51:09.316993] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-19T18:51:09.316436] [DEBUG] [LOCAL ] FLNG: Loaded 34505 existing records from primary storage. [2025-09-19T18:51:09.322380] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-19T18:51:09.322574] [INFO ] [MAIN ] FLNG: Loaded 34505 existing records. [2025-09-19T18:51:09.340960] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-19T18:51:09.437853] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-19T18:51:09.609413] [DEBUG] [LOCAL ] FLG: Loaded 53725 existing records from primary storage. [2025-09-19T18:51:09.664479] [INFO ] [MAIN ] FLG: Loaded 53725 existing records. [2025-09-19T18:51:09.997253] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:10.045105] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-19T18:51:10.029491] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:10.080672] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-19T18:51:10.080572] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-19T18:51:10.110584] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-19T18:51:10.138878] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-19T18:51:10.188340] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-19T18:51:10.214332] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-19T18:51:10.325187] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-19T18:51:10.449692] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:10.547805] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-19T18:51:10.640982] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-19T18:51:10.678246] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:10.717028] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-19T18:51:10.745422] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-19T18:51:10.833745] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-19T18:51:11.210484] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:11.241120] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-19T18:51:11.477915] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:11.494911] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-19T18:51:11.603832] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:11.604155] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-19T18:51:11.624934] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T18:51:11.626949] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-19T18:51:12.428413] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T18:51:12.430289] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-19T18:51:13.999429] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-19T18:51:14.007197] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-19T18:51:14.456190] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T18:51:14.457872] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-19T18:51:14.683120] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-19T18:51:14.693634] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-19T18:51:14.894462] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-19T18:51:14.897027] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (3.29 seconds). [2025-09-19T18:51:14.921508] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-19T18:51:15.043270] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-19T18:51:15.195338] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:51:15.837819] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T18:51:15.843218] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-19T18:51:16.179075] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T18:51:16.240723] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T18:51:16.643292] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-19T18:51:16.856530] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T18:51:17.443296] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-19T18:51:17.812879] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-19T18:51:18.243238] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-19T18:51:18.306576] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T18:51:18.696265] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-19T18:51:19.043275] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-19T18:51:19.843265] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-19T18:51:19.893023] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T18:51:20.643268] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-19T18:51:21.443267] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-19T18:51:21.573202] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:51:22.048283] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:51:22.243267] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-19T18:51:22.326891] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T18:51:22.328235] [INFO ] [REMOTE ] FLC: Full fetch complete (8124 records). [2025-09-19T18:51:22.328305] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-19T18:51:22.693970] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-19T18:51:22.694136] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-19T18:51:22.694356] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-19T18:51:22.694397] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-19T18:51:22.694874] [DEBUG] [LOCAL ] FLC: Trimmed 8124 records to 5799 (keeping 200 days of data) [2025-09-19T18:51:22.729280] [DEBUG] [LOCAL ] FLC: Primary data saved (5799 records). [2025-09-19T18:51:22.729369] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-19T18:51:22.729447] [INFO ] [MAIN ] Update Progress: 841/2372 symbols completed. FLC took 14.5s. Estimated remaining: 3h 22m 38s. Rate: 7.6 symbols/min [2025-09-19T18:51:22.898938] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:22.899130] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-19T18:51:22.899166] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-19T18:51:22.899342] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-19T18:51:22.899385] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-19T18:51:22.899425] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-19T18:51:22.899456] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-19T18:51:23.053297] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-19T18:51:23.262804] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:23.719290] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T18:51:23.843256] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-19T18:51:24.351624] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T18:51:24.643263] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-19T18:51:25.443263] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-19T18:51:25.751776] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T18:51:25.880839] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T18:51:26.243263] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-19T18:51:27.043242] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-19T18:51:27.234907] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:51:27.629675] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T18:51:27.843271] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-19T18:51:28.643315] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-19T18:51:29.083792] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:51:29.094631] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-19T18:51:29.114909] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T18:51:29.242317] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T18:51:29.443260] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-19T18:51:30.243268] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-19T18:51:31.043269] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-19T18:51:31.414099] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T18:51:31.481636] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T18:51:31.843298] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-19T18:51:32.474465] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:51:32.643309] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-19T18:51:33.443283] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-19T18:51:33.731288] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:51:34.243239] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-19T18:51:34.339315] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T18:51:34.911809] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T18:51:35.043308] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-19T18:51:35.693384] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T18:51:35.843265] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-19T18:51:36.643284] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-19T18:51:36.936272] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:51:36.974801] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T18:51:37.443259] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-19T18:51:37.759270] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T18:51:38.243268] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-19T18:51:39.043276] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-19T18:51:39.423734] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:51:39.723381] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:51:39.729333] [INFO ] [REMOTE ] FLNG: Full fetch complete (50985 records). [2025-09-19T18:51:39.729433] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-19T18:51:39.848411] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-19T18:51:40.127185] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-19T18:51:40.127273] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-19T18:51:40.128021] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-19T18:51:40.128093] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-19T18:51:40.129295] [DEBUG] [LOCAL ] FLNG: Trimmed 50985 records to 34778 (keeping 200 days of data) [2025-09-19T18:51:40.347134] [DEBUG] [LOCAL ] FLNG: Primary data saved (34778 records). [2025-09-19T18:51:40.347279] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-19T18:51:40.347383] [INFO ] [MAIN ] Update Progress: 842/2372 symbols completed. FLNG took 32.1s. Estimated remaining: 3h 22m 47s. Rate: 7.5 symbols/min [2025-09-19T18:51:40.518299] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:40.570250] [DEBUG] [LOCAL ] FLR: Loaded 53510 existing records from primary storage. [2025-09-19T18:51:40.570402] [INFO ] [MAIN ] FLR: Loaded 53510 existing records. [2025-09-19T18:51:40.648499] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-19T18:51:40.750693] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:40.751195] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-19T18:51:40.751251] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-19T18:51:40.753026] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-19T18:51:40.753087] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-19T18:51:41.142371] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:41.137189] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T18:51:41.443237] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-19T18:51:41.980001] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T18:51:41.991461] [INFO ] [REMOTE ] FLG: Full fetch complete (77290 records). [2025-09-19T18:51:41.991693] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-19T18:51:42.253720] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-19T18:51:42.416865] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-19T18:51:42.417098] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-19T18:51:42.418320] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-19T18:51:42.418405] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-19T18:51:42.420405] [DEBUG] [LOCAL ] FLG: Trimmed 77290 records to 54112 (keeping 200 days of data) [2025-09-19T18:51:42.577974] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T18:51:42.808943] [DEBUG] [LOCAL ] FLG: Primary data saved (54112 records). [2025-09-19T18:51:42.809099] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-19T18:51:42.809188] [INFO ] [MAIN ] Update Progress: 843/2372 symbols completed. FLG took 34.6s. Estimated remaining: 3h 22m 30s. Rate: 7.6 symbols/min [2025-09-19T18:51:42.976157] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:43.024173] [DEBUG] [LOCAL ] FLS: Loaded 50538 existing records from primary storage. [2025-09-19T18:51:43.024324] [INFO ] [MAIN ] FLS: Loaded 50538 existing records. [2025-09-19T18:51:43.059231] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-19T18:51:43.232808] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:43.233161] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-19T18:51:43.233319] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-19T18:51:43.234692] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-19T18:51:43.234758] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-19T18:51:43.645763] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:43.660096] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T18:51:43.848856] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-19T18:51:43.853284] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T18:51:44.577147] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T18:51:44.643224] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-19T18:51:45.443297] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-19T18:51:45.500540] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T18:51:45.682905] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T18:51:46.243325] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-19T18:51:47.043264] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-19T18:51:47.575232] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T18:51:47.583829] [INFO ] [REMOTE ] FLO: Full fetch complete (74814 records). [2025-09-19T18:51:47.583995] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-19T18:51:47.852604] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-19T18:51:47.999185] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-19T18:51:47.999285] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-19T18:51:48.000310] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-19T18:51:48.000378] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-19T18:51:48.002978] [DEBUG] [LOCAL ] FLO: Trimmed 74814 records to 52630 (keeping 200 days of data) [2025-09-19T18:51:48.266348] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T18:51:48.387304] [DEBUG] [LOCAL ] FLO: Primary data saved (52630 records). [2025-09-19T18:51:48.387469] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-19T18:51:48.387565] [INFO ] [MAIN ] Update Progress: 844/2372 symbols completed. FLO took 40.1s. Estimated remaining: 3h 22m 17s. Rate: 7.6 symbols/min [2025-09-19T18:51:48.564950] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:48.605631] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:51:48.648349] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-19T18:51:48.651076] [DEBUG] [LOCAL ] FLUT: Loaded 51391 existing records from primary storage. [2025-09-19T18:51:48.651166] [INFO ] [MAIN ] FLUT: Loaded 51391 existing records. [2025-09-19T18:51:48.843178] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:48.843474] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-19T18:51:48.843533] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-19T18:51:48.844728] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-19T18:51:48.844792] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-19T18:51:49.233557] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:49.250602] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:51:49.443281] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-19T18:51:50.243781] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:51:50.244006] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-19T18:51:50.966879] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T18:51:51.043244] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-19T18:51:51.843320] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-19T18:51:52.370068] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T18:51:52.450399] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:51:52.455449] [INFO ] [REMOTE ] FLOC: Full fetch complete (36688 records). [2025-09-19T18:51:52.455597] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-19T18:51:52.646282] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-19T18:51:52.646135] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 170 unique days, need 200 days [2025-09-19T18:51:52.648203] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:51:52.648286] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:51:52.648367] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-19T18:51:52.648447] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-19T18:51:52.648592] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-19T18:51:52.648694] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-19T18:51:52.648793] [INFO ] [MAIN ] Update Progress: 845/2372 symbols completed. FLOC took 29.9s. Estimated remaining: 3h 22m 3s. Rate: 7.6 symbols/min [2025-09-19T18:51:52.828849] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:52.853245] [DEBUG] [LOCAL ] FLXR: Loaded 19746 existing records from primary storage. [2025-09-19T18:51:52.853478] [INFO ] [MAIN ] FLXR: Loaded 19746 existing records. [2025-09-19T18:51:53.028796] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:53.029039] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-19T18:51:53.029087] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-19T18:51:53.029819] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-19T18:51:53.029878] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-19T18:51:53.379612] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:53.417245] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T18:51:53.443212] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-19T18:51:54.243244] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-19T18:51:54.353509] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T18:51:54.688484] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T18:51:55.043278] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-19T18:51:55.523937] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:51:55.656501] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T18:51:55.843283] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-19T18:51:56.643308] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-19T18:51:57.362449] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T18:51:57.443361] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-19T18:51:58.033823] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T18:51:58.243282] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-19T18:51:58.968047] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T18:51:59.043326] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-19T18:51:59.420385] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T18:51:59.843270] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-19T18:52:00.373743] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:52:00.643314] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-19T18:52:01.386080] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T18:52:01.443244] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-19T18:52:02.243271] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-19T18:52:02.273302] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T18:52:03.018006] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-19T18:52:03.043239] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-19T18:52:03.843299] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-19T18:52:04.055049] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T18:52:04.521094] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T18:52:04.643234] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-19T18:52:04.695530] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T18:52:05.443290] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-19T18:52:06.243308] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-19T18:52:06.645313] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T18:52:06.670935] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T18:52:07.043269] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-19T18:52:07.843318] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-19T18:52:08.257252] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T18:52:08.344132] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T18:52:08.643277] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-19T18:52:09.329777] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T18:52:09.443242] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-19T18:52:09.640793] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T18:52:09.645506] [INFO ] [REMOTE ] FLXR: Full fetch complete (24484 records). [2025-09-19T18:52:09.645589] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-19T18:52:10.025951] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-19T18:52:10.026031] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-19T18:52:10.026526] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-19T18:52:10.026564] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-19T18:52:10.027253] [DEBUG] [LOCAL ] FLXR: Trimmed 24484 records to 19941 (keeping 200 days of data) [2025-09-19T18:52:10.156507] [DEBUG] [LOCAL ] FLXR: Primary data saved (19941 records). [2025-09-19T18:52:10.156690] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-19T18:52:10.156793] [INFO ] [MAIN ] Update Progress: 846/2372 symbols completed. FLXR took 17.5s. Estimated remaining: 3h 22m 12s. Rate: 7.5 symbols/min [2025-09-19T18:52:10.248341] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-19T18:52:10.335775] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:10.399287] [DEBUG] [LOCAL ] FMC: Loaded 52192 existing records from primary storage. [2025-09-19T18:52:10.399471] [INFO ] [MAIN ] FMC: Loaded 52192 existing records. [2025-09-19T18:52:10.581477] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:10.581794] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-19T18:52:10.581893] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-19T18:52:10.583394] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-19T18:52:10.583457] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-19T18:52:10.963420] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:11.043274] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-19T18:52:11.352914] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T18:52:11.843278] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-19T18:52:11.968944] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T18:52:12.643237] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-19T18:52:12.718162] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T18:52:13.076874] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:52:13.443268] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-19T18:52:13.992093] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T18:52:14.243266] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-19T18:52:14.931239] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T18:52:14.938802] [INFO ] [REMOTE ] FLS: Full fetch complete (71228 records). [2025-09-19T18:52:14.938917] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-19T18:52:15.048428] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-19T18:52:15.357014] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-19T18:52:15.357095] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-19T18:52:15.357979] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-19T18:52:15.358042] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-19T18:52:15.359532] [DEBUG] [LOCAL ] FLS: Trimmed 71228 records to 50924 (keeping 200 days of data) [2025-09-19T18:52:15.682049] [DEBUG] [LOCAL ] FLS: Primary data saved (50924 records). [2025-09-19T18:52:15.682239] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-19T18:52:15.682371] [INFO ] [MAIN ] Update Progress: 847/2372 symbols completed. FLS took 32.9s. Estimated remaining: 3h 21m 60s. Rate: 7.5 symbols/min [2025-09-19T18:52:15.859176] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-19T18:52:15.862406] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:15.870718] [DEBUG] [LOCAL ] FMN: Loaded 6239 existing records from primary storage. [2025-09-19T18:52:15.870828] [INFO ] [MAIN ] FMN: Loaded 6239 existing records. [2025-09-19T18:52:16.054009] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:16.054271] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-19T18:52:16.054319] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-19T18:52:16.054606] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-19T18:52:16.054701] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-19T18:52:16.432539] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:16.538122] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T18:52:16.617413] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:52:16.643226] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-19T18:52:17.270742] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T18:52:17.443242] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-19T18:52:17.539119] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T18:52:18.243279] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-19T18:52:19.043249] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-19T18:52:19.672958] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:52:19.705708] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T18:52:19.713701] [INFO ] [REMOTE ] FLR: Full fetch complete (76252 records). [2025-09-19T18:52:19.713849] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-19T18:52:19.854467] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-19T18:52:20.110871] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-19T18:52:20.111057] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-19T18:52:20.112150] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-19T18:52:20.112303] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-19T18:52:20.123477] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T18:52:20.127776] [DEBUG] [LOCAL ] FLR: Trimmed 76252 records to 53899 (keeping 200 days of data) [2025-09-19T18:52:20.444018] [DEBUG] [LOCAL ] FLR: Primary data saved (53899 records). [2025-09-19T18:52:20.444233] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-19T18:52:20.444373] [INFO ] [MAIN ] Update Progress: 848/2372 symbols completed. FLR took 40.1s. Estimated remaining: 3h 21m 46s. Rate: 7.6 symbols/min [2025-09-19T18:52:20.613536] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:20.644728] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-19T18:52:20.645539] [DEBUG] [LOCAL ] FMS: Loaded 30776 existing records from primary storage. [2025-09-19T18:52:20.646720] [INFO ] [MAIN ] FMS: Loaded 30776 existing records. [2025-09-19T18:52:20.832602] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:20.832907] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-19T18:52:20.832965] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-19T18:52:20.833850] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-19T18:52:20.833911] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-19T18:52:21.206449] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:21.443253] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-19T18:52:21.876719] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T18:52:21.964130] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T18:52:22.243273] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-19T18:52:22.846183] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T18:52:22.927490] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T18:52:23.043258] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-19T18:52:23.843271] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-19T18:52:24.161609] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:52:24.643335] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-19T18:52:25.432775] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:52:25.446145] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-19T18:52:25.540863] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T18:52:26.243272] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-19T18:52:26.286308] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T18:52:27.043283] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-19T18:52:27.746808] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T18:52:27.777270] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T18:52:27.843233] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-19T18:52:28.643274] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-19T18:52:29.443282] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-19T18:52:29.864815] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T18:52:29.872413] [INFO ] [REMOTE ] FLUT: Full fetch complete (72749 records). [2025-09-19T18:52:29.872594] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-19T18:52:30.244717] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-19T18:52:30.239440] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T18:52:30.312717] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-19T18:52:30.312821] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-19T18:52:30.313775] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-19T18:52:30.313843] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-19T18:52:30.315466] [DEBUG] [LOCAL ] FLUT: Trimmed 72749 records to 51736 (keeping 200 days of data) [2025-09-19T18:52:30.555570] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T18:52:30.670795] [DEBUG] [LOCAL ] FLUT: Primary data saved (51736 records). [2025-09-19T18:52:30.670968] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-19T18:52:30.671070] [INFO ] [MAIN ] Update Progress: 849/2372 symbols completed. FLUT took 42.3s. Estimated remaining: 3h 21m 42s. Rate: 7.6 symbols/min [2025-09-19T18:52:30.851033] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:30.892007] [DEBUG] [LOCAL ] FMX: Loaded 41086 existing records from primary storage. [2025-09-19T18:52:30.892171] [INFO ] [MAIN ] FMX: Loaded 41086 existing records. [2025-09-19T18:52:31.050072] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-19T18:52:31.095288] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:31.095720] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-19T18:52:31.095782] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-19T18:52:31.096855] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-19T18:52:31.096919] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-19T18:52:31.472612] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:31.843970] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-19T18:52:31.846367] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T18:52:32.482664] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T18:52:32.643294] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-19T18:52:32.973445] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:52:33.443247] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-19T18:52:33.695550] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T18:52:34.243278] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-19T18:52:34.526621] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T18:52:34.989940] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T18:52:35.043248] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-19T18:52:35.843285] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-19T18:52:35.885700] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T18:52:35.887293] [INFO ] [REMOTE ] FMN: Full fetch complete (10278 records). [2025-09-19T18:52:35.887369] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-19T18:52:36.259102] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-19T18:52:36.259183] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-19T18:52:36.259429] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-19T18:52:36.259467] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-19T18:52:36.259986] [DEBUG] [LOCAL ] FMN: Trimmed 10278 records to 6267 (keeping 200 days of data) [2025-09-19T18:52:36.301889] [DEBUG] [LOCAL ] FMN: Primary data saved (6267 records). [2025-09-19T18:52:36.302021] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-19T18:52:36.302112] [INFO ] [MAIN ] Update Progress: 850/2372 symbols completed. FMN took 20.6s. Estimated remaining: 3h 21m 30s. Rate: 7.6 symbols/min [2025-09-19T18:52:36.482668] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:36.486779] [DEBUG] [LOCAL ] FMY: Loaded 1360 existing records from primary storage. [2025-09-19T18:52:36.486877] [INFO ] [MAIN ] FMY: Loaded 1360 existing records. [2025-09-19T18:52:36.644451] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-19T18:52:36.672241] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:36.673339] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-19T18:52:36.673432] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-19T18:52:36.673731] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-19T18:52:36.673793] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-19T18:52:37.036933] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:37.443303] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-19T18:52:37.751250] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-19T18:52:38.116468] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T18:52:38.223300] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T18:52:38.243213] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-19T18:52:39.043256] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-19T18:52:39.808518] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T18:52:39.843261] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-19T18:52:40.643281] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-19T18:52:40.870886] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T18:52:41.183958] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T18:52:41.276627] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T18:52:41.443281] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-19T18:52:41.993606] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T18:52:42.243300] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-19T18:52:43.043307] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-19T18:52:43.856187] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-19T18:52:43.865028] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:52:43.979813] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T18:52:44.643262] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-19T18:52:45.443283] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-19T18:52:45.554561] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:52:45.714175] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:52:45.719099] [INFO ] [REMOTE ] FMS: Full fetch complete (42502 records). [2025-09-19T18:52:45.719184] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-19T18:52:46.117225] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-19T18:52:46.117315] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-19T18:52:46.118002] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-19T18:52:46.118064] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-19T18:52:46.119093] [DEBUG] [LOCAL ] FMS: Trimmed 42502 records to 30974 (keeping 200 days of data) [2025-09-19T18:52:46.243497] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-19T18:52:46.312158] [DEBUG] [LOCAL ] FMS: Primary data saved (30974 records). [2025-09-19T18:52:46.312320] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-19T18:52:46.312426] [INFO ] [MAIN ] Update Progress: 851/2372 symbols completed. FMS took 25.9s. Estimated remaining: 3h 21m 26s. Rate: 7.6 symbols/min [2025-09-19T18:52:46.480391] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:46.519784] [DEBUG] [LOCAL ] FN: Loaded 40044 existing records from primary storage. [2025-09-19T18:52:46.519952] [INFO ] [MAIN ] FN: Loaded 40044 existing records. [2025-09-19T18:52:46.697799] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:46.698043] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-19T18:52:46.698092] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-19T18:52:46.699460] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-19T18:52:46.699520] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-19T18:52:46.782855] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T18:52:47.059791] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-19T18:52:47.067039] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:47.596779] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-19T18:52:47.600826] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T18:52:47.843303] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-19T18:52:48.233577] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T18:52:48.643302] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-19T18:52:49.050339] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T18:52:49.443276] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-19T18:52:49.965453] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-19T18:52:50.243331] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-19T18:52:51.043286] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-19T18:52:51.843320] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-19T18:52:52.278328] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T18:52:52.402376] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T18:52:52.643303] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-19T18:52:52.975109] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T18:52:53.443269] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-19T18:52:53.964443] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T18:52:54.243307] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-19T18:52:54.299691] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T18:52:54.309376] [INFO ] [REMOTE ] FMC: Full fetch complete (74824 records). [2025-09-19T18:52:54.309583] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-19T18:52:54.726396] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T18:52:54.732836] [INFO ] [REMOTE ] FMY: Full fetch complete (1947 records). [2025-09-19T18:52:54.751983] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-19T18:52:54.752063] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-19T18:52:54.752134] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-19T18:52:54.753240] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-19T18:52:54.753335] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-19T18:52:54.859536] [DEBUG] [LOCAL ] FMC: Trimmed 74824 records to 52569 (keeping 200 days of data) [2025-09-19T18:52:55.048638] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-19T18:52:55.235564] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-19T18:52:55.235722] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-19T18:52:55.236133] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-19T18:52:55.236531] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-19T18:52:55.237828] [DEBUG] [LOCAL ] FMY: Trimmed 1947 records to 1403 (keeping 200 days of data) [2025-09-19T18:52:55.249991] [DEBUG] [LOCAL ] FMY: Primary data saved (1403 records). [2025-09-19T18:52:55.250681] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-19T18:52:55.251076] [INFO ] [MAIN ] Update Progress: 852/2372 symbols completed. FMY took 18.9s. Estimated remaining: 3h 21m 20s. Rate: 7.5 symbols/min [2025-09-19T18:52:55.438483] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:55.592470] [DEBUG] [LOCAL ] FNB: Loaded 52843 existing records from primary storage. [2025-09-19T18:52:55.593216] [INFO ] [MAIN ] FNB: Loaded 52843 existing records. [2025-09-19T18:52:55.792036] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:55.794198] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-19T18:52:55.794307] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-19T18:52:55.827686] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-19T18:52:55.827864] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-19T18:52:55.848349] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-19T18:52:56.200853] [DEBUG] [LOCAL ] FMC: Primary data saved (52569 records). [2025-09-19T18:52:56.211448] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-19T18:52:56.211725] [INFO ] [MAIN ] Update Progress: 853/2372 symbols completed. FMC took 46.1s. Estimated remaining: 3h 20m 59s. Rate: 7.6 symbols/min [2025-09-19T18:52:56.370497] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:56.450434] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:56.508153] [DEBUG] [LOCAL ] FND: Loaded 52560 existing records from primary storage. [2025-09-19T18:52:56.508345] [INFO ] [MAIN ] FND: Loaded 52560 existing records. [2025-09-19T18:52:56.648505] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-19T18:52:56.693094] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:56.693379] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-19T18:52:56.693429] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-19T18:52:56.694855] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-19T18:52:56.694927] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-19T18:52:57.076712] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:57.104127] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T18:52:57.144580] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T18:52:57.443296] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-19T18:52:58.132622] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T18:52:58.243279] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-19T18:52:59.043264] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-19T18:52:59.279677] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T18:52:59.843327] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-19T18:53:00.146089] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T18:53:00.428346] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T18:53:00.643283] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-19T18:53:01.443343] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-19T18:53:02.032070] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:53:02.243278] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-19T18:53:02.497323] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:53:03.036327] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T18:53:03.045548] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-19T18:53:03.599630] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:53:03.843264] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-19T18:53:04.189544] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T18:53:04.643307] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-19T18:53:05.443265] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-19T18:53:05.725802] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T18:53:05.937808] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T18:53:06.243276] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-19T18:53:07.049384] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-19T18:53:07.052787] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T18:53:07.766543] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T18:53:07.843226] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-19T18:53:08.643284] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-19T18:53:09.009882] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T18:53:09.231618] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:53:09.443283] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-19T18:53:09.792847] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:53:10.243265] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-19T18:53:11.043265] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-19T18:53:11.422047] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:53:11.534605] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T18:53:11.843282] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-19T18:53:12.521904] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T18:53:12.643263] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-19T18:53:13.443280] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-19T18:53:13.653603] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:53:14.243269] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-19T18:53:14.485559] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T18:53:14.732114] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T18:53:15.043273] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-19T18:53:15.637497] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T18:53:15.843258] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-19T18:53:16.643261] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-19T18:53:17.012839] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T18:53:17.221723] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T18:53:17.228495] [INFO ] [REMOTE ] FMX: Full fetch complete (57709 records). [2025-09-19T18:53:17.228664] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-19T18:53:17.449730] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-19T18:53:17.644778] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-19T18:53:17.644856] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-19T18:53:17.645790] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-19T18:53:17.645852] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-19T18:53:17.647985] [DEBUG] [LOCAL ] FMX: Trimmed 57709 records to 41399 (keeping 200 days of data) [2025-09-19T18:53:17.929233] [DEBUG] [LOCAL ] FMX: Primary data saved (41399 records). [2025-09-19T18:53:17.929359] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-19T18:53:17.929492] [INFO ] [MAIN ] Update Progress: 854/2372 symbols completed. FMX took 47.3s. Estimated remaining: 3h 21m 16s. Rate: 7.5 symbols/min [2025-09-19T18:53:18.110718] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:18.173174] [DEBUG] [LOCAL ] FNF: Loaded 49675 existing records from primary storage. [2025-09-19T18:53:18.173354] [INFO ] [MAIN ] FNF: Loaded 49675 existing records. [2025-09-19T18:53:18.248393] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-19T18:53:18.423304] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:18.424017] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-19T18:53:18.424122] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-19T18:53:18.425486] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-19T18:53:18.425553] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-19T18:53:18.851981] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:18.846393] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T18:53:19.043234] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-19T18:53:19.382184] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T18:53:19.843267] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-19T18:53:20.058794] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T18:53:20.643276] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-19T18:53:20.745609] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T18:53:21.421031] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T18:53:21.431338] [INFO ] [REMOTE ] FN: Full fetch complete (56528 records). [2025-09-19T18:53:21.431499] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-19T18:53:21.448460] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-19T18:53:21.839191] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-19T18:53:21.839344] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-19T18:53:21.840167] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-19T18:53:21.840230] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-19T18:53:21.841400] [DEBUG] [LOCAL ] FN: Trimmed 56528 records to 40301 (keeping 200 days of data) [2025-09-19T18:53:22.104751] [DEBUG] [LOCAL ] FN: Primary data saved (40301 records). [2025-09-19T18:53:22.104895] [INFO ] [MAIN ] FN: Full history saved. [2025-09-19T18:53:22.105014] [INFO ] [MAIN ] Update Progress: 855/2372 symbols completed. FN took 35.8s. Estimated remaining: 3h 21m 1s. Rate: 7.5 symbols/min [2025-09-19T18:53:22.258392] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-19T18:53:22.303330] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:22.363569] [DEBUG] [LOCAL ] FNV: Loaded 46795 existing records from primary storage. [2025-09-19T18:53:22.363753] [INFO ] [MAIN ] FNV: Loaded 46795 existing records. [2025-09-19T18:53:22.520873] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T18:53:22.615388] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:22.615700] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-19T18:53:22.615760] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-19T18:53:22.617268] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-19T18:53:22.617330] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-19T18:53:22.990624] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:23.044911] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-19T18:53:23.047503] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T18:53:23.497426] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T18:53:23.843280] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-19T18:53:24.643262] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-19T18:53:24.753370] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T18:53:25.224925] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T18:53:25.233868] [INFO ] [REMOTE ] FNB: Full fetch complete (75572 records). [2025-09-19T18:53:25.234045] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-19T18:53:25.450729] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-19T18:53:25.629190] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-19T18:53:25.629281] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-19T18:53:25.630218] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-19T18:53:25.630284] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-19T18:53:25.633776] [DEBUG] [LOCAL ] FNB: Trimmed 75572 records to 53229 (keeping 200 days of data) [2025-09-19T18:53:25.964296] [DEBUG] [LOCAL ] FNB: Primary data saved (53229 records). [2025-09-19T18:53:25.964437] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-19T18:53:25.964519] [INFO ] [MAIN ] Update Progress: 856/2372 symbols completed. FNB took 30.7s. Estimated remaining: 3h 20m 46s. Rate: 7.6 symbols/min [2025-09-19T18:53:26.137860] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:26.152184] [DEBUG] [LOCAL ] FOA: Loaded 13267 existing records from primary storage. [2025-09-19T18:53:26.152292] [INFO ] [MAIN ] FOA: Loaded 13267 existing records. [2025-09-19T18:53:26.249800] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-19T18:53:26.331162] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:26.331398] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-19T18:53:26.331446] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-19T18:53:26.332101] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-19T18:53:26.332161] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-19T18:53:26.686387] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:27.043278] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-19T18:53:28.583155] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T18:53:28.588184] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-19T18:53:29.261064] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (4.62 seconds). [2025-09-19T18:53:29.269499] [INFO ] [REMOTE ] FND: Full fetch complete (74351 records). [2025-09-19T18:53:29.269700] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-19T18:53:29.684701] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-19T18:53:29.684924] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-19T18:53:29.685984] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-19T18:53:29.686106] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-19T18:53:29.687754] [DEBUG] [LOCAL ] FND: Trimmed 74351 records to 52939 (keeping 200 days of data) [2025-09-19T18:53:30.032587] [DEBUG] [LOCAL ] FND: Primary data saved (52939 records). [2025-09-19T18:53:30.033371] [INFO ] [MAIN ] FND: Full history saved. [2025-09-19T18:53:30.034396] [INFO ] [MAIN ] Update Progress: 857/2372 symbols completed. FND took 33.8s. Estimated remaining: 3h 20m 31s. Rate: 7.6 symbols/min [2025-09-19T18:53:30.034228] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (4.58 seconds). [2025-09-19T18:53:30.107834] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-19T18:53:30.222259] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:30.237682] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T18:53:30.245705] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-19T18:53:30.251059] [DEBUG] [LOCAL ] FOF: Loaded 8432 existing records from primary storage. [2025-09-19T18:53:30.251195] [INFO ] [MAIN ] FOF: Loaded 8432 existing records. [2025-09-19T18:53:30.432040] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:30.432292] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-19T18:53:30.432352] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-19T18:53:30.432822] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-19T18:53:30.432881] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-19T18:53:30.829274] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (4.58 seconds). [2025-09-19T18:53:30.827982] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:30.838864] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-19T18:53:31.043302] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-19T18:53:31.490005] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:53:31.843282] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-19T18:53:32.010461] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:53:32.056624] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T18:53:32.643255] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-19T18:53:32.694735] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T18:53:32.771776] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T18:53:33.443285] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-19T18:53:34.251714] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-19T18:53:34.262056] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:53:34.572977] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:53:35.043286] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-19T18:53:35.200933] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:53:35.843347] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-19T18:53:36.643537] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-19T18:53:37.268903] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T18:53:37.443324] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-19T18:53:37.619215] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T18:53:37.689251] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:53:38.243255] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-19T18:53:38.569595] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:53:38.866200] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T18:53:39.043281] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-19T18:53:39.573444] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T18:53:39.843296] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-19T18:53:40.315689] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-19T18:53:40.643290] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-19T18:53:41.443313] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-19T18:53:42.007767] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T18:53:42.243295] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-19T18:53:43.043316] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-19T18:53:43.475181] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T18:53:43.843314] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-19T18:53:44.186739] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-19T18:53:44.270861] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:53:44.522761] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T18:53:44.643305] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-19T18:53:45.443286] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-19T18:53:46.243296] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-19T18:53:46.568305] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T18:53:46.841096] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T18:53:47.043305] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-19T18:53:47.347363] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:53:47.843272] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-19T18:53:48.496542] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T18:53:48.504716] [INFO ] [REMOTE ] FNF: Full fetch complete (69458 records). [2025-09-19T18:53:48.504940] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-19T18:53:48.648392] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-19T18:53:48.837725] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:53:48.936148] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-19T18:53:48.936263] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-19T18:53:48.937177] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-19T18:53:48.937251] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-19T18:53:48.938746] [DEBUG] [LOCAL ] FNF: Trimmed 69458 records to 50015 (keeping 200 days of data) [2025-09-19T18:53:49.238803] [DEBUG] [LOCAL ] FNF: Primary data saved (50015 records). [2025-09-19T18:53:49.238959] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-19T18:53:49.239050] [INFO ] [MAIN ] Update Progress: 858/2372 symbols completed. FNF took 31.3s. Estimated remaining: 3h 20m 43s. Rate: 7.5 symbols/min [2025-09-19T18:53:49.406199] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:49.426289] [DEBUG] [LOCAL ] FOR: Loaded 20451 existing records from primary storage. [2025-09-19T18:53:49.426411] [INFO ] [MAIN ] FOR: Loaded 20451 existing records. [2025-09-19T18:53:49.448353] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-19T18:53:49.606583] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:49.606850] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-19T18:53:49.606914] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-19T18:53:49.607484] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-19T18:53:49.607544] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-19T18:53:49.958156] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:50.243247] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-19T18:53:50.636305] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T18:53:50.654323] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T18:53:50.659406] [INFO ] [REMOTE ] FOA: Full fetch complete (22417 records). [2025-09-19T18:53:50.659685] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-19T18:53:51.051571] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-19T18:53:51.087242] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-19T18:53:51.087388] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-19T18:53:51.087919] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-19T18:53:51.087983] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-19T18:53:51.088677] [DEBUG] [LOCAL ] FOA: Trimmed 22417 records to 13348 (keeping 200 days of data) [2025-09-19T18:53:51.171322] [DEBUG] [LOCAL ] FOA: Primary data saved (13348 records). [2025-09-19T18:53:51.171461] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-19T18:53:51.171583] [INFO ] [MAIN ] Update Progress: 859/2372 symbols completed. FOA took 25.2s. Estimated remaining: 3h 20m 25s. Rate: 7.5 symbols/min [2025-09-19T18:53:51.342993] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:51.376733] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:53:51.399220] [DEBUG] [LOCAL ] FOUR: Loaded 49899 existing records from primary storage. [2025-09-19T18:53:51.399374] [INFO ] [MAIN ] FOUR: Loaded 49899 existing records. [2025-09-19T18:53:51.575189] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:51.575430] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-19T18:53:51.575489] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-19T18:53:51.576825] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-19T18:53:51.576886] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-19T18:53:51.848435] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-19T18:53:51.946225] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:52.432319] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:53:52.643265] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-19T18:53:52.805513] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T18:53:53.443264] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-19T18:53:54.243270] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-19T18:53:54.386495] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T18:53:54.530755] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:53:54.532900] [INFO ] [REMOTE ] FOF: Full fetch complete (11833 records). [2025-09-19T18:53:54.532971] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-19T18:53:54.890438] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-19T18:53:54.890522] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-19T18:53:54.890817] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-19T18:53:54.890879] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-19T18:53:54.891365] [DEBUG] [LOCAL ] FOF: Trimmed 11833 records to 8486 (keeping 200 days of data) [2025-09-19T18:53:54.943318] [DEBUG] [LOCAL ] FOF: Primary data saved (8486 records). [2025-09-19T18:53:54.943459] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-19T18:53:54.943563] [INFO ] [MAIN ] Update Progress: 860/2372 symbols completed. FOF took 24.9s. Estimated remaining: 3h 20m 9s. Rate: 7.6 symbols/min [2025-09-19T18:53:55.048380] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-19T18:53:55.124174] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:55.143734] [DEBUG] [LOCAL ] FPF: Loaded 17789 existing records from primary storage. [2025-09-19T18:53:55.143886] [INFO ] [MAIN ] FPF: Loaded 17789 existing records. [2025-09-19T18:53:55.325564] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:55.325829] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-19T18:53:55.325892] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-19T18:53:55.326515] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-19T18:53:55.326582] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-19T18:53:55.691434] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:55.701585] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:53:55.843269] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-19T18:53:56.395105] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T18:53:56.643242] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-19T18:53:57.117179] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T18:53:57.443282] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-19T18:53:58.243395] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-19T18:53:58.342344] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T18:53:58.515205] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T18:53:58.523044] [INFO ] [REMOTE ] FNV: Full fetch complete (65943 records). [2025-09-19T18:53:58.523290] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-19T18:53:58.946551] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-19T18:53:58.946699] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-19T18:53:58.947713] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-19T18:53:58.947778] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-19T18:53:58.949217] [DEBUG] [LOCAL ] FNV: Trimmed 65943 records to 47177 (keeping 200 days of data) [2025-09-19T18:53:59.044568] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-19T18:53:59.269923] [DEBUG] [LOCAL ] FNV: Primary data saved (47177 records). [2025-09-19T18:53:59.270091] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-19T18:53:59.270195] [INFO ] [MAIN ] Update Progress: 861/2372 symbols completed. FNV took 37.2s. Estimated remaining: 3h 19m 55s. Rate: 7.6 symbols/min [2025-09-19T18:53:59.440285] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:59.459911] [DEBUG] [LOCAL ] FPH: Loaded 19970 existing records from primary storage. [2025-09-19T18:53:59.460043] [INFO ] [MAIN ] FPH: Loaded 19970 existing records. [2025-09-19T18:53:59.641249] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:59.641568] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-19T18:53:59.641624] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-19T18:53:59.642298] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-19T18:53:59.642357] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-19T18:53:59.852174] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-19T18:54:00.034439] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:00.041755] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:54:00.123017] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T18:54:00.643275] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-19T18:54:00.844562] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T18:54:01.443284] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-19T18:54:02.243310] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-19T18:54:02.588691] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T18:54:02.786730] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T18:54:03.043278] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-19T18:54:03.843293] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-19T18:54:04.643271] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-19T18:54:05.548059] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (3.30 seconds). [2025-09-19T18:54:05.553100] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-19T18:54:05.698772] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-19T18:54:06.031701] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:54:06.243235] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-19T18:54:06.653771] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T18:54:06.866538] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:54:07.049710] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-19T18:54:07.054678] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T18:54:07.798352] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T18:54:07.843233] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-19T18:54:08.643309] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-19T18:54:09.125497] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T18:54:09.443266] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-19T18:54:10.243296] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-19T18:54:10.755865] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T18:54:10.787596] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T18:54:10.888214] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T18:54:11.043307] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-19T18:54:11.843246] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-19T18:54:12.388361] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:54:12.643298] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-19T18:54:13.264511] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T18:54:13.443269] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-19T18:54:13.592536] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T18:54:14.243270] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-19T18:54:15.043271] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-19T18:54:15.843252] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-19T18:54:15.993227] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-19T18:54:16.100846] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T18:54:16.643254] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-19T18:54:16.792272] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T18:54:16.817256] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:54:17.443248] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-19T18:54:18.243238] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-19T18:54:18.492544] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T18:54:18.677269] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:54:18.680894] [INFO ] [REMOTE ] FOR: Full fetch complete (29756 records). [2025-09-19T18:54:18.680980] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-19T18:54:19.064542] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-19T18:54:19.079137] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-19T18:54:19.079202] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-19T18:54:19.079919] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-19T18:54:19.080072] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-19T18:54:19.081160] [DEBUG] [LOCAL ] FOR: Trimmed 29756 records to 20598 (keeping 200 days of data) [2025-09-19T18:54:19.208036] [DEBUG] [LOCAL ] FOR: Primary data saved (20598 records). [2025-09-19T18:54:19.208187] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-19T18:54:19.208803] [INFO ] [MAIN ] Update Progress: 862/2372 symbols completed. FOR took 30.0s. Estimated remaining: 3h 20m 8s. Rate: 7.5 symbols/min [2025-09-19T18:54:19.384964] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:19.419984] [DEBUG] [LOCAL ] FPI: Loaded 31537 existing records from primary storage. [2025-09-19T18:54:19.420134] [INFO ] [MAIN ] FPI: Loaded 31537 existing records. [2025-09-19T18:54:19.605865] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:19.606153] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-19T18:54:19.606212] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-19T18:54:19.607091] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-19T18:54:19.607156] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-19T18:54:19.847841] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-19T18:54:19.889875] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:54:20.014131] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:20.562106] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:54:20.621067] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T18:54:20.643218] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-19T18:54:21.443324] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-19T18:54:22.248266] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-19T18:54:22.251582] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T18:54:22.343920] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T18:54:23.043296] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-19T18:54:23.130330] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T18:54:23.133224] [INFO ] [REMOTE ] FPF: Full fetch complete (26346 records). [2025-09-19T18:54:23.133303] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-19T18:54:23.512127] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-19T18:54:23.512216] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-19T18:54:23.512837] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-19T18:54:23.512901] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-19T18:54:23.513750] [DEBUG] [LOCAL ] FPF: Trimmed 26346 records to 17887 (keeping 200 days of data) [2025-09-19T18:54:23.627291] [DEBUG] [LOCAL ] FPF: Primary data saved (17887 records). [2025-09-19T18:54:23.627452] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-19T18:54:23.627561] [INFO ] [MAIN ] Update Progress: 863/2372 symbols completed. FPF took 28.7s. Estimated remaining: 3h 19m 54s. Rate: 7.5 symbols/min [2025-09-19T18:54:23.821303] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:23.848828] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-19T18:54:23.869723] [DEBUG] [LOCAL ] FR: Loaded 47153 existing records from primary storage. [2025-09-19T18:54:23.869911] [INFO ] [MAIN ] FR: Loaded 47153 existing records. [2025-09-19T18:54:24.059359] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:24.059614] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-19T18:54:24.059694] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-19T18:54:24.061034] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-19T18:54:24.061097] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-19T18:54:24.462688] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:24.643237] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-19T18:54:24.843128] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T18:54:25.257914] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T18:54:25.443248] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-19T18:54:25.921482] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:54:26.243304] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-19T18:54:26.867855] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T18:54:26.875423] [INFO ] [REMOTE ] FOUR: Full fetch complete (71892 records). [2025-09-19T18:54:26.875547] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-19T18:54:27.050957] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-19T18:54:27.284556] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-19T18:54:27.284665] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-19T18:54:27.285611] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-19T18:54:27.285708] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-19T18:54:27.290229] [DEBUG] [LOCAL ] FOUR: Trimmed 71892 records to 50265 (keeping 200 days of data) [2025-09-19T18:54:27.393926] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T18:54:27.606986] [DEBUG] [LOCAL ] FOUR: Primary data saved (50265 records). [2025-09-19T18:54:27.607131] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-19T18:54:27.607242] [INFO ] [MAIN ] Update Progress: 864/2372 symbols completed. FOUR took 36.4s. Estimated remaining: 3h 19m 39s. Rate: 7.6 symbols/min [2025-09-19T18:54:27.801393] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:27.817585] [DEBUG] [LOCAL ] FRA: Loaded 14867 existing records from primary storage. [2025-09-19T18:54:27.817772] [INFO ] [MAIN ] FRA: Loaded 14867 existing records. [2025-09-19T18:54:27.848505] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-19T18:54:28.011578] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:28.015720] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-19T18:54:28.015922] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-19T18:54:28.016416] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-19T18:54:28.016476] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-19T18:54:28.385976] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:28.626146] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T18:54:28.643285] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-19T18:54:29.443305] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-19T18:54:29.964900] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T18:54:30.236110] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T18:54:30.244572] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-19T18:54:30.604631] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T18:54:31.043266] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-19T18:54:31.613594] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T18:54:31.843309] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-19T18:54:31.992175] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:54:32.643279] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-19T18:54:33.443276] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-19T18:54:33.655165] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T18:54:33.893779] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T18:54:34.243276] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-19T18:54:34.501751] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T18:54:35.043274] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-19T18:54:35.843272] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-19T18:54:36.150899] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T18:54:36.393892] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T18:54:36.397518] [INFO ] [REMOTE ] FPH: Full fetch complete (31720 records). [2025-09-19T18:54:36.397611] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-19T18:54:36.648972] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-19T18:54:36.779681] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-19T18:54:36.779780] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-19T18:54:36.780392] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-19T18:54:36.780439] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-19T18:54:36.781187] [DEBUG] [LOCAL ] FPH: Trimmed 31720 records to 20104 (keeping 200 days of data) [2025-09-19T18:54:36.891570] [DEBUG] [LOCAL ] FPH: Primary data saved (20104 records). [2025-09-19T18:54:36.891742] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-19T18:54:36.891889] [INFO ] [MAIN ] Update Progress: 865/2372 symbols completed. FPH took 37.6s. Estimated remaining: 3h 19m 33s. Rate: 7.6 symbols/min [2025-09-19T18:54:37.062004] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:37.083590] [DEBUG] [LOCAL ] FRGE: Loaded 19155 existing records from primary storage. [2025-09-19T18:54:37.083807] [INFO ] [MAIN ] FRGE: Loaded 19155 existing records. [2025-09-19T18:54:37.259176] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:37.259474] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-19T18:54:37.259524] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-19T18:54:37.260224] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-19T18:54:37.260286] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-19T18:54:37.471812] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-19T18:54:37.621074] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:37.645729] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T18:54:38.169678] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T18:54:38.243254] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-19T18:54:38.780167] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T18:54:39.043268] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-19T18:54:39.843267] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-19T18:54:39.872240] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T18:54:40.648343] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-19T18:54:40.663838] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T18:54:40.685080] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T18:54:41.443280] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-19T18:54:41.885402] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T18:54:42.157783] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-19T18:54:42.243270] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-19T18:54:43.043299] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-19T18:54:43.843237] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-19T18:54:43.930227] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T18:54:44.174518] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T18:54:44.643293] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-19T18:54:44.924352] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T18:54:45.254000] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T18:54:45.443268] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-19T18:54:46.243297] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-19T18:54:47.043276] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-19T18:54:47.230796] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:54:47.652423] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T18:54:47.817436] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T18:54:47.843216] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-19T18:54:48.643310] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-19T18:54:49.388910] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T18:54:49.443221] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-19T18:54:50.243267] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-19T18:54:50.459679] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T18:54:50.545050] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T18:54:51.043285] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-19T18:54:51.124973] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T18:54:51.843268] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-19T18:54:52.643269] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-19T18:54:52.693984] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T18:54:52.696875] [INFO ] [REMOTE ] FRA: Full fetch complete (24345 records). [2025-09-19T18:54:52.697122] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-19T18:54:52.821894] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-19T18:54:53.116482] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-19T18:54:53.116574] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-19T18:54:53.117180] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-19T18:54:53.117255] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-19T18:54:53.117964] [DEBUG] [LOCAL ] FRA: Trimmed 24345 records to 14908 (keeping 200 days of data) [2025-09-19T18:54:53.208998] [DEBUG] [LOCAL ] FRA: Primary data saved (14908 records). [2025-09-19T18:54:53.209143] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-19T18:54:53.209230] [INFO ] [MAIN ] Update Progress: 866/2372 symbols completed. FRA took 25.6s. Estimated remaining: 3h 19m 40s. Rate: 7.5 symbols/min [2025-09-19T18:54:53.379577] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:53.433985] [DEBUG] [LOCAL ] FRO: Loaded 52317 existing records from primary storage. [2025-09-19T18:54:53.434138] [INFO ] [MAIN ] FRO: Loaded 52317 existing records. [2025-09-19T18:54:53.448470] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-19T18:54:53.619159] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:53.619617] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-19T18:54:53.619811] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-19T18:54:53.626283] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-19T18:54:53.626388] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-19T18:54:53.687828] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T18:54:54.005534] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:54.243294] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-19T18:54:55.043267] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-19T18:54:55.209638] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T18:54:55.254446] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T18:54:55.262490] [INFO ] [REMOTE ] FR: Full fetch complete (66589 records). [2025-09-19T18:54:55.262694] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-19T18:54:55.671848] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-19T18:54:55.671946] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-19T18:54:55.672889] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-19T18:54:55.672954] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-19T18:54:55.674622] [DEBUG] [LOCAL ] FR: Trimmed 66589 records to 47434 (keeping 200 days of data) [2025-09-19T18:54:55.858038] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-19T18:54:55.972622] [DEBUG] [LOCAL ] FR: Primary data saved (47434 records). [2025-09-19T18:54:55.972793] [INFO ] [MAIN ] FR: Full history saved. [2025-09-19T18:54:55.972902] [INFO ] [MAIN ] Update Progress: 867/2372 symbols completed. FR took 32.3s. Estimated remaining: 3h 19m 23s. Rate: 7.5 symbols/min [2025-09-19T18:54:56.161761] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T18:54:56.199625] [INFO ] [REMOTE ] FPI: Full fetch complete (44065 records). [2025-09-19T18:54:56.203233] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-19T18:54:56.203041] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:56.602811] [DEBUG] [LOCAL ] FRT: Loaded 42722 existing records from primary storage. [2025-09-19T18:54:56.613247] [INFO ] [MAIN ] FRT: Loaded 42722 existing records. [2025-09-19T18:54:56.656461] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-19T18:54:56.711623] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-19T18:54:56.729246] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-19T18:54:56.751282] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-19T18:54:56.751471] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-19T18:54:56.804699] [DEBUG] [LOCAL ] FPI: Trimmed 44065 records to 31700 (keeping 200 days of data) [2025-09-19T18:54:56.833786] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:56.834038] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-19T18:54:56.834095] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-19T18:54:56.835534] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-19T18:54:56.835671] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-19T18:54:57.355133] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:57.443235] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-19T18:54:57.448926] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T18:54:57.467166] [DEBUG] [LOCAL ] FPI: Primary data saved (31700 records). [2025-09-19T18:54:57.467279] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-19T18:54:57.467358] [INFO ] [MAIN ] Update Progress: 868/2372 symbols completed. FPI took 38.3s. Estimated remaining: 3h 19m 4s. Rate: 7.6 symbols/min [2025-09-19T18:54:57.645362] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:57.685567] [DEBUG] [LOCAL ] FSCO: Loaded 37079 existing records from primary storage. [2025-09-19T18:54:57.685730] [INFO ] [MAIN ] FSCO: Loaded 37079 existing records. [2025-09-19T18:54:57.877896] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:57.878227] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-19T18:54:57.878312] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-19T18:54:57.879256] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-19T18:54:57.879333] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-19T18:54:58.257346] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-19T18:54:58.263403] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:58.302762] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-19T18:54:59.043282] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-19T18:54:59.092507] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T18:54:59.416756] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T18:54:59.843278] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-19T18:55:00.643274] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-19T18:55:01.360268] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T18:55:01.443330] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-19T18:55:01.846575] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T18:55:02.079675] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T18:55:02.243280] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-19T18:55:03.043266] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-19T18:55:03.338363] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T18:55:03.843252] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-19T18:55:04.128613] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:55:04.130934] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T18:55:04.141894] [INFO ] [REMOTE ] FRGE: Full fetch complete (34593 records). [2025-09-19T18:55:04.142357] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-19T18:55:04.554425] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-19T18:55:04.554519] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-19T18:55:04.555447] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-19T18:55:04.555552] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-19T18:55:04.556470] [DEBUG] [LOCAL ] FRGE: Trimmed 34593 records to 19246 (keeping 200 days of data) [2025-09-19T18:55:04.661420] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-19T18:55:04.695791] [DEBUG] [LOCAL ] FRGE: Primary data saved (19246 records). [2025-09-19T18:55:04.695945] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-19T18:55:04.696089] [INFO ] [MAIN ] Update Progress: 869/2372 symbols completed. FRGE took 27.8s. Estimated remaining: 3h 18m 55s. Rate: 7.6 symbols/min [2025-09-19T18:55:04.872379] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:04.938996] [DEBUG] [LOCAL ] FSK: Loaded 49724 existing records from primary storage. [2025-09-19T18:55:04.939168] [INFO ] [MAIN ] FSK: Loaded 49724 existing records. [2025-09-19T18:55:05.135087] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:05.135345] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-19T18:55:05.135395] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-19T18:55:05.136529] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-19T18:55:05.136633] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-19T18:55:05.455040] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-19T18:55:05.498816] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:05.525340] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T18:55:06.243261] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-19T18:55:06.391280] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:55:07.043278] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-19T18:55:07.174215] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T18:55:07.726027] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T18:55:07.843266] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-19T18:55:08.643239] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-19T18:55:09.067400] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T18:55:09.264592] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T18:55:09.443236] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-19T18:55:10.213913] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T18:55:10.243214] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-19T18:55:11.043271] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-19T18:55:11.416896] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T18:55:11.843256] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-19T18:55:11.867384] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T18:55:12.643280] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-19T18:55:12.776684] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T18:55:13.285632] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T18:55:13.443232] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-19T18:55:14.176902] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:55:14.243257] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-19T18:55:15.043266] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-19T18:55:15.244940] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T18:55:15.843286] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-19T18:55:16.174006] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:55:16.413542] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T18:55:16.643272] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-19T18:55:17.016485] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T18:55:17.443246] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-19T18:55:18.250335] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-19T18:55:18.271019] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T18:55:19.043267] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-19T18:55:19.488247] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T18:55:19.586405] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T18:55:19.843263] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-19T18:55:20.163775] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T18:55:20.643264] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-19T18:55:21.253565] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:55:21.261263] [INFO ] [REMOTE ] FRT: Full fetch complete (60262 records). [2025-09-19T18:55:21.261432] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-19T18:55:21.450596] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-19T18:55:21.812712] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-19T18:55:21.812856] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-19T18:55:21.814806] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-19T18:55:21.814956] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-19T18:55:21.817036] [DEBUG] [LOCAL ] FRT: Trimmed 60262 records to 42999 (keeping 200 days of data) [2025-09-19T18:55:22.214974] [DEBUG] [LOCAL ] FRT: Primary data saved (42999 records). [2025-09-19T18:55:22.215238] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-19T18:55:22.215471] [INFO ] [MAIN ] Update Progress: 870/2372 symbols completed. FRT took 26.2s. Estimated remaining: 3h 19m 3s. Rate: 7.5 symbols/min [2025-09-19T18:55:22.248724] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-19T18:55:22.478896] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:22.544381] [DEBUG] [LOCAL ] FSLY: Loaded 51658 existing records from primary storage. [2025-09-19T18:55:22.544619] [INFO ] [MAIN ] FSLY: Loaded 51658 existing records. [2025-09-19T18:55:22.755853] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:22.756257] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-19T18:55:22.766159] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-19T18:55:22.783282] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-19T18:55:22.783422] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-19T18:55:22.852911] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T18:55:23.049136] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-19T18:55:23.166219] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:23.548427] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T18:55:23.843299] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-19T18:55:24.008121] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T18:55:24.643288] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-19T18:55:25.223323] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T18:55:25.235347] [INFO ] [REMOTE ] FRO: Full fetch complete (75468 records). [2025-09-19T18:55:25.235554] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-19T18:55:25.446390] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-19T18:55:25.686256] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-19T18:55:25.686475] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-19T18:55:25.687560] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-19T18:55:25.687734] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-19T18:55:25.708726] [DEBUG] [LOCAL ] FRO: Trimmed 75468 records to 52689 (keeping 200 days of data) [2025-09-19T18:55:25.723726] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T18:55:26.088100] [DEBUG] [LOCAL ] FRO: Primary data saved (52689 records). [2025-09-19T18:55:26.088489] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-19T18:55:26.088600] [INFO ] [MAIN ] Update Progress: 871/2372 symbols completed. FRO took 32.9s. Estimated remaining: 3h 18m 48s. Rate: 7.6 symbols/min [2025-09-19T18:55:26.245330] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-19T18:55:26.273777] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:26.338052] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T18:55:26.373361] [DEBUG] [LOCAL ] FSM: Loaded 53671 existing records from primary storage. [2025-09-19T18:55:26.373529] [INFO ] [MAIN ] FSM: Loaded 53671 existing records. [2025-09-19T18:55:26.566993] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:26.567387] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-19T18:55:26.567465] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-19T18:55:26.568945] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-19T18:55:26.569012] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-19T18:55:26.720361] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T18:55:26.976138] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:27.043259] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-19T18:55:27.843305] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-19T18:55:28.350115] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T18:55:28.643284] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-19T18:55:28.697702] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T18:55:29.046904] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T18:55:29.443249] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-19T18:55:30.243283] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-19T18:55:30.669324] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T18:55:31.043270] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-19T18:55:31.161371] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T18:55:31.167877] [INFO ] [REMOTE ] FSCO: Full fetch complete (53865 records). [2025-09-19T18:55:31.167981] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-19T18:55:31.576429] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-19T18:55:31.576605] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-19T18:55:31.577437] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-19T18:55:31.577517] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-19T18:55:31.579171] [DEBUG] [LOCAL ] FSCO: Trimmed 53865 records to 37339 (keeping 200 days of data) [2025-09-19T18:55:31.698859] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T18:55:31.844417] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-19T18:55:31.844292] [DEBUG] [LOCAL ] FSCO: Primary data saved (37339 records). [2025-09-19T18:55:31.845721] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-19T18:55:31.847039] [INFO ] [MAIN ] Update Progress: 872/2372 symbols completed. FSCO took 34.4s. Estimated remaining: 3h 18m 37s. Rate: 7.6 symbols/min [2025-09-19T18:55:32.020611] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:32.059582] [DEBUG] [LOCAL ] FSS: Loaded 35240 existing records from primary storage. [2025-09-19T18:55:32.059758] [INFO ] [MAIN ] FSS: Loaded 35240 existing records. [2025-09-19T18:55:32.237897] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:32.238139] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-19T18:55:32.238187] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-19T18:55:32.239104] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-19T18:55:32.239164] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-19T18:55:32.621268] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:32.643231] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-19T18:55:32.986520] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:55:33.027878] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:55:33.443248] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-19T18:55:34.136852] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T18:55:34.243307] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-19T18:55:35.043285] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-19T18:55:35.263465] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T18:55:35.356496] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T18:55:35.843267] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-19T18:55:36.643285] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-19T18:55:36.927950] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T18:55:37.443323] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-19T18:55:37.771506] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T18:55:38.243266] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-19T18:55:38.536942] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:55:38.927044] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T18:55:39.043297] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-19T18:55:39.811706] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T18:55:39.843233] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-19T18:55:40.643264] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-19T18:55:41.376215] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-19T18:55:41.443254] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-19T18:55:41.918249] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:55:42.243755] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-19T18:55:42.247532] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T18:55:43.043306] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-19T18:55:43.227846] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:55:43.589733] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T18:55:43.843275] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-19T18:55:44.435302] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:55:44.443050] [INFO ] [REMOTE ] FSK: Full fetch complete (71375 records). [2025-09-19T18:55:44.443192] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-19T18:55:44.652015] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-19T18:55:44.843136] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-19T18:55:44.843249] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-19T18:55:44.844338] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-19T18:55:44.844415] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-19T18:55:44.846088] [DEBUG] [LOCAL ] FSK: Trimmed 71375 records to 50114 (keeping 200 days of data) [2025-09-19T18:55:45.165336] [DEBUG] [LOCAL ] FSK: Primary data saved (50114 records). [2025-09-19T18:55:45.165519] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-19T18:55:45.165621] [INFO ] [MAIN ] Update Progress: 873/2372 symbols completed. FSK took 40.5s. Estimated remaining: 3h 18m 38s. Rate: 7.5 symbols/min [2025-09-19T18:55:45.346131] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:45.355228] [DEBUG] [LOCAL ] FT: Loaded 6372 existing records from primary storage. [2025-09-19T18:55:45.355358] [INFO ] [MAIN ] FT: Loaded 6372 existing records. [2025-09-19T18:55:45.452613] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-19T18:55:45.534235] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:45.534470] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-19T18:55:45.534531] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-19T18:55:45.534894] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-19T18:55:45.534978] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-19T18:55:45.900895] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:45.935845] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T18:55:46.243272] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-19T18:55:46.699407] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:55:46.732449] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T18:55:46.790870] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-19T18:55:47.043269] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-19T18:55:47.843266] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-19T18:55:48.649025] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-19T18:55:48.655627] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T18:55:48.929962] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:55:49.443254] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-19T18:55:50.155756] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T18:55:50.243243] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-19T18:55:50.570147] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T18:55:50.802221] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T18:55:51.043261] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-19T18:55:51.843270] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-19T18:55:52.643294] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-19T18:55:53.021774] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T18:55:53.443256] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-19T18:55:53.499995] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-19T18:55:53.706507] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T18:55:54.243266] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-19T18:55:54.851189] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T18:55:55.043269] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-19T18:55:55.843279] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-19T18:55:56.167129] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T18:55:56.261149] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T18:55:56.269684] [INFO ] [REMOTE ] FSM: Full fetch complete (76665 records). [2025-09-19T18:55:56.269901] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-19T18:55:56.654952] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-19T18:55:56.679868] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-19T18:55:56.679944] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-19T18:55:56.680931] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-19T18:55:56.681108] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-19T18:55:56.683014] [DEBUG] [LOCAL ] FSM: Trimmed 76665 records to 54061 (keeping 200 days of data) [2025-09-19T18:55:56.780540] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T18:55:57.005306] [DEBUG] [LOCAL ] FSM: Primary data saved (54061 records). [2025-09-19T18:55:57.005464] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-19T18:55:57.005594] [INFO ] [MAIN ] Update Progress: 874/2372 symbols completed. FSM took 30.9s. Estimated remaining: 3h 18m 37s. Rate: 7.5 symbols/min [2025-09-19T18:55:57.231539] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:57.244516] [DEBUG] [LOCAL ] FTHY: Loaded 11796 existing records from primary storage. [2025-09-19T18:55:57.244683] [INFO ] [MAIN ] FTHY: Loaded 11796 existing records. [2025-09-19T18:55:57.430938] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:57.431210] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-19T18:55:57.431260] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-19T18:55:57.431732] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-19T18:55:57.431795] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-19T18:55:57.452441] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-19T18:55:57.800664] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:58.006805] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T18:55:58.016100] [INFO ] [REMOTE ] FSLY: Full fetch complete (74994 records). [2025-09-19T18:55:58.016262] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-19T18:55:58.248457] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-19T18:55:58.449034] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-19T18:55:58.449195] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-19T18:55:58.450231] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-19T18:55:58.450300] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-19T18:55:58.451965] [DEBUG] [LOCAL ] FSLY: Trimmed 74994 records to 52048 (keeping 200 days of data) [2025-09-19T18:55:58.744889] [DEBUG] [LOCAL ] FSLY: Primary data saved (52048 records). [2025-09-19T18:55:58.745039] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-19T18:55:58.745128] [INFO ] [MAIN ] Update Progress: 875/2372 symbols completed. FSLY took 36.5s. Estimated remaining: 3h 18m 18s. Rate: 7.5 symbols/min [2025-09-19T18:55:58.925222] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:58.974852] [DEBUG] [LOCAL ] FTI: Loaded 53693 existing records from primary storage. [2025-09-19T18:55:58.975003] [INFO ] [MAIN ] FTI: Loaded 53693 existing records. [2025-09-19T18:55:59.048746] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-19T18:55:59.159007] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:59.159287] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-19T18:55:59.159351] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-19T18:55:59.160499] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-19T18:55:59.160560] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-19T18:55:59.533539] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:59.546105] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T18:55:59.574414] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T18:55:59.843261] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-19T18:55:59.849085] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T18:56:00.643268] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-19T18:56:01.443271] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-19T18:56:02.070853] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T18:56:02.243261] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-19T18:56:02.318568] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:56:02.595843] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T18:56:03.043277] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-19T18:56:03.843264] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-19T18:56:04.036782] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T18:56:04.152048] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T18:56:04.319694] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-19T18:56:04.643272] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-19T18:56:05.443267] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-19T18:56:05.778194] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T18:56:06.198562] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T18:56:06.243216] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-19T18:56:06.857717] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T18:56:06.859332] [INFO ] [REMOTE ] FT: Full fetch complete (9050 records). [2025-09-19T18:56:06.859411] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-19T18:56:07.044678] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-19T18:56:07.239106] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-19T18:56:07.239186] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-19T18:56:07.239441] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-19T18:56:07.239479] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-19T18:56:07.239948] [DEBUG] [LOCAL ] FT: Trimmed 9050 records to 6424 (keeping 200 days of data) [2025-09-19T18:56:07.278177] [DEBUG] [LOCAL ] FT: Primary data saved (6424 records). [2025-09-19T18:56:07.278326] [INFO ] [MAIN ] FT: Full history saved. [2025-09-19T18:56:07.278415] [INFO ] [MAIN ] Update Progress: 876/2372 symbols completed. FT took 22.1s. Estimated remaining: 3h 18m 11s. Rate: 7.5 symbols/min [2025-09-19T18:56:07.467195] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:07.502086] [DEBUG] [LOCAL ] FTK: Loaded 32184 existing records from primary storage. [2025-09-19T18:56:07.502239] [INFO ] [MAIN ] FTK: Loaded 32184 existing records. [2025-09-19T18:56:07.684202] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:07.684508] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-19T18:56:07.684560] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-19T18:56:07.685436] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-19T18:56:07.685499] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-19T18:56:07.847715] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-19T18:56:08.065541] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:08.215050] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T18:56:08.643290] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-19T18:56:09.443265] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-19T18:56:09.822755] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T18:56:09.905520] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T18:56:10.243270] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-19T18:56:10.806149] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-19T18:56:10.948946] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T18:56:10.953515] [INFO ] [REMOTE ] FSS: Full fetch complete (47990 records). [2025-09-19T18:56:10.953626] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-19T18:56:11.048484] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-19T18:56:11.344407] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-19T18:56:11.344503] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-19T18:56:11.345297] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-19T18:56:11.345362] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-19T18:56:11.346584] [DEBUG] [LOCAL ] FSS: Trimmed 47990 records to 35405 (keeping 200 days of data) [2025-09-19T18:56:11.573713] [DEBUG] [LOCAL ] FSS: Primary data saved (35405 records). [2025-09-19T18:56:11.573867] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-19T18:56:11.573954] [INFO ] [MAIN ] Update Progress: 877/2372 symbols completed. FSS took 39.7s. Estimated remaining: 3h 17m 57s. Rate: 7.6 symbols/min [2025-09-19T18:56:11.843286] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-19T18:56:12.036301] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:56:12.643261] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-19T18:56:12.839164] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:56:13.443271] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-19T18:56:13.624015] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T18:56:14.244250] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-19T18:56:14.248579] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T18:56:15.043275] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-19T18:56:15.198900] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T18:56:15.843320] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-19T18:56:16.152849] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T18:56:16.643261] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-19T18:56:17.096924] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T18:56:17.099139] [INFO ] [REMOTE ] FTHY: Full fetch complete (17673 records). [2025-09-19T18:56:17.099218] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-19T18:56:17.452783] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-19T18:56:17.464393] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-19T18:56:17.464484] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-19T18:56:17.464921] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-19T18:56:17.464982] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-19T18:56:17.465729] [DEBUG] [LOCAL ] FTHY: Trimmed 17673 records to 11845 (keeping 200 days of data) [2025-09-19T18:56:17.540212] [DEBUG] [LOCAL ] FTHY: Primary data saved (11845 records). [2025-09-19T18:56:17.540359] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-19T18:56:17.540459] [INFO ] [MAIN ] Update Progress: 878/2372 symbols completed. FTHY took 20.5s. Estimated remaining: 3h 17m 46s. Rate: 7.6 symbols/min [2025-09-19T18:56:18.322402] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T18:56:18.333932] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-19T18:56:18.459193] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:56:19.043261] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-19T18:56:20.293763] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T18:56:20.306684] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-19T18:56:20.358017] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T18:56:20.643289] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-19T18:56:21.645459] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:56:21.654356] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-19T18:56:21.821830] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T18:56:22.243298] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-19T18:56:22.788030] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:56:23.043327] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-19T18:56:23.668192] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T18:56:23.843289] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-19T18:56:24.682565] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T18:56:24.690416] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-19T18:56:25.399323] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T18:56:25.443218] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-19T18:56:26.240114] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:56:26.245442] [INFO ] [REMOTE ] FTK: Full fetch complete (42278 records). [2025-09-19T18:56:26.245568] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-19T18:56:26.634238] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-19T18:56:26.634326] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-19T18:56:26.635010] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-19T18:56:26.635073] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-19T18:56:26.636127] [DEBUG] [LOCAL ] FTK: Trimmed 42278 records to 32433 (keeping 200 days of data) [2025-09-19T18:56:26.827419] [DEBUG] [LOCAL ] FTK: Primary data saved (32433 records). [2025-09-19T18:56:26.827575] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-19T18:56:26.827711] [INFO ] [MAIN ] Update Progress: 879/2372 symbols completed. FTK took 19.5s. Estimated remaining: 3h 17m 40s. Rate: 7.6 symbols/min [2025-09-19T18:56:27.229460] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:56:27.241090] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-19T18:56:29.224155] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T18:56:29.232293] [INFO ] [REMOTE ] FTI: Full fetch complete (77122 records). [2025-09-19T18:56:29.232441] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-19T18:56:29.633322] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-19T18:56:29.633420] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-19T18:56:29.634381] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-19T18:56:29.634447] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-19T18:56:29.636065] [DEBUG] [LOCAL ] FTI: Trimmed 77122 records to 54083 (keeping 200 days of data) [2025-09-19T18:56:29.970502] [DEBUG] [LOCAL ] FTI: Primary data saved (54083 records). [2025-09-19T18:56:29.970728] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-19T18:56:29.970855] [INFO ] [MAIN ] Update Progress: 880/2372 symbols completed. FTI took 31.2s. Estimated remaining: 3h 17m 24s. Rate: 7.6 symbols/min [2025-09-19T18:56:30.545689] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:30.627916] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:30.676997] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:30.737800] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:30.740592] [DEBUG] [LOCAL ] FTWO: Loaded 1804 existing records from primary storage. [2025-09-19T18:56:30.741259] [INFO ] [MAIN ] FTWO: Loaded 1804 existing records. [2025-09-19T18:56:30.961803] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:30.978119] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-19T18:56:30.979285] [DEBUG] [LOCAL ] FUBO: Loaded 54089 existing records from primary storage. [2025-09-19T18:56:30.978392] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-19T18:56:30.988293] [INFO ] [MAIN ] FUBO: Loaded 54089 existing records. [2025-09-19T18:56:31.000890] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-19T18:56:31.032939] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-19T18:56:31.106375] [DEBUG] [LOCAL ] FTV: Loaded 53286 existing records from primary storage. [2025-09-19T18:56:31.156397] [INFO ] [MAIN ] FTV: Loaded 53286 existing records. [2025-09-19T18:56:31.201245] [DEBUG] [LOCAL ] FTS: Loaded 42466 existing records from primary storage. [2025-09-19T18:56:31.233763] [INFO ] [MAIN ] FTS: Loaded 42466 existing records. [2025-09-19T18:56:31.554966] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:31.649112] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-19T18:56:31.682069] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-19T18:56:31.772583] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:31.809615] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-19T18:56:31.853356] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-19T18:56:31.853271] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-19T18:56:31.860350] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-19T18:56:31.906256] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-19T18:56:31.931485] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-19T18:56:31.936803] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:32.058016] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-19T18:56:32.103111] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-19T18:56:32.134254] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-19T18:56:32.182899] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-19T18:56:32.243096] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:32.337926] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-19T18:56:33.035870] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:33.118236] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:33.115262] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-19T18:56:33.118558] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-19T18:56:33.207219] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:33.207564] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-19T18:56:33.212541] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T18:56:33.214404] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-19T18:56:33.881929] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T18:56:33.883626] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-19T18:56:34.300169] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-19T18:56:34.302063] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-19T18:56:34.493034] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T18:56:34.503561] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-19T18:56:34.834713] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T18:56:34.835935] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-19T18:56:34.915122] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T18:56:34.926469] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-19T18:56:34.962634] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T18:56:35.043256] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-19T18:56:35.336947] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T18:56:35.843268] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-19T18:56:36.242843] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T18:56:36.310002] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T18:56:36.587387] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T18:56:36.643221] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-19T18:56:37.443235] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-19T18:56:37.572311] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-19T18:56:38.243290] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-19T18:56:38.470714] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:56:38.842091] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-19T18:56:39.043265] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-19T18:56:39.114870] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T18:56:39.353342] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-19T18:56:39.843266] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-19T18:56:40.219107] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-19T18:56:40.643264] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-19T18:56:41.443299] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-19T18:56:42.243312] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-19T18:56:42.282767] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T18:56:42.710374] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T18:56:43.043305] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-19T18:56:43.843270] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-19T18:56:44.643330] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-19T18:56:44.716712] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-19T18:56:44.871928] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T18:56:44.872820] [INFO ] [REMOTE ] FTWO: Full fetch complete (3522 records). [2025-09-19T18:56:44.873017] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-19T18:56:45.082988] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:56:45.280259] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-19T18:56:45.280372] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-19T18:56:45.280505] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-19T18:56:45.280544] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-19T18:56:45.280927] [DEBUG] [LOCAL ] FTWO: Trimmed 3522 records to 1824 (keeping 200 days of data) [2025-09-19T18:56:45.292454] [DEBUG] [LOCAL ] FTWO: Primary data saved (1824 records). [2025-09-19T18:56:45.292528] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-19T18:56:45.292604] [INFO ] [MAIN ] Update Progress: 881/2372 symbols completed. FTWO took 15.3s. Estimated remaining: 3h 17m 29s. Rate: 7.6 symbols/min [2025-09-19T18:56:45.459129] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-19T18:56:45.463032] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:45.499708] [DEBUG] [LOCAL ] FUL: Loaded 33281 existing records from primary storage. [2025-09-19T18:56:45.499850] [INFO ] [MAIN ] FUL: Loaded 33281 existing records. [2025-09-19T18:56:45.678865] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:45.679139] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-19T18:56:45.679210] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-19T18:56:45.680290] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-19T18:56:45.680354] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-19T18:56:46.059496] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:46.086029] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:56:46.243265] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-19T18:56:47.043279] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-19T18:56:47.515585] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T18:56:47.843246] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-19T18:56:47.932296] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T18:56:48.643225] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-19T18:56:48.701580] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:56:49.346494] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T18:56:49.443311] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-19T18:56:50.243273] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-19T18:56:51.001484] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-19T18:56:51.043221] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-19T18:56:51.232383] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T18:56:51.456332] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T18:56:51.843286] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-19T18:56:52.643283] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-19T18:56:53.184595] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T18:56:53.443289] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-19T18:56:53.628002] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T18:56:53.741679] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:56:54.243274] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-19T18:56:55.043249] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-19T18:56:55.249755] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:56:55.819917] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T18:56:55.843221] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-19T18:56:56.643257] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-19T18:56:56.683833] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T18:56:57.443350] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-19T18:56:57.625919] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:56:58.183062] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:56:58.243232] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-19T18:56:58.510807] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:56:58.516994] [INFO ] [REMOTE ] FTS: Full fetch complete (60074 records). [2025-09-19T18:56:58.517127] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-19T18:56:58.915875] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-19T18:56:58.915965] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-19T18:56:58.916874] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-19T18:56:58.916954] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-19T18:56:58.918265] [DEBUG] [LOCAL ] FTS: Trimmed 60074 records to 42760 (keeping 200 days of data) [2025-09-19T18:56:59.046355] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-19T18:56:59.188175] [DEBUG] [LOCAL ] FTS: Primary data saved (42760 records). [2025-09-19T18:56:59.188320] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-19T18:56:59.188430] [INFO ] [MAIN ] Update Progress: 882/2372 symbols completed. FTS took 29.2s. Estimated remaining: 3h 17m 31s. Rate: 7.5 symbols/min [2025-09-19T18:56:59.389004] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:59.451279] [DEBUG] [LOCAL ] FUN: Loaded 51913 existing records from primary storage. [2025-09-19T18:56:59.451487] [INFO ] [MAIN ] FUN: Loaded 51913 existing records. [2025-09-19T18:56:59.636677] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:59.636978] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-19T18:56:59.637036] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-19T18:56:59.638322] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-19T18:56:59.638405] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-19T18:56:59.848439] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-19T18:57:00.007946] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:00.028368] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T18:57:00.071021] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T18:57:00.643280] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-19T18:57:01.443288] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-19T18:57:02.243284] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-19T18:57:02.707076] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-19T18:57:02.938985] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T18:57:03.043252] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-19T18:57:03.843242] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-19T18:57:04.370029] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (2.93 seconds). [2025-09-19T18:57:04.643406] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-19T18:57:04.965388] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T18:57:05.152332] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-19T18:57:05.443273] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-19T18:57:05.843452] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:57:06.243268] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-19T18:57:06.598810] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-19T18:57:06.859155] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T18:57:06.867146] [INFO ] [REMOTE ] FTV: Full fetch complete (76220 records). [2025-09-19T18:57:06.867282] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-19T18:57:07.047240] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-19T18:57:07.275588] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-19T18:57:07.275728] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-19T18:57:07.276778] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-19T18:57:07.276865] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-19T18:57:07.278521] [DEBUG] [LOCAL ] FTV: Trimmed 76220 records to 53674 (keeping 200 days of data) [2025-09-19T18:57:07.620232] [DEBUG] [LOCAL ] FTV: Primary data saved (53674 records). [2025-09-19T18:57:07.620378] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-19T18:57:07.620511] [INFO ] [MAIN ] Update Progress: 883/2372 symbols completed. FTV took 37.6s. Estimated remaining: 3h 17m 23s. Rate: 7.5 symbols/min [2025-09-19T18:57:07.746074] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T18:57:07.837881] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:07.843240] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-19T18:57:07.865404] [DEBUG] [LOCAL ] FVR: Loaded 22106 existing records from primary storage. [2025-09-19T18:57:07.865545] [INFO ] [MAIN ] FVR: Loaded 22106 existing records. [2025-09-19T18:57:08.059811] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:08.060262] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-19T18:57:08.060355] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-19T18:57:08.061172] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-19T18:57:08.061257] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-19T18:57:08.432665] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:08.643262] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-19T18:57:09.407960] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:57:09.413492] [INFO ] [REMOTE ] FUL: Full fetch complete (46593 records). [2025-09-19T18:57:09.413606] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-19T18:57:09.449296] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-19T18:57:09.859684] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-19T18:57:09.860465] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-19T18:57:09.861245] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-19T18:57:09.862070] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-19T18:57:09.869741] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-19T18:57:09.873292] [DEBUG] [LOCAL ] FUL: Trimmed 46593 records to 33507 (keeping 200 days of data) [2025-09-19T18:57:09.876056] [INFO ] [REMOTE ] FUBO: Full fetch complete (77750 records). [2025-09-19T18:57:09.876162] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-19T18:57:10.314999] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T18:57:10.349101] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-19T18:57:10.524833] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-19T18:57:10.526707] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-19T18:57:10.528803] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-19T18:57:10.533041] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-19T18:57:10.546801] [DEBUG] [LOCAL ] FUL: Primary data saved (33507 records). [2025-09-19T18:57:10.547043] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-19T18:57:10.547201] [INFO ] [MAIN ] Update Progress: 884/2372 symbols completed. FUL took 25.3s. Estimated remaining: 3h 17m 7s. Rate: 7.5 symbols/min [2025-09-19T18:57:10.582628] [DEBUG] [LOCAL ] FUBO: Trimmed 77750 records to 54479 (keeping 200 days of data) [2025-09-19T18:57:10.813195] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:10.866886] [DEBUG] [LOCAL ] FVRR: Loaded 40480 existing records from primary storage. [2025-09-19T18:57:10.869548] [INFO ] [MAIN ] FVRR: Loaded 40480 existing records. [2025-09-19T18:57:11.148052] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:11.156666] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-19T18:57:11.157528] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-19T18:57:11.161459] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-19T18:57:11.162005] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-19T18:57:11.298529] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:57:11.372334] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-19T18:57:11.678904] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:11.686043] [DEBUG] [LOCAL ] FUBO: Primary data saved (54479 records). [2025-09-19T18:57:11.686208] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-19T18:57:11.686345] [INFO ] [MAIN ] Update Progress: 885/2372 symbols completed. FUBO took 41.7s. Estimated remaining: 3h 16m 48s. Rate: 7.6 symbols/min [2025-09-19T18:57:11.798753] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:57:11.849486] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-19T18:57:11.875910] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:11.880325] [DEBUG] [LOCAL ] FXED: Loaded 1218 existing records from primary storage. [2025-09-19T18:57:11.880408] [INFO ] [MAIN ] FXED: Loaded 1218 existing records. [2025-09-19T18:57:12.066968] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:12.067273] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-19T18:57:12.067334] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-19T18:57:12.067717] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-19T18:57:12.067780] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-19T18:57:12.427805] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:12.643226] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-19T18:57:13.172336] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T18:57:13.240227] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T18:57:13.355134] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T18:57:13.443246] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-19T18:57:14.243232] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-19T18:57:14.446812] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:57:14.597278] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-19T18:57:15.043279] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-19T18:57:15.843263] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-19T18:57:16.643284] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-19T18:57:16.994759] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:57:17.443273] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-19T18:57:17.650478] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:57:18.243324] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-19T18:57:18.430631] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:57:18.631495] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:57:18.752558] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T18:57:19.043265] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-19T18:57:19.843278] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-19T18:57:20.259926] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T18:57:20.643283] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-19T18:57:21.443250] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-19T18:57:21.506223] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:57:21.847728] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T18:57:22.210706] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T18:57:22.243228] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-19T18:57:23.043312] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-19T18:57:23.383009] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-19T18:57:23.457317] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T18:57:23.843278] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-19T18:57:24.220623] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T18:57:24.643265] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-19T18:57:25.443262] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-19T18:57:25.849148] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T18:57:25.973481] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:57:26.243280] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-19T18:57:27.043307] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-19T18:57:27.347422] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T18:57:27.843341] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-19T18:57:28.223338] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-19T18:57:28.275124] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T18:57:28.643303] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-19T18:57:29.443287] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-19T18:57:30.243275] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-19T18:57:30.462019] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T18:57:30.462855] [INFO ] [REMOTE ] FXED: Full fetch complete (1767 records). [2025-09-19T18:57:30.462928] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-19T18:57:30.830205] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-19T18:57:30.830314] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-19T18:57:30.830536] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-19T18:57:30.830671] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-19T18:57:30.831176] [DEBUG] [LOCAL ] FXED: Trimmed 1767 records to 1232 (keeping 200 days of data) [2025-09-19T18:57:30.839901] [DEBUG] [LOCAL ] FXED: Primary data saved (1232 records). [2025-09-19T18:57:30.839988] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-19T18:57:30.840292] [INFO ] [MAIN ] Update Progress: 886/2372 symbols completed. FXED took 19.2s. Estimated remaining: 3h 16m 59s. Rate: 7.5 symbols/min [2025-09-19T18:57:31.044116] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-19T18:57:31.048454] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:31.053583] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-19T18:57:31.084421] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T18:57:31.135116] [DEBUG] [LOCAL ] G: Loaded 50126 existing records from primary storage. [2025-09-19T18:57:31.135269] [INFO ] [MAIN ] G: Loaded 50126 existing records. [2025-09-19T18:57:31.319772] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:31.320057] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-19T18:57:31.320107] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-19T18:57:31.321408] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-19T18:57:31.321472] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-19T18:57:31.708984] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:31.843299] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-19T18:57:32.405227] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T18:57:32.643282] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-19T18:57:33.443314] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-19T18:57:33.799463] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:57:33.824025] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T18:57:34.243310] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-19T18:57:35.043301] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-19T18:57:35.124361] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T18:57:35.223566] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T18:57:35.843261] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-19T18:57:36.643294] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-19T18:57:36.926360] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T18:57:37.248050] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T18:57:37.443284] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-19T18:57:37.814345] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T18:57:37.817558] [INFO ] [REMOTE ] FVR: Full fetch complete (30703 records). [2025-09-19T18:57:37.817845] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-19T18:57:38.191680] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-19T18:57:38.191786] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-19T18:57:38.192425] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-19T18:57:38.192479] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-19T18:57:38.193464] [DEBUG] [LOCAL ] FVR: Trimmed 30703 records to 22259 (keeping 200 days of data) [2025-09-19T18:57:38.254308] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-19T18:57:38.339158] [DEBUG] [LOCAL ] FVR: Primary data saved (22259 records). [2025-09-19T18:57:38.339284] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-19T18:57:38.339377] [INFO ] [MAIN ] Update Progress: 887/2372 symbols completed. FVR took 30.7s. Estimated remaining: 3h 16m 50s. Rate: 7.5 symbols/min [2025-09-19T18:57:38.512385] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:38.540598] [DEBUG] [LOCAL ] GAB: Loaded 27996 existing records from primary storage. [2025-09-19T18:57:38.540773] [INFO ] [MAIN ] GAB: Loaded 27996 existing records. [2025-09-19T18:57:38.720509] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:38.720854] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-19T18:57:38.720912] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-19T18:57:38.721676] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-19T18:57:38.721754] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-19T18:57:39.081325] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:39.075748] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-19T18:57:39.111563] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T18:57:39.843309] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-19T18:57:40.192139] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:57:40.224269] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T18:57:40.232193] [INFO ] [REMOTE ] FUN: Full fetch complete (72280 records). [2025-09-19T18:57:40.232346] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-19T18:57:40.630839] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-19T18:57:40.630964] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-19T18:57:40.631901] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-19T18:57:40.631975] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-19T18:57:40.633391] [DEBUG] [LOCAL ] FUN: Trimmed 72280 records to 52303 (keeping 200 days of data) [2025-09-19T18:57:40.643256] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-19T18:57:40.949664] [DEBUG] [LOCAL ] FUN: Primary data saved (52303 records). [2025-09-19T18:57:40.949815] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-19T18:57:40.950873] [INFO ] [MAIN ] Update Progress: 888/2372 symbols completed. FUN took 41.8s. Estimated remaining: 3h 16m 33s. Rate: 7.6 symbols/min [2025-09-19T18:57:41.125047] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:41.137720] [DEBUG] [LOCAL ] GAM: Loaded 4390 existing records from primary storage. [2025-09-19T18:57:41.137846] [INFO ] [MAIN ] GAM: Loaded 4390 existing records. [2025-09-19T18:57:41.367136] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:41.367429] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-19T18:57:41.367607] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-19T18:57:41.368017] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-19T18:57:41.368186] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-19T18:57:41.460855] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-19T18:57:41.521887] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:57:41.761761] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:42.243271] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-19T18:57:42.576730] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T18:57:42.685628] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-19T18:57:42.766934] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T18:57:42.773089] [INFO ] [REMOTE ] FVRR: Full fetch complete (58886 records). [2025-09-19T18:57:42.773207] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-19T18:57:43.048508] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-19T18:57:43.175340] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-19T18:57:43.175424] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-19T18:57:43.176248] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-19T18:57:43.176312] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-19T18:57:43.177540] [DEBUG] [LOCAL ] FVRR: Trimmed 58886 records to 40863 (keeping 200 days of data) [2025-09-19T18:57:43.413817] [DEBUG] [LOCAL ] FVRR: Primary data saved (40863 records). [2025-09-19T18:57:43.413985] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-19T18:57:43.414090] [INFO ] [MAIN ] Update Progress: 889/2372 symbols completed. FVRR took 32.9s. Estimated remaining: 3h 16m 16s. Rate: 7.6 symbols/min [2025-09-19T18:57:43.593422] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:43.603334] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T18:57:43.654396] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-09-19T18:57:43.654559] [INFO ] [MAIN ] GAP: Loaded 54045 existing records. [2025-09-19T18:57:43.833542] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:43.833849] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-19T18:57:43.833918] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-19T18:57:43.835186] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-19T18:57:43.835261] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-19T18:57:43.848397] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-19T18:57:44.205667] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:44.643267] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-19T18:57:45.202992] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T18:57:45.247116] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T18:57:45.443286] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-19T18:57:45.984332] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T18:57:46.243285] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-19T18:57:46.980059] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T18:57:47.043259] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-19T18:57:47.809803] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T18:57:47.843232] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-19T18:57:48.533913] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T18:57:48.643286] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-19T18:57:49.370269] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T18:57:49.443280] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-19T18:57:50.243264] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-19T18:57:50.599891] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T18:57:51.000207] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T18:57:51.043270] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-19T18:57:51.843270] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-19T18:57:52.359543] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-19T18:57:52.360558] [INFO ] [REMOTE ] GAM: Full fetch complete (6944 records). [2025-09-19T18:57:52.360627] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-19T18:57:52.648361] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-19T18:57:52.739477] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-19T18:57:52.739703] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-19T18:57:52.739997] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-19T18:57:52.740073] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-19T18:57:52.740843] [DEBUG] [LOCAL ] GAM: Trimmed 6944 records to 4398 (keeping 200 days of data) [2025-09-19T18:57:52.767108] [DEBUG] [LOCAL ] GAM: Primary data saved (4398 records). [2025-09-19T18:57:52.767214] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-19T18:57:52.767311] [INFO ] [MAIN ] Update Progress: 890/2372 symbols completed. GAM took 11.8s. Estimated remaining: 3h 16m 10s. Rate: 7.6 symbols/min [2025-09-19T18:57:52.957429] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:52.989981] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T18:57:53.015992] [DEBUG] [LOCAL ] GATX: Loaded 18177 existing records from primary storage. [2025-09-19T18:57:53.016129] [INFO ] [MAIN ] GATX: Loaded 18177 existing records. [2025-09-19T18:57:53.203444] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:53.203797] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-19T18:57:53.203854] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-19T18:57:53.204449] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-19T18:57:53.204512] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-19T18:57:53.449472] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-19T18:57:53.569414] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:54.243233] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-19T18:57:54.325892] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:57:55.043246] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-19T18:57:55.078517] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:57:55.445307] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T18:57:55.843262] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-19T18:57:56.643261] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-19T18:57:57.048703] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T18:57:57.144610] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T18:57:57.443292] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-19T18:57:58.243291] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-19T18:57:58.462597] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T18:57:58.679057] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:57:58.824550] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T18:57:59.043271] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-19T18:57:59.843279] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-19T18:58:00.300826] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T18:58:00.643276] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-19T18:58:01.443296] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-19T18:58:02.177960] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T18:58:02.243230] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-19T18:58:03.017273] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T18:58:03.043226] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-19T18:58:03.401439] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-19T18:58:03.554459] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T18:58:03.843272] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-19T18:58:04.223267] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T18:58:04.643271] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-19T18:58:05.374055] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:58:05.443218] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-19T18:58:06.243274] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-19T18:58:06.496362] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T18:58:06.572100] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T18:58:07.043286] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-19T18:58:07.843235] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-19T18:58:08.644496] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T18:58:08.644590] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-19T18:58:08.950198] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T18:58:09.027872] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:58:09.443280] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-19T18:58:09.636421] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:58:10.243264] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-19T18:58:11.043253] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-19T18:58:11.601001] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T18:58:11.764380] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T18:58:11.843259] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-19T18:58:12.643257] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-19T18:58:12.884920] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T18:58:12.892532] [INFO ] [REMOTE ] G: Full fetch complete (71544 records). [2025-09-19T18:58:12.892677] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-19T18:58:13.355289] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-19T18:58:13.355421] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-19T18:58:13.356419] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-19T18:58:13.356483] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-19T18:58:13.358246] [DEBUG] [LOCAL ] G: Trimmed 71544 records to 50508 (keeping 200 days of data) [2025-09-19T18:58:13.449953] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-19T18:58:13.622502] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T18:58:13.751590] [DEBUG] [LOCAL ] G: Primary data saved (50508 records). [2025-09-19T18:58:13.749826] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T18:58:13.756356] [INFO ] [MAIN ] G: Full history saved. [2025-09-19T18:58:13.756927] [INFO ] [MAIN ] Update Progress: 891/2372 symbols completed. G took 42.9s. Estimated remaining: 3h 16m 24s. Rate: 7.5 symbols/min [2025-09-19T18:58:13.926799] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:13.941594] [DEBUG] [LOCAL ] GBAB: Loaded 13156 existing records from primary storage. [2025-09-19T18:58:13.941740] [INFO ] [MAIN ] GBAB: Loaded 13156 existing records. [2025-09-19T18:58:14.116823] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:14.117098] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-19T18:58:14.117157] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-19T18:58:14.117687] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-19T18:58:14.117766] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-19T18:58:14.255595] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-19T18:58:14.480784] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:14.494347] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T18:58:15.043272] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-19T18:58:15.843261] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-19T18:58:16.404817] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:58:16.409382] [INFO ] [REMOTE ] GAB: Full fetch complete (39255 records). [2025-09-19T18:58:16.409484] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-19T18:58:16.660871] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-19T18:58:16.853086] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-19T18:58:16.853443] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-19T18:58:16.865216] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-19T18:58:16.865988] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-19T18:58:16.866080] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-19T18:58:16.868058] [DEBUG] [LOCAL ] GAB: Trimmed 39255 records to 28200 (keeping 200 days of data) [2025-09-19T18:58:16.881304] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T18:58:17.051823] [DEBUG] [LOCAL ] GAB: Primary data saved (28200 records). [2025-09-19T18:58:17.051965] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-19T18:58:17.052051] [INFO ] [MAIN ] Update Progress: 892/2372 symbols completed. GAB took 38.7s. Estimated remaining: 3h 16m 8s. Rate: 7.5 symbols/min [2025-09-19T18:58:17.219294] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:17.259352] [DEBUG] [LOCAL ] GBCI: Loaded 40386 existing records from primary storage. [2025-09-19T18:58:17.259513] [INFO ] [MAIN ] GBCI: Loaded 40386 existing records. [2025-09-19T18:58:17.435385] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:17.435636] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-19T18:58:17.435719] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-19T18:58:17.436743] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-19T18:58:17.436805] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-19T18:58:17.448326] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-19T18:58:17.817484] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:17.975322] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T18:58:18.243316] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-19T18:58:19.025636] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T18:58:19.043210] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-19T18:58:19.299333] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T18:58:19.843299] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-19T18:58:20.643337] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-19T18:58:21.443334] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-19T18:58:21.478464] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T18:58:21.609584] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T18:58:21.618243] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-19T18:58:21.618524] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-19T18:58:21.733963] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:58:21.783937] [INFO ] [REMOTE ] GATX: Full fetch complete (25276 records). [2025-09-19T18:58:21.803638] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-19T18:58:22.252164] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-19T18:58:22.263894] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-19T18:58:22.252316] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-19T18:58:22.265355] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-19T18:58:22.271764] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-19T18:58:22.351326] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 54435 (keeping 200 days of data) [2025-09-19T18:58:22.595758] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-19T18:58:22.597173] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-19T18:58:22.605394] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-19T18:58:22.613503] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-19T18:58:22.616376] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:58:22.625122] [DEBUG] [LOCAL ] GATX: Trimmed 25276 records to 18317 (keeping 200 days of data) [2025-09-19T18:58:22.984010] [DEBUG] [LOCAL ] GATX: Primary data saved (18317 records). [2025-09-19T18:58:22.984148] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-19T18:58:22.983909] [DEBUG] [LOCAL ] GAP: Primary data saved (54435 records). [2025-09-19T18:58:22.984350] [INFO ] [MAIN ] Update Progress: 893/2372 symbols completed. GATX took 30.2s. Estimated remaining: 3h 15m 57s. Rate: 7.5 symbols/min [2025-09-19T18:58:22.984788] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-19T18:58:23.016700] [INFO ] [MAIN ] Update Progress: 894/2372 symbols completed. GAP took 39.6s. Estimated remaining: 3h 15m 36s. Rate: 7.6 symbols/min [2025-09-19T18:58:23.048676] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-19T18:58:23.285028] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:23.320873] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-19T18:58:23.348951] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:23.349026] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-19T18:58:23.349306] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-19T18:58:23.349361] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-19T18:58:23.349409] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-19T18:58:23.349442] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-19T18:58:23.702070] [DEBUG] [LOCAL ] GBTG: Loaded 41003 existing records from primary storage. [2025-09-19T18:58:23.762688] [INFO ] [MAIN ] GBTG: Loaded 41003 existing records. [2025-09-19T18:58:23.765982] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:23.850888] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T18:58:23.850298] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-19T18:58:23.925769] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:58:24.012072] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:24.012350] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-19T18:58:24.012402] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-19T18:58:24.013431] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-19T18:58:24.013493] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-19T18:58:24.406065] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:24.435192] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T18:58:24.643283] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-19T18:58:25.443309] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-19T18:58:26.243264] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-19T18:58:26.360079] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T18:58:26.843323] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T18:58:27.043283] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-19T18:58:27.381483] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-19T18:58:27.698078] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T18:58:27.843265] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-19T18:58:28.220463] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-19T18:58:28.643287] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-19T18:58:29.044669] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T18:58:29.443315] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-19T18:58:29.807168] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-19T18:58:30.243268] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-19T18:58:31.043292] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-19T18:58:31.444360] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T18:58:31.833671] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T18:58:31.843246] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-19T18:58:32.643267] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-19T18:58:33.298128] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:58:33.443244] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-19T18:58:34.243294] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-19T18:58:34.292147] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:58:34.514973] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-19T18:58:34.534266] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T18:58:35.043270] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-19T18:58:35.843264] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-19T18:58:35.967419] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T18:58:36.126342] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-19T18:58:36.643309] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-19T18:58:37.443286] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-19T18:58:37.848988] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T18:58:37.997349] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T18:58:38.243273] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-19T18:58:38.659336] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-19T18:58:38.660109] [INFO ] [REMOTE ] GBLI: Full fetch complete (1418 records). [2025-09-19T18:58:38.660184] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-19T18:58:38.854908] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-19T18:58:38.855142] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:58:38.855215] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:58:38.855290] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-19T18:58:38.855370] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-19T18:58:38.855426] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-19T18:58:38.855470] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-19T18:58:38.855530] [INFO ] [MAIN ] Update Progress: 895/2372 symbols completed. GBLI took 15.9s. Estimated remaining: 3h 15m 41s. Rate: 7.5 symbols/min [2025-09-19T18:58:39.032209] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:39.043292] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-19T18:58:39.065850] [DEBUG] [LOCAL ] GBX: Loaded 29724 existing records from primary storage. [2025-09-19T18:58:39.065993] [INFO ] [MAIN ] GBX: Loaded 29724 existing records. [2025-09-19T18:58:39.247985] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:39.248221] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-19T18:58:39.248269] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-19T18:58:39.248992] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-19T18:58:39.249051] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-19T18:58:39.628611] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:39.843250] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-19T18:58:40.222855] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T18:58:40.642901] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T18:58:40.647909] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-19T18:58:41.443322] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-19T18:58:41.735956] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T18:58:42.243348] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-19T18:58:42.426764] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T18:58:43.043268] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-19T18:58:43.843269] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-19T18:58:44.015616] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:58:44.188270] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T18:58:44.599388] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T18:58:44.643265] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-19T18:58:45.443258] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-19T18:58:45.961675] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T18:58:46.243282] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-19T18:58:46.947426] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T18:58:47.043266] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-19T18:58:47.349583] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T18:58:47.843264] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-19T18:58:48.531377] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T18:58:48.643264] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-19T18:58:48.964278] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T18:58:49.443282] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-19T18:58:50.243267] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-19T18:58:50.327329] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T18:58:50.765030] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T18:58:51.043259] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-19T18:58:51.190491] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T18:58:51.196483] [INFO ] [REMOTE ] GBCI: Full fetch complete (57676 records). [2025-09-19T18:58:51.196595] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-19T18:58:51.607039] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-19T18:58:51.607120] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-19T18:58:51.607921] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-19T18:58:51.607982] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-19T18:58:51.609149] [DEBUG] [LOCAL ] GBCI: Trimmed 57676 records to 40713 (keeping 200 days of data) [2025-09-19T18:58:51.843454] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-19T18:58:51.871041] [DEBUG] [LOCAL ] GBCI: Primary data saved (40713 records). [2025-09-19T18:58:51.871159] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-19T18:58:51.871250] [INFO ] [MAIN ] Update Progress: 896/2372 symbols completed. GBCI took 34.8s. Estimated remaining: 3h 15m 41s. Rate: 7.5 symbols/min [2025-09-19T18:58:52.048378] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:52.092021] [DEBUG] [LOCAL ] GCI: Loaded 44615 existing records from primary storage. [2025-09-19T18:58:52.092181] [INFO ] [MAIN ] GCI: Loaded 44615 existing records. [2025-09-19T18:58:52.272031] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:52.272321] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-19T18:58:52.272373] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-19T18:58:52.273285] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-19T18:58:52.273347] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-19T18:58:52.643247] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-19T18:58:52.656518] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:53.110193] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T18:58:53.443272] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-19T18:58:53.537516] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T18:58:53.736149] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:58:53.739402] [INFO ] [REMOTE ] GBAB: Full fetch complete (20629 records). [2025-09-19T18:58:53.739491] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-19T18:58:54.171405] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-19T18:58:54.171515] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-19T18:58:54.172271] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-19T18:58:54.172495] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-19T18:58:54.173466] [DEBUG] [LOCAL ] GBAB: Trimmed 20629 records to 13219 (keeping 200 days of data) [2025-09-19T18:58:54.243483] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-19T18:58:54.259330] [DEBUG] [LOCAL ] GBAB: Primary data saved (13219 records). [2025-09-19T18:58:54.259482] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-19T18:58:54.259584] [INFO ] [MAIN ] Update Progress: 897/2372 symbols completed. GBAB took 40.5s. Estimated remaining: 3h 15m 24s. Rate: 7.5 symbols/min [2025-09-19T18:58:54.439782] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:54.465944] [DEBUG] [LOCAL ] GCO: Loaded 26118 existing records from primary storage. [2025-09-19T18:58:54.466154] [INFO ] [MAIN ] GCO: Loaded 26118 existing records. [2025-09-19T18:58:54.642337] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:54.642578] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-19T18:58:54.642628] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-19T18:58:54.643368] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-19T18:58:54.643428] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-19T18:58:55.008625] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:55.032344] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T18:58:55.043216] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-19T18:58:55.843381] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-19T18:58:55.867760] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:58:56.353797] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T18:58:56.643265] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-19T18:58:57.241031] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T18:58:57.443265] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-19T18:58:57.838335] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T18:58:58.243270] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-19T18:58:59.043278] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-19T18:58:59.178168] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T18:58:59.184400] [INFO ] [REMOTE ] GBTG: Full fetch complete (56710 records). [2025-09-19T18:58:59.184511] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-19T18:58:59.574389] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-19T18:58:59.574519] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-19T18:58:59.575380] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-19T18:58:59.575475] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-19T18:58:59.577038] [DEBUG] [LOCAL ] GBTG: Trimmed 56710 records to 41256 (keeping 200 days of data) [2025-09-19T18:58:59.684627] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T18:58:59.843251] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-19T18:58:59.843438] [DEBUG] [LOCAL ] GBTG: Primary data saved (41256 records). [2025-09-19T18:58:59.844314] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-19T18:58:59.844431] [INFO ] [MAIN ] Update Progress: 898/2372 symbols completed. GBTG took 36.8s. Estimated remaining: 3h 15m 13s. Rate: 7.6 symbols/min [2025-09-19T18:59:00.020335] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:00.038421] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T18:59:00.061077] [DEBUG] [LOCAL ] GCTS: Loaded 19626 existing records from primary storage. [2025-09-19T18:59:00.061287] [INFO ] [MAIN ] GCTS: Loaded 19626 existing records. [2025-09-19T18:59:00.244977] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:00.245242] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-19T18:59:00.245307] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-19T18:59:00.245955] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-19T18:59:00.246021] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-19T18:59:00.595859] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:00.643233] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-19T18:59:01.455273] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-19T18:59:01.461550] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:59:02.060056] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T18:59:02.243296] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-19T18:59:02.328775] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T18:59:03.043248] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-19T18:59:03.465508] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T18:59:03.843248] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-19T18:59:03.973210] [DEBUG] [REMOTE ] GCTS: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T18:59:03.973489] [WARN ] [REMOTE ] GCTS: No data returned for month 2025-01 [2025-09-19T18:59:04.322809] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T18:59:04.643285] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-19T18:59:05.443232] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-19T18:59:05.878174] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T18:59:06.243269] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-19T18:59:06.706805] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T18:59:07.010772] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T18:59:07.043243] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-19T18:59:07.843270] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-19T18:59:08.317527] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T18:59:08.643248] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-19T18:59:09.443253] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-19T18:59:09.534343] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T18:59:09.750133] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T18:59:10.243260] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-19T18:59:11.016562] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T18:59:11.043220] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-19T18:59:11.843265] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-19T18:59:12.114990] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:59:12.240579] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T18:59:12.643319] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-19T18:59:13.443287] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-19T18:59:13.482874] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T18:59:13.736619] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:59:14.243286] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-19T18:59:14.249157] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-19T18:59:15.043289] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-19T18:59:15.500475] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T18:59:15.843299] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-19T18:59:16.468049] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T18:59:16.643281] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-19T18:59:16.693943] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T18:59:17.443314] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-19T18:59:17.506262] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T18:59:17.510387] [INFO ] [REMOTE ] GBX: Full fetch complete (42691 records). [2025-09-19T18:59:17.510543] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-19T18:59:17.922526] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-19T18:59:17.922606] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-19T18:59:17.923303] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-19T18:59:17.923377] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-19T18:59:17.924365] [DEBUG] [LOCAL ] GBX: Trimmed 42691 records to 29882 (keeping 200 days of data) [2025-09-19T18:59:18.109222] [DEBUG] [LOCAL ] GBX: Primary data saved (29882 records). [2025-09-19T18:59:18.109365] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-19T18:59:18.109477] [INFO ] [MAIN ] Update Progress: 899/2372 symbols completed. GBX took 39.3s. Estimated remaining: 3h 15m 22s. Rate: 7.5 symbols/min [2025-09-19T18:59:18.256497] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-19T18:59:18.294138] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:18.302876] [DEBUG] [LOCAL ] GCV: Loaded 7097 existing records from primary storage. [2025-09-19T18:59:18.303521] [INFO ] [MAIN ] GCV: Loaded 7097 existing records. [2025-09-19T18:59:18.490812] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:18.491065] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-19T18:59:18.491112] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-19T18:59:18.491468] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-19T18:59:18.491535] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-19T18:59:18.867798] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:18.901543] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:59:19.043268] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-19T18:59:19.409476] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T18:59:19.413107] [INFO ] [REMOTE ] GCTS: Full fetch complete (24575 records). [2025-09-19T18:59:19.413202] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-19T18:59:19.619923] [WARN ] [VALIDATOR ] GCTS: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T18:59:19.620299] [FATAL] [MAIN ] GCTS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:59:19.620429] [WARN ] [MAIN ] GCTS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:59:19.620505] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-19T18:59:19.620596] [DEBUG] [LOCAL ] GCTS: No primary data file found to delete. [2025-09-19T18:59:19.620677] [INFO ] [LOCAL ] GCTS: Starting deletion of derivative data. [2025-09-19T18:59:19.621152] [DEBUG] [LOCAL ] GCTS: Deleted derivative data file. [2025-09-19T18:59:19.621298] [INFO ] [MAIN ] Update Progress: 900/2372 symbols completed. GCTS took 19.8s. Estimated remaining: 3h 15m 3s. Rate: 7.5 symbols/min [2025-09-19T18:59:19.806963] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:19.847347] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-19T18:59:19.868107] [DEBUG] [LOCAL ] GD: Loaded 47822 existing records from primary storage. [2025-09-19T18:59:19.868287] [INFO ] [MAIN ] GD: Loaded 47822 existing records. [2025-09-19T18:59:19.981958] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:59:20.071020] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:20.071296] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-19T18:59:20.071348] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-19T18:59:20.073440] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-19T18:59:20.073502] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-19T18:59:20.477962] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:20.643282] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-19T18:59:20.770789] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T18:59:21.443294] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-19T18:59:22.243304] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-19T18:59:22.599722] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-19T18:59:22.762013] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T18:59:22.797271] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T18:59:22.805353] [INFO ] [REMOTE ] GCI: Full fetch complete (63084 records). [2025-09-19T18:59:22.805493] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-19T18:59:23.048405] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-19T18:59:23.213468] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-19T18:59:23.213635] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-19T18:59:23.214845] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-19T18:59:23.214962] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-19T18:59:23.217323] [DEBUG] [LOCAL ] GCI: Trimmed 63084 records to 44929 (keeping 200 days of data) [2025-09-19T18:59:23.482187] [DEBUG] [LOCAL ] GCI: Primary data saved (44929 records). [2025-09-19T18:59:23.482313] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-19T18:59:23.482444] [INFO ] [MAIN ] Update Progress: 901/2372 symbols completed. GCI took 31.6s. Estimated remaining: 3h 14m 48s. Rate: 7.6 symbols/min [2025-09-19T18:59:23.657724] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:23.715390] [DEBUG] [LOCAL ] GDDY: Loaded 50203 existing records from primary storage. [2025-09-19T18:59:23.715553] [INFO ] [MAIN ] GDDY: Loaded 50203 existing records. [2025-09-19T18:59:23.843586] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-19T18:59:23.844949] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T18:59:23.915289] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:23.915578] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-19T18:59:23.915683] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-19T18:59:23.916853] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-19T18:59:23.916935] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-19T18:59:24.335079] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:24.643299] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-19T18:59:25.443307] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-19T18:59:25.614846] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T18:59:25.692708] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T18:59:26.243293] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-19T18:59:27.043271] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-19T18:59:27.253853] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T18:59:27.324105] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-19T18:59:27.717390] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T18:59:27.843226] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-19T18:59:28.476637] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T18:59:28.643328] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-19T18:59:29.443288] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-19T18:59:29.572506] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T18:59:30.161487] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T18:59:30.243212] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-19T18:59:30.817143] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T18:59:31.043346] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-19T18:59:31.843264] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-19T18:59:32.643342] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-19T18:59:33.084462] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T18:59:33.212703] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T18:59:33.443279] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-19T18:59:34.243338] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-19T18:59:35.043251] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-19T18:59:35.177451] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-19T18:59:35.182060] [INFO ] [REMOTE ] GCO: Full fetch complete (36092 records). [2025-09-19T18:59:35.182166] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-19T18:59:35.594278] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-19T18:59:35.594451] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-19T18:59:35.595127] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-19T18:59:35.595208] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-19T18:59:35.596435] [DEBUG] [LOCAL ] GCO: Trimmed 36092 records to 26266 (keeping 200 days of data) [2025-09-19T18:59:35.610223] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T18:59:35.746285] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-19T18:59:35.807353] [DEBUG] [LOCAL ] GCO: Primary data saved (26266 records). [2025-09-19T18:59:35.807489] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-19T18:59:35.807612] [INFO ] [MAIN ] Update Progress: 902/2372 symbols completed. GCO took 41.5s. Estimated remaining: 3h 14m 48s. Rate: 7.5 symbols/min [2025-09-19T18:59:35.848313] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-19T18:59:36.027277] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:36.032451] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T18:59:36.047503] [DEBUG] [LOCAL ] GDIV: Loaded 3803 existing records from primary storage. [2025-09-19T18:59:36.047628] [INFO ] [MAIN ] GDIV: Loaded 3803 existing records. [2025-09-19T18:59:36.235836] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:36.236110] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-19T18:59:36.236157] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-19T18:59:36.236519] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-19T18:59:36.236578] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-19T18:59:36.605937] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:36.643268] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-19T18:59:37.342770] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T18:59:37.344794] [INFO ] [REMOTE ] GCV: Full fetch complete (9274 records). [2025-09-19T18:59:37.344869] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-19T18:59:37.445332] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-19T18:59:37.707160] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-19T18:59:37.707273] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-19T18:59:37.707517] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-19T18:59:37.707592] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-19T18:59:37.708330] [DEBUG] [LOCAL ] GCV: Trimmed 9274 records to 7140 (keeping 200 days of data) [2025-09-19T18:59:37.754291] [DEBUG] [LOCAL ] GCV: Primary data saved (7140 records). [2025-09-19T18:59:37.754478] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-19T18:59:37.754602] [INFO ] [MAIN ] Update Progress: 903/2372 symbols completed. GCV took 19.6s. Estimated remaining: 3h 14m 30s. Rate: 7.6 symbols/min [2025-09-19T18:59:37.924870] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:37.925121] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-19T18:59:37.925194] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-19T18:59:37.925381] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-19T18:59:37.925434] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-19T18:59:37.925478] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-19T18:59:37.925510] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-19T18:59:38.107956] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T18:59:38.250179] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-19T18:59:38.332885] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:39.043222] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-19T18:59:39.156935] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:59:39.186689] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:59:39.843283] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-19T18:59:40.505273] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T18:59:40.643254] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-19T18:59:40.967842] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T18:59:41.301167] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T18:59:41.443304] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-19T18:59:41.966115] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T18:59:42.243266] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-19T18:59:42.999799] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T18:59:43.043222] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-19T18:59:43.843284] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-19T18:59:44.500141] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T18:59:44.643305] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-19T18:59:44.857405] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T18:59:45.181431] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T18:59:45.443294] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-19T18:59:46.243298] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-19T18:59:46.817812] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T18:59:47.043311] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-19T18:59:47.426636] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T18:59:47.843276] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-19T18:59:48.643383] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-19T18:59:48.951134] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-19T18:59:49.107917] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T18:59:49.340321] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:59:49.443222] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-19T18:59:50.243272] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-19T18:59:51.043301] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-19T18:59:51.366913] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T18:59:51.379148] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T18:59:51.843291] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-19T18:59:52.643278] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-19T18:59:52.791632] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T18:59:53.285748] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T18:59:53.329560] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T18:59:53.336283] [INFO ] [REMOTE ] GD: Full fetch complete (70556 records). [2025-09-19T18:59:53.336427] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-19T18:59:53.448425] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-19T18:59:53.745526] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-19T18:59:53.745760] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-19T18:59:53.746810] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-19T18:59:53.746882] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-19T18:59:53.752289] [DEBUG] [LOCAL ] GD: Trimmed 70556 records to 48133 (keeping 200 days of data) [2025-09-19T18:59:54.069998] [DEBUG] [LOCAL ] GD: Primary data saved (48133 records). [2025-09-19T18:59:54.070142] [INFO ] [MAIN ] GD: Full history saved. [2025-09-19T18:59:54.070254] [INFO ] [MAIN ] Update Progress: 904/2372 symbols completed. GD took 34.4s. Estimated remaining: 3h 14m 36s. Rate: 7.5 symbols/min [2025-09-19T18:59:54.249933] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:54.248078] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-19T18:59:54.262513] [DEBUG] [LOCAL ] GDO: Loaded 6087 existing records from primary storage. [2025-09-19T18:59:54.262635] [INFO ] [MAIN ] GDO: Loaded 6087 existing records. [2025-09-19T18:59:54.378235] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T18:59:54.452601] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:54.452890] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-19T18:59:54.452941] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-19T18:59:54.453578] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-19T18:59:54.453693] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-19T18:59:54.754307] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T18:59:54.823525] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:55.043266] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-19T18:59:55.762899] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T18:59:55.843235] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-19T18:59:56.643275] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-19T18:59:57.319082] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T18:59:57.443279] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-19T18:59:57.774955] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T18:59:57.929455] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T18:59:57.930612] [INFO ] [REMOTE ] GDL: Full fetch complete (3566 records). [2025-09-19T18:59:57.930708] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-19T18:59:58.139519] [WARN ] [VALIDATOR ] GDL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T18:59:58.139867] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:59:58.139969] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:59:58.140065] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-19T18:59:58.140194] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-19T18:59:58.140278] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-19T18:59:58.140370] [DEBUG] [LOCAL ] GDL: No derivative data file found to delete. [2025-09-19T18:59:58.140503] [INFO ] [MAIN ] Update Progress: 905/2372 symbols completed. GDL took 20.4s. Estimated remaining: 3h 14m 21s. Rate: 7.5 symbols/min [2025-09-19T18:59:58.245525] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-19T18:59:58.316436] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:58.370524] [DEBUG] [LOCAL ] GDOT: Loaded 38970 existing records from primary storage. [2025-09-19T18:59:58.370718] [INFO ] [MAIN ] GDOT: Loaded 38970 existing records. [2025-09-19T18:59:58.554061] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:58.554311] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-19T18:59:58.554393] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-19T18:59:58.555566] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-19T18:59:58.555630] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-19T18:59:58.921790] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:59.043258] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-19T18:59:59.843225] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-19T19:00:00.272846] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T19:00:00.512247] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T19:00:00.643260] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-19T19:00:00.825001] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T19:00:01.443271] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-19T19:00:02.243269] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-19T19:00:03.013843] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:00:03.039481] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-19T19:00:03.046851] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-19T19:00:03.048325] [INFO ] [REMOTE ] GDDY: Full fetch complete (71251 records). [2025-09-19T19:00:03.048439] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-19T19:00:03.472300] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-19T19:00:03.472394] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-19T19:00:03.473370] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-19T19:00:03.473447] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-19T19:00:03.474961] [DEBUG] [LOCAL ] GDDY: Trimmed 71251 records to 50573 (keeping 200 days of data) [2025-09-19T19:00:03.784878] [DEBUG] [LOCAL ] GDDY: Primary data saved (50573 records). [2025-09-19T19:00:03.785048] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-19T19:00:03.785164] [INFO ] [MAIN ] Update Progress: 906/2372 symbols completed. GDDY took 40.3s. Estimated remaining: 3h 14m 10s. Rate: 7.6 symbols/min [2025-09-19T19:00:03.851907] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-19T19:00:03.964080] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:03.984270] [DEBUG] [LOCAL ] GDV: Loaded 20129 existing records from primary storage. [2025-09-19T19:00:03.984411] [INFO ] [MAIN ] GDV: Loaded 20129 existing records. [2025-09-19T19:00:04.167896] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:04.168183] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-19T19:00:04.168234] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-19T19:00:04.169039] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-19T19:00:04.169101] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-19T19:00:04.538556] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:04.643330] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-19T19:00:04.919878] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-19T19:00:05.325508] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-19T19:00:05.443357] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-19T19:00:06.147327] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:00:06.243310] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-19T19:00:06.474708] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-19T19:00:07.036512] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T19:00:07.043205] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-19T19:00:07.843268] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-19T19:00:07.866824] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:00:08.436844] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T19:00:08.643235] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-19T19:00:08.789340] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T19:00:09.443256] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-19T19:00:09.851776] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T19:00:10.086444] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T19:00:10.243261] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-19T19:00:11.043223] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-19T19:00:11.555945] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T19:00:11.587887] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T19:00:11.843250] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-19T19:00:12.567526] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T19:00:12.643333] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-19T19:00:13.314118] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T19:00:13.443316] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-19T19:00:14.243272] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-19T19:00:15.043299] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-19T19:00:15.178249] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T19:00:15.843278] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-19T19:00:16.071675] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:00:16.642903] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T19:00:16.644519] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-19T19:00:17.196392] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-19T19:00:17.197963] [INFO ] [REMOTE ] GDIV: Full fetch complete (5430 records). [2025-09-19T19:00:17.198061] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-19T19:00:17.443343] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-19T19:00:17.581985] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-19T19:00:17.582075] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-19T19:00:17.582248] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-19T19:00:17.582288] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-19T19:00:17.582750] [DEBUG] [LOCAL ] GDIV: Trimmed 5430 records to 3814 (keeping 200 days of data) [2025-09-19T19:00:17.607447] [DEBUG] [LOCAL ] GDIV: Primary data saved (3814 records). [2025-09-19T19:00:17.607611] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-19T19:00:17.607737] [INFO ] [MAIN ] Update Progress: 907/2372 symbols completed. GDIV took 41.8s. Estimated remaining: 3h 14m 11s. Rate: 7.5 symbols/min [2025-09-19T19:00:17.789734] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:17.850108] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-09-19T19:00:17.850255] [INFO ] [MAIN ] GE: Loaded 54103 existing records. [2025-09-19T19:00:18.052152] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:18.052626] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-19T19:00:18.052814] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-19T19:00:18.061135] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-19T19:00:18.075502] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-19T19:00:18.139784] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T19:00:18.245752] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-19T19:00:18.477270] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:18.674957] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T19:00:19.019373] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T19:00:19.043214] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-19T19:00:19.843280] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-19T19:00:19.925351] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:00:19.927031] [INFO ] [REMOTE ] GDO: Full fetch complete (9537 records). [2025-09-19T19:00:19.927104] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-19T19:00:20.308384] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-19T19:00:20.308491] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-19T19:00:20.308770] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-19T19:00:20.308833] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-19T19:00:20.309318] [DEBUG] [LOCAL ] GDO: Trimmed 9537 records to 6116 (keeping 200 days of data) [2025-09-19T19:00:20.346668] [DEBUG] [LOCAL ] GDO: Primary data saved (6116 records). [2025-09-19T19:00:20.346795] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-19T19:00:20.346882] [INFO ] [MAIN ] Update Progress: 908/2372 symbols completed. GDO took 26.3s. Estimated remaining: 3h 13m 55s. Rate: 7.5 symbols/min [2025-09-19T19:00:20.522865] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:20.544217] [DEBUG] [LOCAL ] GEF: Loaded 20905 existing records from primary storage. [2025-09-19T19:00:20.544351] [INFO ] [MAIN ] GEF: Loaded 20905 existing records. [2025-09-19T19:00:20.645726] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-19T19:00:20.725197] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:20.725460] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-19T19:00:20.725508] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-19T19:00:20.726153] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-19T19:00:20.726214] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-19T19:00:21.046944] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T19:00:21.116910] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:21.443278] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-19T19:00:21.943276] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T19:00:22.190938] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:00:22.243307] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-19T19:00:23.043284] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-19T19:00:23.657837] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T19:00:23.843279] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-19T19:00:23.937073] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T19:00:24.643242] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-19T19:00:24.834968] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T19:00:25.443278] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-19T19:00:26.224585] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T19:00:26.227412] [INFO ] [REMOTE ] GDV: Full fetch complete (28833 records). [2025-09-19T19:00:26.227495] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-19T19:00:26.249160] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-19T19:00:26.612806] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-19T19:00:26.612938] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-19T19:00:26.613525] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-19T19:00:26.613568] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-19T19:00:26.614300] [DEBUG] [LOCAL ] GDV: Trimmed 28833 records to 20234 (keeping 200 days of data) [2025-09-19T19:00:26.736689] [DEBUG] [LOCAL ] GDV: Primary data saved (20234 records). [2025-09-19T19:00:26.736892] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-19T19:00:26.737019] [INFO ] [MAIN ] Update Progress: 909/2372 symbols completed. GDV took 23.0s. Estimated remaining: 3h 13m 44s. Rate: 7.6 symbols/min [2025-09-19T19:00:26.903917] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:26.939347] [DEBUG] [LOCAL ] GEL: Loaded 34789 existing records from primary storage. [2025-09-19T19:00:26.939516] [INFO ] [MAIN ] GEL: Loaded 34789 existing records. [2025-09-19T19:00:27.043403] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-19T19:00:27.123028] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:27.123374] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-19T19:00:27.123457] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-19T19:00:27.124452] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-19T19:00:27.124560] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-19T19:00:27.266601] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-19T19:00:27.556856] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:27.748633] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T19:00:27.843261] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-19T19:00:28.310955] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T19:00:28.643244] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-19T19:00:29.159857] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T19:00:29.443279] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-19T19:00:30.243248] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-19T19:00:30.701105] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T19:00:30.911079] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T19:00:31.043234] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-19T19:00:31.236855] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T19:00:31.843302] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-19T19:00:32.282436] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T19:00:32.643317] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-19T19:00:33.040141] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T19:00:33.443301] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-19T19:00:34.243246] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-19T19:00:34.513856] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T19:00:35.006142] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T19:00:35.043231] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-19T19:00:35.848324] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-19T19:00:35.859737] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:00:36.643273] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-19T19:00:36.785448] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:00:36.791468] [INFO ] [REMOTE ] GDOT: Full fetch complete (52329 records). [2025-09-19T19:00:36.791582] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-19T19:00:37.184475] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-19T19:00:37.184570] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-19T19:00:37.185363] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-19T19:00:37.185428] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-19T19:00:37.187476] [DEBUG] [LOCAL ] GDOT: Trimmed 52329 records to 39273 (keeping 200 days of data) [2025-09-19T19:00:37.434731] [DEBUG] [LOCAL ] GDOT: Primary data saved (39273 records). [2025-09-19T19:00:37.435002] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-19T19:00:37.435934] [INFO ] [MAIN ] Update Progress: 910/2372 symbols completed. GDOT took 39.3s. Estimated remaining: 3h 13m 41s. Rate: 7.5 symbols/min [2025-09-19T19:00:37.449200] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-19T19:00:37.464941] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:00:37.634901] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:37.694483] [DEBUG] [LOCAL ] GENI: Loaded 53304 existing records from primary storage. [2025-09-19T19:00:37.694687] [INFO ] [MAIN ] GENI: Loaded 53304 existing records. [2025-09-19T19:00:37.872988] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:37.873287] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-19T19:00:37.873337] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-19T19:00:37.874532] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-19T19:00:37.874604] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-19T19:00:38.251083] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-19T19:00:38.282254] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:38.548293] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T19:00:39.015585] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T19:00:39.043223] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-19T19:00:39.843239] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-19T19:00:39.888179] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T19:00:40.207985] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T19:00:40.643281] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-19T19:00:41.217903] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T19:00:41.443288] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-19T19:00:41.811125] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T19:00:42.243314] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-19T19:00:43.043471] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-19T19:00:43.501129] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T19:00:43.529282] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T19:00:43.843280] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-19T19:00:44.137182] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T19:00:44.643275] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-19T19:00:45.443273] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-19T19:00:46.248890] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-19T19:00:46.263275] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-19T19:00:46.298473] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T19:00:47.005485] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T19:00:47.043259] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-19T19:00:47.535540] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T19:00:47.843286] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-19T19:00:48.423246] [DEBUG] [REMOTE ] GE: Error fetching primary data for 2025-07: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-19T19:00:48.423421] [WARN ] [REMOTE ] GE: No data returned for month 2025-07 [2025-09-19T19:00:48.643296] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-19T19:00:48.723763] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T19:00:49.443322] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-19T19:00:50.243290] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-19T19:00:50.634753] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:00:50.698132] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T19:00:50.702199] [INFO ] [REMOTE ] GEF: Full fetch complete (29406 records). [2025-09-19T19:00:50.702304] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-19T19:00:51.046133] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-19T19:00:51.086103] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-19T19:00:51.086193] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-19T19:00:51.086903] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-19T19:00:51.086968] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-19T19:00:51.088208] [DEBUG] [LOCAL ] GEF: Trimmed 29406 records to 21067 (keeping 200 days of data) [2025-09-19T19:00:51.219140] [DEBUG] [LOCAL ] GEF: Primary data saved (21067 records). [2025-09-19T19:00:51.219270] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-19T19:00:51.219370] [INFO ] [MAIN ] Update Progress: 911/2372 symbols completed. GEF took 30.9s. Estimated remaining: 3h 13m 42s. Rate: 7.5 symbols/min [2025-09-19T19:00:51.389328] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:51.446952] [DEBUG] [LOCAL ] GEO: Loaded 52604 existing records from primary storage. [2025-09-19T19:00:51.447097] [INFO ] [MAIN ] GEO: Loaded 52604 existing records. [2025-09-19T19:00:51.627317] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:51.627933] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-19T19:00:51.628041] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-19T19:00:51.634377] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-19T19:00:51.634468] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-19T19:00:51.711424] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T19:00:51.755101] [INFO ] [REMOTE ] GEL: Full fetch complete (48661 records). [2025-09-19T19:00:51.755770] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-19T19:00:51.850017] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-19T19:00:52.243579] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:52.435130] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-19T19:00:52.435222] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-19T19:00:52.435993] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-19T19:00:52.436057] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-19T19:00:52.437166] [DEBUG] [LOCAL ] GEL: Trimmed 48661 records to 34950 (keeping 200 days of data) [2025-09-19T19:00:52.648690] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-19T19:00:52.662248] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:00:52.688629] [DEBUG] [LOCAL ] GEL: Primary data saved (34950 records). [2025-09-19T19:00:52.688823] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-19T19:00:52.688951] [INFO ] [MAIN ] Update Progress: 912/2372 symbols completed. GEL took 26.0s. Estimated remaining: 3h 13m 24s. Rate: 7.5 symbols/min [2025-09-19T19:00:52.860142] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:52.900936] [DEBUG] [LOCAL ] GES: Loaded 40812 existing records from primary storage. [2025-09-19T19:00:52.901110] [INFO ] [MAIN ] GES: Loaded 40812 existing records. [2025-09-19T19:00:53.079999] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:53.080282] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-19T19:00:53.080338] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-19T19:00:53.081322] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-19T19:00:53.081389] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-19T19:00:53.448367] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-19T19:00:53.454317] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:54.258607] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-19T19:00:54.261578] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T19:00:54.658900] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:00:55.043305] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-19T19:00:55.474321] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T19:00:55.843282] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-19T19:00:56.475802] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T19:00:56.643275] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-19T19:00:56.709588] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:00:57.443288] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-19T19:00:57.877930] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T19:00:58.243277] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-19T19:00:58.601139] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T19:00:59.043336] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-19T19:00:59.783338] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T19:00:59.791861] [INFO ] [REMOTE ] GE: Full fetch complete (69277 records). [2025-09-19T19:00:59.792039] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-19T19:00:59.867186] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-19T19:01:00.003323] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:01:00.036142] [WARN ] [VALIDATOR ] GE: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T19:01:00.037750] [FATAL] [MAIN ] GE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:01:00.038211] [WARN ] [MAIN ] GE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:01:00.038309] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-19T19:01:00.038415] [DEBUG] [LOCAL ] GE: No primary data file found to delete. [2025-09-19T19:01:00.038473] [INFO ] [LOCAL ] GE: Starting deletion of derivative data. [2025-09-19T19:01:00.038992] [DEBUG] [LOCAL ] GE: Deleted derivative data file. [2025-09-19T19:01:00.039106] [INFO ] [MAIN ] Update Progress: 913/2372 symbols completed. GE took 42.4s. Estimated remaining: 3h 13m 15s. Rate: 7.5 symbols/min [2025-09-19T19:01:00.224827] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:00.262369] [DEBUG] [LOCAL ] GETY: Loaded 36644 existing records from primary storage. [2025-09-19T19:01:00.262536] [INFO ] [MAIN ] GETY: Loaded 36644 existing records. [2025-09-19T19:01:00.439812] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:00.440115] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-19T19:01:00.440170] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-19T19:01:00.441042] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-19T19:01:00.441111] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-19T19:01:00.648817] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-19T19:01:00.809035] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:00.837567] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:01:01.443277] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-19T19:01:02.243342] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-19T19:01:02.368984] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-19T19:01:03.038969] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T19:01:03.047504] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-19T19:01:03.335630] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T19:01:03.602436] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T19:01:03.843276] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-19T19:01:04.643265] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-19T19:01:04.958804] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T19:01:05.437012] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:01:05.446361] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-19T19:01:06.121010] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T19:01:06.243259] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-19T19:01:07.043246] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-19T19:01:07.117298] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T19:01:07.843288] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-19T19:01:08.057911] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:01:08.643263] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-19T19:01:09.160493] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:01:09.443237] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-19T19:01:09.515975] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T19:01:10.060375] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T19:01:10.243258] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-19T19:01:10.947274] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T19:01:11.043334] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-19T19:01:11.843286] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-19T19:01:12.147181] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:01:12.625361] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T19:01:12.643218] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-19T19:01:13.443322] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-19T19:01:13.507854] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:01:14.243299] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-19T19:01:14.577726] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T19:01:14.625987] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:01:15.043293] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-19T19:01:15.784966] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:01:15.792900] [INFO ] [REMOTE ] GENI: Full fetch complete (75425 records). [2025-09-19T19:01:15.793043] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-19T19:01:15.852097] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-19T19:01:16.210745] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-19T19:01:16.210855] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-19T19:01:16.211897] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-19T19:01:16.211970] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-19T19:01:16.213581] [DEBUG] [LOCAL ] GENI: Trimmed 75425 records to 53692 (keeping 200 days of data) [2025-09-19T19:01:16.578344] [DEBUG] [LOCAL ] GENI: Primary data saved (53692 records). [2025-09-19T19:01:16.578559] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-19T19:01:16.578725] [INFO ] [MAIN ] Update Progress: 914/2372 symbols completed. GENI took 39.1s. Estimated remaining: 3h 13m 21s. Rate: 7.5 symbols/min [2025-09-19T19:01:16.654562] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-19T19:01:16.842985] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:16.929770] [DEBUG] [LOCAL ] GEV: Loaded 53548 existing records from primary storage. [2025-09-19T19:01:16.930029] [INFO ] [MAIN ] GEV: Loaded 53548 existing records. [2025-09-19T19:01:17.239296] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:17.253238] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-19T19:01:17.278848] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-19T19:01:17.282603] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-19T19:01:17.282477] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T19:01:17.286845] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-19T19:01:17.448417] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-19T19:01:17.800508] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:17.824391] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T19:01:18.243302] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-19T19:01:18.341031] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:01:19.043288] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-19T19:01:19.564591] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T19:01:19.576087] [INFO ] [REMOTE ] GEO: Full fetch complete (75636 records). [2025-09-19T19:01:19.576468] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-19T19:01:19.854537] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-19T19:01:20.046427] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-19T19:01:20.046662] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-19T19:01:20.048067] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-19T19:01:20.048166] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-19T19:01:20.074818] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:01:20.083752] [DEBUG] [LOCAL ] GEO: Trimmed 75636 records to 52962 (keeping 200 days of data) [2025-09-19T19:01:20.335829] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T19:01:20.446891] [DEBUG] [LOCAL ] GEO: Primary data saved (52962 records). [2025-09-19T19:01:20.447043] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-19T19:01:20.447161] [INFO ] [MAIN ] Update Progress: 915/2372 symbols completed. GEO took 29.2s. Estimated remaining: 3h 13m 6s. Rate: 7.5 symbols/min [2025-09-19T19:01:20.625111] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:20.630827] [DEBUG] [LOCAL ] GF: Loaded 3516 existing records from primary storage. [2025-09-19T19:01:20.630919] [INFO ] [MAIN ] GF: Loaded 3516 existing records. [2025-09-19T19:01:20.652387] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-19T19:01:20.823513] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:20.823799] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-19T19:01:20.823864] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-19T19:01:20.824140] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-19T19:01:20.824201] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-19T19:01:21.202997] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:21.443297] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-19T19:01:21.892966] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T19:01:21.941547] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T19:01:22.243298] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-19T19:01:22.492220] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:01:22.499579] [INFO ] [REMOTE ] GES: Full fetch complete (60260 records). [2025-09-19T19:01:22.499762] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-19T19:01:22.789009] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T19:01:22.917140] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-19T19:01:22.917239] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-19T19:01:22.918234] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-19T19:01:22.918302] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-19T19:01:22.919683] [DEBUG] [LOCAL ] GES: Trimmed 60260 records to 41008 (keeping 200 days of data) [2025-09-19T19:01:23.043499] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-19T19:01:23.189496] [DEBUG] [LOCAL ] GES: Primary data saved (41008 records). [2025-09-19T19:01:23.189662] [INFO ] [MAIN ] GES: Full history saved. [2025-09-19T19:01:23.189792] [INFO ] [MAIN ] Update Progress: 916/2372 symbols completed. GES took 30.5s. Estimated remaining: 3h 12m 50s. Rate: 7.6 symbols/min [2025-09-19T19:01:23.366925] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:23.402791] [DEBUG] [LOCAL ] GFF: Loaded 31421 existing records from primary storage. [2025-09-19T19:01:23.402970] [INFO ] [MAIN ] GFF: Loaded 31421 existing records. [2025-09-19T19:01:23.584371] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:23.584695] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-19T19:01:23.584758] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-19T19:01:23.585544] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-19T19:01:23.585602] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-19T19:01:23.850568] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-19T19:01:23.965537] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:24.546610] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T19:01:24.643300] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-19T19:01:25.202333] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T19:01:25.257555] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T19:01:25.443259] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-19T19:01:26.243298] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-19T19:01:27.043231] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-19T19:01:27.278990] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T19:01:27.704619] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T19:01:27.747142] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-19T19:01:27.843347] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-19T19:01:28.643296] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-19T19:01:29.329729] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T19:01:29.443269] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-19T19:01:30.243325] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-19T19:01:30.272731] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:01:31.018741] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T19:01:31.043239] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-19T19:01:31.843270] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-19T19:01:32.152718] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T19:01:32.297937] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T19:01:32.643318] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-19T19:01:32.836475] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T19:01:33.443341] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-19T19:01:34.243279] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-19T19:01:34.544233] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T19:01:34.910100] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T19:01:34.917883] [INFO ] [REMOTE ] GETY: Full fetch complete (55835 records). [2025-09-19T19:01:34.918005] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-19T19:01:35.035617] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T19:01:35.048079] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-19T19:01:35.352364] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-19T19:01:35.352485] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-19T19:01:35.353491] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-19T19:01:35.353579] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-19T19:01:35.355164] [DEBUG] [LOCAL ] GETY: Trimmed 55835 records to 36842 (keeping 200 days of data) [2025-09-19T19:01:35.583864] [DEBUG] [LOCAL ] GETY: Primary data saved (36842 records). [2025-09-19T19:01:35.584013] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-19T19:01:35.584153] [INFO ] [MAIN ] Update Progress: 917/2372 symbols completed. GETY took 35.5s. Estimated remaining: 3h 12m 49s. Rate: 7.5 symbols/min [2025-09-19T19:01:35.843274] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-19T19:01:36.516561] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T19:01:36.643327] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-19T19:01:36.735869] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:01:37.443291] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-19T19:01:38.004270] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T19:01:38.244184] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-19T19:01:38.248375] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T19:01:38.858307] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T19:01:39.043317] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-19T19:01:39.843282] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-19T19:01:40.269738] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-19T19:01:40.271142] [INFO ] [REMOTE ] GF: Full fetch complete (5403 records). [2025-09-19T19:01:40.271218] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-19T19:01:40.652070] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-19T19:01:40.658727] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-19T19:01:40.652178] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-19T19:01:40.662240] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-19T19:01:40.663109] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-19T19:01:40.666608] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T19:01:40.666901] [DEBUG] [LOCAL ] GF: Trimmed 5403 records to 3524 (keeping 200 days of data) [2025-09-19T19:01:40.710401] [DEBUG] [LOCAL ] GF: Primary data saved (3524 records). [2025-09-19T19:01:40.710617] [INFO ] [MAIN ] GF: Full history saved. [2025-09-19T19:01:40.710800] [INFO ] [MAIN ] Update Progress: 918/2372 symbols completed. GF took 20.3s. Estimated remaining: 3h 12m 37s. Rate: 7.5 symbols/min [2025-09-19T19:01:41.443308] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-19T19:01:42.843731] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T19:01:42.850176] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-19T19:01:42.978528] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T19:01:43.043247] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-19T19:01:43.968453] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T19:01:43.977498] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-19T19:01:45.157613] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T19:01:45.171307] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-19T19:01:45.562685] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:01:45.568385] [INFO ] [REMOTE ] GFF: Full fetch complete (44343 records). [2025-09-19T19:01:45.568557] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-19T19:01:45.955564] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-19T19:01:45.955675] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-19T19:01:45.956411] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-19T19:01:45.956504] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-19T19:01:45.957791] [DEBUG] [LOCAL ] GFF: Trimmed 44343 records to 31628 (keeping 200 days of data) [2025-09-19T19:01:46.162382] [DEBUG] [LOCAL ] GFF: Primary data saved (31628 records). [2025-09-19T19:01:46.162524] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-19T19:01:46.162681] [INFO ] [MAIN ] Update Progress: 919/2372 symbols completed. GFF took 23.0s. Estimated remaining: 3h 12m 25s. Rate: 7.6 symbols/min [2025-09-19T19:01:47.554178] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T19:01:47.566169] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-19T19:01:50.184997] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-19T19:01:50.196292] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-19T19:01:52.365066] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T19:01:52.372985] [INFO ] [REMOTE ] GEV: Full fetch complete (76994 records). [2025-09-19T19:01:52.373187] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-19T19:01:52.777368] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-19T19:01:52.777465] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-19T19:01:52.778466] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-19T19:01:52.778533] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-19T19:01:52.781542] [DEBUG] [LOCAL ] GEV: Trimmed 76994 records to 53932 (keeping 200 days of data) [2025-09-19T19:01:53.134502] [DEBUG] [LOCAL ] GEV: Primary data saved (53932 records). [2025-09-19T19:01:53.134667] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-19T19:01:53.135611] [INFO ] [MAIN ] Update Progress: 920/2372 symbols completed. GEV took 36.6s. Estimated remaining: 3h 12m 15s. Rate: 7.6 symbols/min [2025-09-19T19:01:53.773719] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:53.890138] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:53.945311] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:53.994905] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:54.019627] [DEBUG] [LOCAL ] GFR: Loaded 8593 existing records from primary storage. [2025-09-19T19:01:54.019820] [INFO ] [MAIN ] GFR: Loaded 8593 existing records. [2025-09-19T19:01:54.302694] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:54.304143] [DEBUG] [LOCAL ] GFI: Loaded 53483 existing records from primary storage. [2025-09-19T19:01:54.305368] [DEBUG] [LOCAL ] GFL: Loaded 48534 existing records from primary storage. [2025-09-19T19:01:54.306067] [INFO ] [MAIN ] GFI: Loaded 53483 existing records. [2025-09-19T19:01:54.305998] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-19T19:01:54.305926] [INFO ] [MAIN ] GFL: Loaded 48534 existing records. [2025-09-19T19:01:54.311412] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-19T19:01:54.442318] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-19T19:01:54.481873] [DEBUG] [LOCAL ] GGB: Loaded 51382 existing records from primary storage. [2025-09-19T19:01:54.481081] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-19T19:01:54.523702] [INFO ] [MAIN ] GGB: Loaded 51382 existing records. [2025-09-19T19:01:54.799877] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:54.951164] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-19T19:01:54.963335] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-19T19:01:54.963222] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:55.017107] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-19T19:01:55.094905] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-19T19:01:55.081451] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-19T19:01:55.136281] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:55.133105] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-19T19:01:55.150620] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-19T19:01:55.156179] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-19T19:01:55.184928] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-19T19:01:55.204113] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-19T19:01:55.305978] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-19T19:01:55.329965] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-19T19:01:55.825131] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:55.907448] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-19T19:01:56.312346] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:56.368438] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:56.376633] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-19T19:01:56.380511] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-19T19:01:56.464032] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:56.464301] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-19T19:01:57.143919] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:01:57.147324] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-19T19:01:57.573947] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T19:01:57.582872] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-19T19:01:58.022408] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T19:01:58.033937] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-19T19:01:58.058375] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T19:01:58.061041] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-19T19:01:58.589722] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T19:01:58.599971] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-19T19:01:58.740208] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-19T19:01:58.742585] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-19T19:01:59.046994] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T19:01:59.058206] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-19T19:01:59.310108] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T19:01:59.313527] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-19T19:01:59.945224] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:01:59.955922] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-19T19:02:00.077993] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T19:02:00.081522] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-19T19:02:00.230137] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T19:02:00.239856] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-19T19:02:00.721455] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T19:02:00.731892] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-19T19:02:01.278880] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T19:02:01.281832] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-19T19:02:02.109043] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T19:02:02.120312] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-19T19:02:02.743149] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-19T19:02:02.754003] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-19T19:02:03.055864] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:02:03.058024] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-19T19:02:03.722053] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (2.99 seconds). [2025-09-19T19:02:03.738821] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-19T19:02:03.801207] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T19:02:03.831726] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T19:02:03.843203] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-19T19:02:04.136618] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T19:02:04.643278] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-19T19:02:05.328082] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T19:02:05.443270] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-19T19:02:05.944795] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T19:02:06.243300] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-19T19:02:06.620034] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T19:02:07.043262] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-19T19:02:07.529509] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T19:02:07.843233] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-19T19:02:08.213850] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:02:08.643264] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-19T19:02:08.863991] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T19:02:09.101888] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T19:02:09.443295] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-19T19:02:10.243295] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-19T19:02:10.644542] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T19:02:10.789128] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T19:02:11.043374] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-19T19:02:11.843357] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-19T19:02:12.272430] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:02:12.319397] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T19:02:12.643301] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-19T19:02:13.172919] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T19:02:13.443310] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-19T19:02:13.568575] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T19:02:13.570088] [INFO ] [REMOTE ] GFR: Full fetch complete (13070 records). [2025-09-19T19:02:13.570160] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-19T19:02:13.925624] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-19T19:02:13.925730] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-19T19:02:13.925984] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-19T19:02:13.926022] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-19T19:02:13.926478] [DEBUG] [LOCAL ] GFR: Trimmed 13070 records to 8622 (keeping 200 days of data) [2025-09-19T19:02:13.975127] [DEBUG] [LOCAL ] GFR: Primary data saved (8622 records). [2025-09-19T19:02:13.975229] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-19T19:02:13.975320] [INFO ] [MAIN ] Update Progress: 921/2372 symbols completed. GFR took 20.8s. Estimated remaining: 3h 12m 28s. Rate: 7.5 symbols/min [2025-09-19T19:02:14.146700] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:14.192944] [DEBUG] [LOCAL ] GGG: Loaded 41430 existing records from primary storage. [2025-09-19T19:02:14.193104] [INFO ] [MAIN ] GGG: Loaded 41430 existing records. [2025-09-19T19:02:14.255422] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-19T19:02:14.372863] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:14.373089] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-19T19:02:14.373137] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-19T19:02:14.374151] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-19T19:02:14.374212] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-19T19:02:14.724660] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:15.053192] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-19T19:02:15.059895] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T19:02:15.843298] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-19T19:02:16.569165] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T19:02:16.643293] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-19T19:02:16.884874] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:02:17.003349] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T19:02:17.443298] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-19T19:02:18.243272] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-19T19:02:18.449857] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:02:19.043231] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-19T19:02:19.165835] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T19:02:19.843274] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-19T19:02:20.086603] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:02:20.094794] [INFO ] [REMOTE ] GFL: Full fetch complete (68663 records). [2025-09-19T19:02:20.094977] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-19T19:02:20.512853] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-19T19:02:20.512970] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-19T19:02:20.513962] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-19T19:02:20.514041] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-19T19:02:20.515709] [DEBUG] [LOCAL ] GFL: Trimmed 68663 records to 48895 (keeping 200 days of data) [2025-09-19T19:02:20.644159] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-19T19:02:20.839693] [DEBUG] [LOCAL ] GFL: Primary data saved (48895 records). [2025-09-19T19:02:20.839882] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-19T19:02:20.839999] [INFO ] [MAIN ] Update Progress: 922/2372 symbols completed. GFL took 27.7s. Estimated remaining: 3h 12m 18s. Rate: 7.5 symbols/min [2025-09-19T19:02:21.023003] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:21.038385] [DEBUG] [LOCAL ] GGT: Loaded 14214 existing records from primary storage. [2025-09-19T19:02:21.038515] [INFO ] [MAIN ] GGT: Loaded 14214 existing records. [2025-09-19T19:02:21.227743] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:21.228163] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-19T19:02:21.228404] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-19T19:02:21.228880] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-19T19:02:21.228954] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-19T19:02:21.385093] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T19:02:21.444697] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-19T19:02:21.648573] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:22.243322] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-19T19:02:23.304995] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T19:02:23.308607] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-19T19:02:23.479748] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (4.44 seconds). [2025-09-19T19:02:23.487640] [INFO ] [REMOTE ] GFI: Full fetch complete (76233 records). [2025-09-19T19:02:23.487844] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-19T19:02:23.878889] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-19T19:02:23.878992] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-19T19:02:23.879979] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-19T19:02:23.880048] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-19T19:02:23.881636] [DEBUG] [LOCAL ] GFI: Trimmed 76233 records to 53872 (keeping 200 days of data) [2025-09-19T19:02:23.978246] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:02:23.985165] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-19T19:02:24.235595] [DEBUG] [LOCAL ] GFI: Primary data saved (53872 records). [2025-09-19T19:02:24.235794] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-19T19:02:24.235912] [INFO ] [MAIN ] Update Progress: 923/2372 symbols completed. GFI took 31.1s. Estimated remaining: 3h 12m 3s. Rate: 7.5 symbols/min [2025-09-19T19:02:24.408508] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:24.413060] [DEBUG] [LOCAL ] GGZ: Loaded 2499 existing records from primary storage. [2025-09-19T19:02:24.413152] [INFO ] [MAIN ] GGZ: Loaded 2499 existing records. [2025-09-19T19:02:24.591728] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:24.592039] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-19T19:02:24.592114] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-19T19:02:24.592405] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-19T19:02:24.592466] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-19T19:02:24.985328] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:24.979971] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T19:02:24.987751] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-19T19:02:25.356751] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (4.71 seconds). [2025-09-19T19:02:25.364945] [INFO ] [REMOTE ] GGB: Full fetch complete (73956 records). [2025-09-19T19:02:25.365103] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-19T19:02:25.456429] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-19T19:02:25.687441] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T19:02:25.768312] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-19T19:02:25.768398] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-19T19:02:25.769356] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-19T19:02:25.769421] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-19T19:02:25.770853] [DEBUG] [LOCAL ] GGB: Trimmed 73956 records to 51759 (keeping 200 days of data) [2025-09-19T19:02:26.063789] [DEBUG] [LOCAL ] GGB: Primary data saved (51759 records). [2025-09-19T19:02:26.063939] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-19T19:02:26.064466] [INFO ] [MAIN ] Update Progress: 924/2372 symbols completed. GGB took 32.9s. Estimated remaining: 3h 11m 45s. Rate: 7.6 symbols/min [2025-09-19T19:02:26.235925] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:26.241414] [DEBUG] [LOCAL ] GHC: Loaded 2622 existing records from primary storage. [2025-09-19T19:02:26.241509] [INFO ] [MAIN ] GHC: Loaded 2622 existing records. [2025-09-19T19:02:26.272779] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-19T19:02:26.424625] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:26.425160] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-19T19:02:26.425319] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-19T19:02:26.425583] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-19T19:02:26.425668] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-19T19:02:26.593428] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T19:02:26.802069] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:27.043260] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-19T19:02:27.374449] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (5.93 seconds). [2025-09-19T19:02:27.541735] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T19:02:27.567807] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-19T19:02:27.843259] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-19T19:02:28.643234] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-19T19:02:29.055921] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T19:02:29.443262] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-19T19:02:29.983870] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T19:02:30.243296] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-19T19:02:30.486764] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:02:31.043284] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-19T19:02:31.419918] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T19:02:31.714266] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:02:31.843278] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-19T19:02:32.643318] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-19T19:02:32.980109] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:02:33.191565] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T19:02:33.443276] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-19T19:02:33.913331] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-19T19:02:34.243272] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-19T19:02:35.043313] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-19T19:02:35.631999] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T19:02:35.716089] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-19T19:02:35.843261] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-19T19:02:36.643283] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-19T19:02:36.719140] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-19T19:02:37.179349] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T19:02:37.443361] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-19T19:02:38.243273] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-19T19:02:38.764489] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-19T19:02:39.043291] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-19T19:02:39.193274] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T19:02:39.569361] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T19:02:39.843272] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-19T19:02:40.499160] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T19:02:40.643316] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-19T19:02:41.219170] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T19:02:41.443308] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-19T19:02:41.997755] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T19:02:42.243268] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-19T19:02:43.043303] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-19T19:02:43.794045] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T19:02:43.843222] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-19T19:02:44.158060] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T19:02:44.643263] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-19T19:02:45.238319] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T19:02:45.262225] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T19:02:45.263265] [INFO ] [REMOTE ] GGZ: Full fetch complete (4152 records). [2025-09-19T19:02:45.263361] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-19T19:02:45.451387] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-19T19:02:45.687835] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-19T19:02:45.688005] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-19T19:02:45.688184] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-19T19:02:45.688227] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-19T19:02:45.688708] [DEBUG] [LOCAL ] GGZ: Trimmed 4152 records to 2533 (keeping 200 days of data) [2025-09-19T19:02:45.705510] [DEBUG] [LOCAL ] GGZ: Primary data saved (2533 records). [2025-09-19T19:02:45.705622] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-19T19:02:45.705739] [INFO ] [MAIN ] Update Progress: 925/2372 symbols completed. GGZ took 21.5s. Estimated remaining: 3h 11m 56s. Rate: 7.5 symbols/min [2025-09-19T19:02:45.884917] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:45.892031] [DEBUG] [LOCAL ] GHG: Loaded 3161 existing records from primary storage. [2025-09-19T19:02:45.892192] [INFO ] [MAIN ] GHG: Loaded 3161 existing records. [2025-09-19T19:02:46.089751] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:46.090011] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-19T19:02:46.090068] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-19T19:02:46.090279] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-19T19:02:46.090339] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-19T19:02:46.245137] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-19T19:02:46.354429] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T19:02:46.460562] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:47.043281] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-19T19:02:47.566484] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:02:47.573638] [INFO ] [REMOTE ] GGT: Full fetch complete (18638 records). [2025-09-19T19:02:47.573533] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T19:02:47.573875] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-19T19:02:47.848372] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-19T19:02:47.957586] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-19T19:02:47.957744] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-19T19:02:47.958218] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-19T19:02:47.958260] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-19T19:02:47.958952] [DEBUG] [LOCAL ] GGT: Trimmed 18638 records to 14290 (keeping 200 days of data) [2025-09-19T19:02:48.051096] [DEBUG] [LOCAL ] GGT: Primary data saved (14290 records). [2025-09-19T19:02:48.051251] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-19T19:02:48.051340] [INFO ] [MAIN ] Update Progress: 926/2372 symbols completed. GGT took 27.2s. Estimated remaining: 3h 11m 39s. Rate: 7.5 symbols/min [2025-09-19T19:02:48.223139] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:48.232201] [DEBUG] [LOCAL ] GHI: Loaded 7029 existing records from primary storage. [2025-09-19T19:02:48.232319] [INFO ] [MAIN ] GHI: Loaded 7029 existing records. [2025-09-19T19:02:48.412613] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:48.412937] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-19T19:02:48.413008] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-19T19:02:48.413383] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-19T19:02:48.413441] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-19T19:02:48.523142] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T19:02:48.648368] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-19T19:02:48.794219] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:49.443275] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-19T19:02:49.965227] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:02:50.243264] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-19T19:02:50.617793] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T19:02:50.697018] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T19:02:51.043271] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-19T19:02:51.843263] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-19T19:02:52.314306] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-19T19:02:52.587486] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:02:52.593301] [INFO ] [REMOTE ] GGG: Full fetch complete (59324 records). [2025-09-19T19:02:52.593479] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-19T19:02:52.648531] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-19T19:02:52.982253] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-19T19:02:52.982333] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-19T19:02:52.983104] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-19T19:02:52.983177] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-19T19:02:52.984629] [DEBUG] [LOCAL ] GGG: Trimmed 59324 records to 41753 (keeping 200 days of data) [2025-09-19T19:02:53.234984] [DEBUG] [LOCAL ] GGG: Primary data saved (41753 records). [2025-09-19T19:02:53.235108] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-19T19:02:53.235219] [INFO ] [MAIN ] Update Progress: 927/2372 symbols completed. GGG took 39.3s. Estimated remaining: 3h 11m 27s. Rate: 7.5 symbols/min [2025-09-19T19:02:53.407869] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:53.414080] [DEBUG] [LOCAL ] GHLD: Loaded 4056 existing records from primary storage. [2025-09-19T19:02:53.414179] [INFO ] [MAIN ] GHLD: Loaded 4056 existing records. [2025-09-19T19:02:53.448485] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-19T19:02:53.596008] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:53.596262] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-19T19:02:53.596311] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-19T19:02:53.596696] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-19T19:02:53.596756] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-19T19:02:53.762741] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T19:02:53.995528] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:54.032023] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T19:02:54.243275] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-19T19:02:54.776667] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T19:02:55.043301] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-19T19:02:55.662122] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-19T19:02:55.843274] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-19T19:02:56.181023] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-19T19:02:56.643260] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-19T19:02:57.019789] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T19:02:57.443264] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-19T19:02:57.915609] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-19T19:02:58.243268] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-19T19:02:58.649117] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T19:02:59.043266] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-19T19:02:59.620118] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T19:02:59.843274] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-19T19:03:00.565484] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T19:03:00.643255] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-19T19:03:01.443261] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-19T19:03:01.453035] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-19T19:03:02.243276] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-19T19:03:02.971358] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T19:03:03.043262] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-19T19:03:03.843318] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-19T19:03:04.643267] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-19T19:03:04.710472] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T19:03:04.713962] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T19:03:04.718205] [INFO ] [REMOTE ] GHC: Full fetch complete (3230 records). [2025-09-19T19:03:04.718294] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-19T19:03:05.092833] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-19T19:03:05.092916] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-19T19:03:05.093025] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-19T19:03:05.093063] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-19T19:03:05.093463] [DEBUG] [LOCAL ] GHC: Trimmed 3230 records to 2646 (keeping 200 days of data) [2025-09-19T19:03:05.110450] [DEBUG] [LOCAL ] GHC: Primary data saved (2646 records). [2025-09-19T19:03:05.110519] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-19T19:03:05.110601] [INFO ] [MAIN ] Update Progress: 928/2372 symbols completed. GHC took 39.0s. Estimated remaining: 3h 11m 25s. Rate: 7.5 symbols/min [2025-09-19T19:03:05.287916] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:05.284560] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-19T19:03:05.308718] [DEBUG] [LOCAL ] GHM: Loaded 14400 existing records from primary storage. [2025-09-19T19:03:05.308864] [INFO ] [MAIN ] GHM: Loaded 14400 existing records. [2025-09-19T19:03:05.443342] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T19:03:05.448562] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-19T19:03:05.517307] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:05.517558] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-19T19:03:05.517823] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-19T19:03:05.518319] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-19T19:03:05.518381] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-19T19:03:05.886317] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:06.243234] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-19T19:03:06.294455] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T19:03:06.749572] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T19:03:07.043318] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-19T19:03:07.509309] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-19T19:03:07.843263] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-19T19:03:08.643303] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-19T19:03:08.822712] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T19:03:09.062321] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T19:03:09.443305] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-19T19:03:10.116493] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T19:03:10.243257] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-19T19:03:10.708932] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-19T19:03:11.043277] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-19T19:03:11.843318] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-19T19:03:12.027565] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T19:03:12.643283] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-19T19:03:13.035471] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:03:13.443266] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-19T19:03:14.243239] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-19T19:03:14.432791] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:03:14.744034] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T19:03:14.745402] [INFO ] [REMOTE ] GHLD: Full fetch complete (4664 records). [2025-09-19T19:03:14.745479] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-19T19:03:14.912092] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T19:03:14.941715] [INFO ] [REMOTE ] GHG: Full fetch complete (3959 records). [2025-09-19T19:03:15.007254] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-19T19:03:15.050996] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-19T19:03:15.241228] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-19T19:03:15.246445] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-19T19:03:15.251782] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-19T19:03:15.257344] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-19T19:03:15.288866] [DEBUG] [LOCAL ] GHLD: Trimmed 4664 records to 4080 (keeping 200 days of data) [2025-09-19T19:03:15.451360] [DEBUG] [LOCAL ] GHLD: Primary data saved (4080 records). [2025-09-19T19:03:15.451496] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-19T19:03:15.451951] [INFO ] [MAIN ] Update Progress: 929/2372 symbols completed. GHLD took 22.2s. Estimated remaining: 3h 11m 21s. Rate: 7.5 symbols/min [2025-09-19T19:03:15.643990] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-19T19:03:15.644456] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-19T19:03:15.650200] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-19T19:03:15.655407] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-19T19:03:15.698089] [DEBUG] [LOCAL ] GHG: Trimmed 3959 records to 3180 (keeping 200 days of data) [2025-09-19T19:03:15.720016] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:15.739051] [DEBUG] [LOCAL ] GHG: Primary data saved (3180 records). [2025-09-19T19:03:15.739172] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-19T19:03:15.739273] [INFO ] [MAIN ] Update Progress: 930/2372 symbols completed. GHG took 30.0s. Estimated remaining: 3h 11m 1s. Rate: 7.5 symbols/min [2025-09-19T19:03:15.848456] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-19T19:03:15.936181] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:15.911502] [DEBUG] [LOCAL ] GHY: Loaded 21293 existing records from primary storage. [2025-09-19T19:03:15.941957] [INFO ] [MAIN ] GHY: Loaded 21293 existing records. [2025-09-19T19:03:15.976144] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T19:03:16.146690] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:16.156352] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-19T19:03:16.156277] [DEBUG] [LOCAL ] GIB: Loaded 32695 existing records from primary storage. [2025-09-19T19:03:16.156523] [INFO ] [MAIN ] GIB: Loaded 32695 existing records. [2025-09-19T19:03:16.156458] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-19T19:03:16.188515] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-19T19:03:16.214304] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-19T19:03:16.501155] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:16.515979] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-19T19:03:16.517511] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-19T19:03:16.570587] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-19T19:03:16.603736] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-19T19:03:16.652604] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-19T19:03:16.921549] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:17.102365] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:17.127519] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T19:03:17.443273] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-19T19:03:17.670875] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T19:03:18.200164] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T19:03:18.243225] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-19T19:03:19.043319] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-19T19:03:19.190286] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:03:19.843272] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-19T19:03:19.871535] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T19:03:19.873185] [INFO ] [REMOTE ] GHI: Full fetch complete (11857 records). [2025-09-19T19:03:19.873263] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-19T19:03:20.255661] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-19T19:03:20.255775] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-19T19:03:20.256098] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-19T19:03:20.256138] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-19T19:03:20.256748] [DEBUG] [LOCAL ] GHI: Trimmed 11857 records to 7129 (keeping 200 days of data) [2025-09-19T19:03:20.305736] [DEBUG] [LOCAL ] GHI: Primary data saved (7129 records). [2025-09-19T19:03:20.305889] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-19T19:03:20.306040] [INFO ] [MAIN ] Update Progress: 931/2372 symbols completed. GHI took 32.3s. Estimated remaining: 3h 10m 48s. Rate: 7.6 symbols/min [2025-09-19T19:03:20.481480] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:20.497964] [DEBUG] [LOCAL ] GIC: Loaded 13973 existing records from primary storage. [2025-09-19T19:03:20.498097] [INFO ] [MAIN ] GIC: Loaded 13973 existing records. [2025-09-19T19:03:20.649382] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-19T19:03:20.681741] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:20.682077] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-19T19:03:20.682132] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-19T19:03:20.682774] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-19T19:03:20.682836] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-19T19:03:21.061952] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:21.075033] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T19:03:21.443296] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-19T19:03:22.067861] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T19:03:22.243338] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-19T19:03:22.932122] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T19:03:23.043291] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-19T19:03:23.545890] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:03:23.843279] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-19T19:03:24.161701] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T19:03:24.643310] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-19T19:03:25.456324] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-19T19:03:25.462149] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:03:25.483494] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T19:03:26.243235] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-19T19:03:26.792010] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:03:27.043264] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-19T19:03:27.127894] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T19:03:27.843290] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-19T19:03:28.218980] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:03:28.643278] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-19T19:03:28.743179] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-19T19:03:29.443310] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-19T19:03:29.987318] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T19:03:30.243302] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-19T19:03:30.438461] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T19:03:31.043285] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-19T19:03:31.843302] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-19T19:03:31.888951] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T19:03:32.413981] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:03:32.643280] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-19T19:03:33.283547] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T19:03:33.443241] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-19T19:03:33.845491] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:03:34.243263] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-19T19:03:34.277756] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T19:03:35.043280] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-19T19:03:35.468392] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T19:03:35.843272] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-19T19:03:36.096135] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T19:03:36.098585] [INFO ] [REMOTE ] GHM: Full fetch complete (21477 records). [2025-09-19T19:03:36.098697] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-19T19:03:36.469614] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-19T19:03:36.469747] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-19T19:03:36.470200] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-19T19:03:36.470241] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-19T19:03:36.470837] [DEBUG] [LOCAL ] GHM: Trimmed 21477 records to 14487 (keeping 200 days of data) [2025-09-19T19:03:36.556509] [DEBUG] [LOCAL ] GHM: Primary data saved (14487 records). [2025-09-19T19:03:36.556680] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-19T19:03:36.556800] [INFO ] [MAIN ] Update Progress: 932/2372 symbols completed. GHM took 31.4s. Estimated remaining: 3h 10m 52s. Rate: 7.5 symbols/min [2025-09-19T19:03:36.648365] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-19T19:03:36.740540] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:36.782170] [DEBUG] [LOCAL ] GIL: Loaded 43347 existing records from primary storage. [2025-09-19T19:03:36.782320] [INFO ] [MAIN ] GIL: Loaded 43347 existing records. [2025-09-19T19:03:36.967608] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:36.967897] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-19T19:03:36.967948] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-19T19:03:36.969174] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-19T19:03:36.969237] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-19T19:03:37.317519] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T19:03:37.364788] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:37.443240] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-19T19:03:38.113626] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:03:38.208922] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T19:03:38.243220] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-19T19:03:39.043251] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-19T19:03:39.506681] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T19:03:39.843275] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-19T19:03:40.643324] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-19T19:03:40.695584] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T19:03:40.785624] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T19:03:41.443266] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-19T19:03:41.453205] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T19:03:42.243283] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-19T19:03:43.043250] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-19T19:03:43.168917] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T19:03:43.269411] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T19:03:43.843266] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-19T19:03:44.148432] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T19:03:44.643237] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-19T19:03:44.728089] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:03:44.731120] [INFO ] [REMOTE ] GHY: Full fetch complete (31926 records). [2025-09-19T19:03:44.731205] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-19T19:03:45.097595] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-19T19:03:45.097737] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-19T19:03:45.098359] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-19T19:03:45.098403] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-19T19:03:45.099360] [DEBUG] [LOCAL ] GHY: Trimmed 31926 records to 21391 (keeping 200 days of data) [2025-09-19T19:03:45.231847] [DEBUG] [LOCAL ] GHY: Primary data saved (21391 records). [2025-09-19T19:03:45.231984] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-19T19:03:45.232067] [INFO ] [MAIN ] Update Progress: 933/2372 symbols completed. GHY took 29.8s. Estimated remaining: 3h 10m 46s. Rate: 7.5 symbols/min [2025-09-19T19:03:45.411948] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:45.447018] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-19T19:03:45.468950] [DEBUG] [LOCAL ] GIS: Loaded 54064 existing records from primary storage. [2025-09-19T19:03:45.469090] [INFO ] [MAIN ] GIS: Loaded 54064 existing records. [2025-09-19T19:03:45.664324] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:45.664609] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-19T19:03:45.664684] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-19T19:03:45.666148] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-19T19:03:45.666213] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-19T19:03:46.054983] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:46.056324] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T19:03:46.243323] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-19T19:03:47.043330] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-19T19:03:47.124399] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:03:47.664795] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T19:03:47.843269] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-19T19:03:48.181864] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T19:03:48.184889] [INFO ] [REMOTE ] GIC: Full fetch complete (20319 records). [2025-09-19T19:03:48.184979] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-19T19:03:48.558139] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-19T19:03:48.558255] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-19T19:03:48.558779] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-19T19:03:48.558852] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-19T19:03:48.559534] [DEBUG] [LOCAL ] GIC: Trimmed 20319 records to 14066 (keeping 200 days of data) [2025-09-19T19:03:48.643267] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-19T19:03:48.652851] [DEBUG] [LOCAL ] GIC: Primary data saved (14066 records). [2025-09-19T19:03:48.652947] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-19T19:03:48.653112] [INFO ] [MAIN ] Update Progress: 934/2372 symbols completed. GIC took 28.3s. Estimated remaining: 3h 10m 31s. Rate: 7.5 symbols/min [2025-09-19T19:03:48.825699] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:48.871192] [DEBUG] [LOCAL ] GKOS: Loaded 43478 existing records from primary storage. [2025-09-19T19:03:48.871335] [INFO ] [MAIN ] GKOS: Loaded 43478 existing records. [2025-09-19T19:03:49.050472] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:49.050809] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-19T19:03:49.050876] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-19T19:03:49.052097] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-19T19:03:49.052165] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-19T19:03:49.442014] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:49.443219] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-19T19:03:50.070635] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T19:03:50.243272] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-19T19:03:50.270668] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:03:50.778256] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T19:03:51.043270] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-19T19:03:51.843311] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-19T19:03:52.212705] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T19:03:52.583504] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T19:03:52.643226] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-19T19:03:53.138197] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:03:53.443268] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-19T19:03:53.701526] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T19:03:53.706410] [INFO ] [REMOTE ] GIB: Full fetch complete (44981 records). [2025-09-19T19:03:53.706504] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-19T19:03:54.102314] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-19T19:03:54.102437] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-19T19:03:54.103746] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-19T19:03:54.103828] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-19T19:03:54.108687] [DEBUG] [LOCAL ] GIB: Trimmed 44981 records to 32922 (keeping 200 days of data) [2025-09-19T19:03:54.245832] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-19T19:03:54.330031] [DEBUG] [LOCAL ] GIB: Primary data saved (32922 records). [2025-09-19T19:03:54.330185] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-19T19:03:54.330337] [INFO ] [MAIN ] Update Progress: 935/2372 symbols completed. GIB took 38.6s. Estimated remaining: 3h 10m 19s. Rate: 7.6 symbols/min [2025-09-19T19:03:54.511454] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:54.556604] [DEBUG] [LOCAL ] GL: Loaded 38494 existing records from primary storage. [2025-09-19T19:03:54.556794] [INFO ] [MAIN ] GL: Loaded 38494 existing records. [2025-09-19T19:03:54.774901] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:54.775164] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-19T19:03:54.775212] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-19T19:03:54.776615] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-19T19:03:54.776700] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-19T19:03:55.054110] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-19T19:03:55.137234] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:55.349837] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:03:55.843217] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-19T19:03:56.116821] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T19:03:56.643272] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-19T19:03:56.899074] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:03:57.443337] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-19T19:03:57.491384] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T19:03:58.243229] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-19T19:03:58.368788] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T19:03:59.043272] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-19T19:03:59.227808] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:03:59.734211] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:03:59.843229] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-19T19:04:00.643289] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-19T19:04:01.443279] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-19T19:04:01.500763] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:04:01.570545] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T19:04:02.243256] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-19T19:04:02.754740] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:04:02.788815] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T19:04:03.043308] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-19T19:04:03.843340] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-19T19:04:04.340513] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T19:04:04.643282] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-19T19:04:04.799581] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T19:04:05.233768] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T19:04:05.443315] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-19T19:04:06.243292] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-19T19:04:06.396184] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:04:06.655893] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:04:07.043350] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-19T19:04:07.843283] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-19T19:04:08.107732] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T19:04:08.643293] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-19T19:04:08.832466] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:04:09.443251] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-19T19:04:10.019663] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T19:04:10.243276] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-19T19:04:10.449298] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:04:10.457056] [INFO ] [REMOTE ] GIL: Full fetch complete (61188 records). [2025-09-19T19:04:10.457227] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-19T19:04:10.928279] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-19T19:04:10.928504] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-19T19:04:10.931330] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T19:04:10.930108] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-19T19:04:10.939277] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-19T19:04:10.944831] [DEBUG] [LOCAL ] GIL: Trimmed 61188 records to 43701 (keeping 200 days of data) [2025-09-19T19:04:11.052837] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-19T19:04:11.244784] [DEBUG] [LOCAL ] GIL: Primary data saved (43701 records). [2025-09-19T19:04:11.244931] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-19T19:04:11.245084] [INFO ] [MAIN ] Update Progress: 936/2372 symbols completed. GIL took 34.7s. Estimated remaining: 3h 10m 25s. Rate: 7.5 symbols/min [2025-09-19T19:04:11.443011] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:11.498087] [DEBUG] [LOCAL ] GLOB: Loaded 47525 existing records from primary storage. [2025-09-19T19:04:11.498274] [INFO ] [MAIN ] GLOB: Loaded 47525 existing records. [2025-09-19T19:04:11.694402] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:11.694743] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-19T19:04:11.694801] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-19T19:04:11.695973] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-19T19:04:11.696054] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-19T19:04:11.854310] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-19T19:04:12.121158] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:12.147909] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:04:12.643264] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-19T19:04:12.730676] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:04:13.443274] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-19T19:04:13.798782] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T19:04:13.994634] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T19:04:14.006405] [INFO ] [REMOTE ] GIS: Full fetch complete (77649 records). [2025-09-19T19:04:14.006573] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-19T19:04:14.255144] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-19T19:04:14.401124] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-19T19:04:14.401215] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-19T19:04:14.402273] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-19T19:04:14.402346] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-19T19:04:14.405405] [DEBUG] [LOCAL ] GIS: Trimmed 77649 records to 54454 (keeping 200 days of data) [2025-09-19T19:04:14.798102] [DEBUG] [LOCAL ] GIS: Primary data saved (54454 records). [2025-09-19T19:04:14.798674] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-19T19:04:14.798915] [INFO ] [MAIN ] Update Progress: 937/2372 symbols completed. GIS took 29.6s. Estimated remaining: 3h 10m 10s. Rate: 7.5 symbols/min [2025-09-19T19:04:14.992945] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:15.005918] [DEBUG] [LOCAL ] GLP: Loaded 9662 existing records from primary storage. [2025-09-19T19:04:15.006077] [INFO ] [MAIN ] GLP: Loaded 9662 existing records. [2025-09-19T19:04:15.048518] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-19T19:04:15.194162] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:15.194464] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-19T19:04:15.194518] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-19T19:04:15.195031] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-19T19:04:15.195093] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-19T19:04:15.563601] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:15.843270] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-19T19:04:16.006517] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T19:04:16.033420] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-19T19:04:16.041560] [INFO ] [REMOTE ] GKOS: Full fetch complete (59833 records). [2025-09-19T19:04:16.041794] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-19T19:04:16.425941] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-19T19:04:16.426039] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-19T19:04:16.426847] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-19T19:04:16.426911] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-19T19:04:16.428294] [DEBUG] [LOCAL ] GKOS: Trimmed 59833 records to 43831 (keeping 200 days of data) [2025-09-19T19:04:16.635508] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T19:04:16.664332] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-19T19:04:16.727774] [DEBUG] [LOCAL ] GKOS: Primary data saved (43831 records). [2025-09-19T19:04:16.728224] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-19T19:04:16.728343] [INFO ] [MAIN ] Update Progress: 938/2372 symbols completed. GKOS took 28.1s. Estimated remaining: 3h 9m 53s. Rate: 7.6 symbols/min [2025-09-19T19:04:16.907980] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:16.950465] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T19:04:16.999321] [DEBUG] [LOCAL ] GLW: Loaded 54025 existing records from primary storage. [2025-09-19T19:04:16.999529] [INFO ] [MAIN ] GLW: Loaded 54025 existing records. [2025-09-19T19:04:17.184357] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:17.184787] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-19T19:04:17.184849] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-19T19:04:17.186530] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-19T19:04:17.186595] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-19T19:04:17.448451] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-19T19:04:17.554758] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:17.631321] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T19:04:18.243286] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-19T19:04:18.825030] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T19:04:19.043328] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-19T19:04:19.843269] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-19T19:04:20.073737] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:04:20.643339] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-19T19:04:20.844915] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T19:04:20.910327] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T19:04:21.443317] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-19T19:04:21.846998] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T19:04:22.243330] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-19T19:04:22.632591] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T19:04:23.043301] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-19T19:04:23.220770] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T19:04:23.843267] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-19T19:04:24.520458] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T19:04:24.571754] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T19:04:24.643242] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-19T19:04:25.443321] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-19T19:04:26.243268] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-19T19:04:26.377194] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:04:26.701802] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T19:04:27.043276] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-19T19:04:27.843296] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-19T19:04:27.880404] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:04:28.643274] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-19T19:04:29.191204] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T19:04:29.238670] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-19T19:04:29.402753] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T19:04:29.443227] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-19T19:04:30.243269] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-19T19:04:31.043259] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-19T19:04:31.245834] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:04:31.843275] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-19T19:04:31.885555] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T19:04:32.165203] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T19:04:32.643276] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-19T19:04:33.403421] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:04:33.443255] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-19T19:04:34.233195] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:04:34.244307] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-19T19:04:34.307426] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T19:04:35.043290] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-19T19:04:35.843251] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-19T19:04:35.894081] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T19:04:36.643264] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-19T19:04:36.750135] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T19:04:36.771527] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T19:04:37.443279] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-19T19:04:38.243258] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-19T19:04:38.339029] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T19:04:38.819352] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T19:04:38.824398] [INFO ] [REMOTE ] GL: Full fetch complete (55777 records). [2025-09-19T19:04:38.824526] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-19T19:04:39.013707] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-19T19:04:39.048372] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-19T19:04:39.077961] [INFO ] [REMOTE ] GLP: Full fetch complete (14403 records). [2025-09-19T19:04:39.092704] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-19T19:04:39.400122] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-19T19:04:39.416326] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-19T19:04:39.450775] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-19T19:04:39.491801] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-19T19:04:39.537248] [DEBUG] [LOCAL ] GL: Trimmed 55777 records to 38747 (keeping 200 days of data) [2025-09-19T19:04:39.720036] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-19T19:04:39.720722] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-19T19:04:39.721760] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-19T19:04:39.722133] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-19T19:04:39.729728] [DEBUG] [LOCAL ] GLP: Trimmed 14403 records to 9735 (keeping 200 days of data) [2025-09-19T19:04:39.818056] [DEBUG] [LOCAL ] GLP: Primary data saved (9735 records). [2025-09-19T19:04:39.818996] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-19T19:04:39.819169] [INFO ] [MAIN ] Update Progress: 939/2372 symbols completed. GLP took 25.0s. Estimated remaining: 3h 10m 8s. Rate: 7.5 symbols/min [2025-09-19T19:04:39.851287] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-19T19:04:40.092448] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:40.165030] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-09-19T19:04:40.168143] [DEBUG] [LOCAL ] GL: Primary data saved (38747 records). [2025-09-19T19:04:40.168316] [INFO ] [MAIN ] GL: Full history saved. [2025-09-19T19:04:40.168408] [INFO ] [MAIN ] GM: Loaded 54118 existing records. [2025-09-19T19:04:40.173694] [INFO ] [MAIN ] Update Progress: 940/2372 symbols completed. GL took 45.8s. Estimated remaining: 3h 9m 49s. Rate: 7.5 symbols/min [2025-09-19T19:04:40.528134] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:40.530616] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-19T19:04:40.530369] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:40.530762] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-19T19:04:40.532069] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-19T19:04:40.532234] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-19T19:04:40.936262] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:40.936708] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-19T19:04:40.939697] [DEBUG] [LOCAL ] GME: Loaded 54149 existing records from primary storage. [2025-09-19T19:04:40.939976] [INFO ] [MAIN ] GME: Loaded 54149 existing records. [2025-09-19T19:04:41.122585] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:41.122909] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-19T19:04:41.122959] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-19T19:04:41.124222] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-19T19:04:41.124283] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-19T19:04:41.488871] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:41.489314] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-19T19:04:41.526698] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-19T19:04:41.954728] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T19:04:41.962169] [INFO ] [REMOTE ] GLOB: Full fetch complete (62982 records). [2025-09-19T19:04:41.962288] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-19T19:04:42.248390] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-19T19:04:42.354088] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-19T19:04:42.354180] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-19T19:04:42.355017] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-19T19:04:42.355128] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-19T19:04:42.356947] [DEBUG] [LOCAL ] GLOB: Trimmed 62982 records to 47899 (keeping 200 days of data) [2025-09-19T19:04:42.640423] [DEBUG] [LOCAL ] GLOB: Primary data saved (47899 records). [2025-09-19T19:04:42.640559] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-19T19:04:42.640921] [INFO ] [MAIN ] Update Progress: 941/2372 symbols completed. GLOB took 31.4s. Estimated remaining: 3h 9m 33s. Rate: 7.5 symbols/min [2025-09-19T19:04:42.811769] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:42.859094] [DEBUG] [LOCAL ] GMED: Loaded 48614 existing records from primary storage. [2025-09-19T19:04:42.859245] [INFO ] [MAIN ] GMED: Loaded 48614 existing records. [2025-09-19T19:04:43.037473] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:43.037777] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-19T19:04:43.037919] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-19T19:04:43.039010] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-19T19:04:43.039074] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-19T19:04:43.434678] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:43.435097] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-19T19:04:43.472345] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-19T19:04:43.843304] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-19T19:04:43.849358] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-19T19:04:44.477082] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T19:04:44.643249] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-19T19:04:45.185345] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T19:04:45.443271] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-19T19:04:46.216233] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-19T19:04:46.243218] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-19T19:04:46.979060] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T19:04:47.043293] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-19T19:04:47.275698] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:04:47.843271] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-19T19:04:48.507513] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T19:04:48.643225] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-19T19:04:48.692024] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-19T19:04:49.443265] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-19T19:04:50.184890] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T19:04:50.192957] [INFO ] [REMOTE ] GLW: Full fetch complete (77614 records). [2025-09-19T19:04:50.193100] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-19T19:04:50.258160] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-19T19:04:50.601762] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-19T19:04:50.601882] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-19T19:04:50.602925] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-19T19:04:50.603022] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-19T19:04:50.628518] [DEBUG] [LOCAL ] GLW: Trimmed 77614 records to 54415 (keeping 200 days of data) [2025-09-19T19:04:50.629363] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T19:04:50.989813] [DEBUG] [LOCAL ] GLW: Primary data saved (54415 records). [2025-09-19T19:04:50.989996] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-19T19:04:50.990286] [INFO ] [MAIN ] Update Progress: 942/2372 symbols completed. GLW took 34.3s. Estimated remaining: 3h 9m 25s. Rate: 7.5 symbols/min [2025-09-19T19:04:51.054332] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-19T19:04:51.168823] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:51.204474] [DEBUG] [LOCAL ] GMRE: Loaded 37946 existing records from primary storage. [2025-09-19T19:04:51.204635] [INFO ] [MAIN ] GMRE: Loaded 37946 existing records. [2025-09-19T19:04:51.387458] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:51.387914] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-19T19:04:51.387990] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-19T19:04:51.389098] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-19T19:04:51.389162] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-19T19:04:51.767947] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-19T19:04:51.809586] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:51.843218] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-19T19:04:52.643263] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-19T19:04:52.808450] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-19T19:04:52.995396] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T19:04:53.443264] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-19T19:04:53.789980] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:04:54.243243] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-19T19:04:54.265883] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:04:54.663563] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T19:04:55.043264] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-19T19:04:55.843271] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-19T19:04:56.643278] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-19T19:04:56.707307] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T19:04:56.812181] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-19T19:04:57.443281] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-19T19:04:57.727963] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:04:58.243271] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-19T19:04:58.709054] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:04:59.043259] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-19T19:04:59.136062] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T19:04:59.843264] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-19T19:05:00.309208] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T19:05:00.436863] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T19:05:00.643267] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-19T19:05:01.443241] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-19T19:05:01.469558] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:05:02.243267] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-19T19:05:02.769974] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T19:05:03.043262] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-19T19:05:03.854003] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-19T19:05:03.855612] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-19T19:05:04.347607] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T19:05:04.643267] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-19T19:05:05.176426] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T19:05:05.443279] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-19T19:05:05.634135] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-19T19:05:06.243330] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-19T19:05:06.947404] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T19:05:07.043337] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-19T19:05:07.105391] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T19:05:07.843279] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-19T19:05:07.950013] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T19:05:07.958229] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-19T19:05:07.958373] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-19T19:05:08.420106] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-19T19:05:08.420245] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-19T19:05:08.421499] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-19T19:05:08.421598] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-19T19:05:08.423505] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54508 (keeping 200 days of data) [2025-09-19T19:05:08.648536] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-19T19:05:08.877610] [DEBUG] [LOCAL ] GM: Primary data saved (54508 records). [2025-09-19T19:05:08.877880] [INFO ] [MAIN ] GM: Full history saved. [2025-09-19T19:05:08.878095] [INFO ] [MAIN ] Update Progress: 943/2372 symbols completed. GM took 29.1s. Estimated remaining: 3h 9m 32s. Rate: 7.5 symbols/min [2025-09-19T19:05:09.134634] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T19:05:09.231614] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:09.258226] [DEBUG] [LOCAL ] GNE: Loaded 17483 existing records from primary storage. [2025-09-19T19:05:09.258409] [INFO ] [MAIN ] GNE: Loaded 17483 existing records. [2025-09-19T19:05:09.452171] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-19T19:05:09.488386] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:09.488677] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-19T19:05:09.488763] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-19T19:05:09.489452] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-19T19:05:09.489516] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-19T19:05:09.873818] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:09.905390] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-09-19T19:05:10.243270] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-19T19:05:10.456676] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:05:10.858456] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-19T19:05:11.043302] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-19T19:05:11.176313] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T19:05:11.843312] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-19T19:05:12.459770] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T19:05:12.466639] [INFO ] [REMOTE ] GMED: Full fetch complete (69069 records). [2025-09-19T19:05:12.466807] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-19T19:05:12.646674] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-19T19:05:12.863305] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-19T19:05:12.863391] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-19T19:05:12.864282] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-19T19:05:12.864344] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-19T19:05:12.865742] [DEBUG] [LOCAL ] GMED: Trimmed 69069 records to 48979 (keeping 200 days of data) [2025-09-19T19:05:13.108622] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T19:05:13.187290] [DEBUG] [LOCAL ] GMED: Primary data saved (48979 records). [2025-09-19T19:05:13.187494] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-19T19:05:13.188131] [INFO ] [MAIN ] Update Progress: 944/2372 symbols completed. GMED took 30.5s. Estimated remaining: 3h 9m 19s. Rate: 7.5 symbols/min [2025-09-19T19:05:13.368204] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:13.413998] [DEBUG] [LOCAL ] GNK: Loaded 41207 existing records from primary storage. [2025-09-19T19:05:13.414188] [INFO ] [MAIN ] GNK: Loaded 41207 existing records. [2025-09-19T19:05:13.447415] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-19T19:05:13.620036] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:13.620321] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-19T19:05:13.620372] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-19T19:05:13.621499] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-19T19:05:13.621565] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-19T19:05:13.924378] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:05:14.050601] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:14.243290] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-19T19:05:15.043275] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-19T19:05:15.843301] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-19T19:05:15.929867] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T19:05:15.984428] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T19:05:16.179199] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-19T19:05:16.643299] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-19T19:05:17.334867] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:05:17.340667] [INFO ] [REMOTE ] GMRE: Full fetch complete (53464 records). [2025-09-19T19:05:17.340775] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-19T19:05:17.448468] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-19T19:05:17.720985] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-19T19:05:17.721066] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-19T19:05:17.721855] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-19T19:05:17.721918] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-19T19:05:17.723061] [DEBUG] [LOCAL ] GMRE: Trimmed 53464 records to 38263 (keeping 200 days of data) [2025-09-19T19:05:17.942470] [DEBUG] [LOCAL ] GMRE: Primary data saved (38263 records). [2025-09-19T19:05:17.942663] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-19T19:05:17.942805] [INFO ] [MAIN ] Update Progress: 945/2372 symbols completed. GMRE took 27.0s. Estimated remaining: 3h 9m 6s. Rate: 7.5 symbols/min [2025-09-19T19:05:18.118341] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:18.118616] [DEBUG] [LOCAL ] GNL: No existing data file found in primary storage. [2025-09-19T19:05:18.118696] [WARN ] [MAIN ] GNL: No existing data found, performing full refresh instead. [2025-09-19T19:05:18.118851] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-19T19:05:18.118895] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-19T19:05:18.118937] [DEBUG] [LOCAL ] GNL: No primary data file found to delete. [2025-09-19T19:05:18.118969] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-19T19:05:18.246584] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-19T19:05:18.511912] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:18.523816] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T19:05:19.043252] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-19T19:05:19.343901] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T19:05:19.843290] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-19T19:05:20.274064] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-19T19:05:20.317113] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:05:20.643270] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-19T19:05:20.784607] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T19:05:21.443289] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-19T19:05:22.243291] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-19T19:05:23.043283] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-19T19:05:23.369353] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-19T19:05:23.377346] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-09-19T19:05:23.377481] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-19T19:05:23.810143] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-19T19:05:23.810357] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-19T19:05:23.811626] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-19T19:05:23.811898] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-19T19:05:23.849592] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-19T19:05:23.860518] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 54539 (keeping 200 days of data) [2025-09-19T19:05:23.861387] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-19T19:05:23.977832] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:05:24.221996] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T19:05:24.241784] [DEBUG] [LOCAL ] GME: Primary data saved (54539 records). [2025-09-19T19:05:24.241924] [INFO ] [MAIN ] GME: Full history saved. [2025-09-19T19:05:24.242018] [INFO ] [MAIN ] Update Progress: 946/2372 symbols completed. GME took 44.0s. Estimated remaining: 3h 8m 56s. Rate: 7.5 symbols/min [2025-09-19T19:05:24.416368] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:24.466276] [DEBUG] [LOCAL ] GNRC: Loaded 45443 existing records from primary storage. [2025-09-19T19:05:24.466461] [INFO ] [MAIN ] GNRC: Loaded 45443 existing records. [2025-09-19T19:05:24.655313] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-19T19:05:24.661804] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:24.662890] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-19T19:05:24.663001] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-19T19:05:24.664299] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-19T19:05:24.664374] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-19T19:05:25.037534] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:25.443260] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-19T19:05:25.720295] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:05:25.995072] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:05:26.243251] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-19T19:05:27.043293] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-19T19:05:27.289831] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T19:05:27.843276] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-19T19:05:28.033688] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:05:28.643300] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-19T19:05:28.879198] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:05:29.443265] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-19T19:05:29.597213] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T19:05:30.243258] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-19T19:05:30.706771] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T19:05:31.043268] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-19T19:05:31.513761] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:05:31.843306] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-19T19:05:32.095704] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T19:05:32.436839] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T19:05:32.643258] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-19T19:05:33.104869] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T19:05:33.443241] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-19T19:05:33.871149] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T19:05:34.243272] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-19T19:05:34.902925] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T19:05:35.043259] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-19T19:05:35.843236] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-19T19:05:35.958244] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T19:05:36.643258] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-19T19:05:37.443284] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-19T19:05:37.720210] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T19:05:38.243324] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-19T19:05:38.438356] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T19:05:38.603138] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T19:05:39.043274] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-19T19:05:39.843270] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-19T19:05:40.150246] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T19:05:40.643270] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-19T19:05:40.896180] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T19:05:41.443267] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-19T19:05:42.399354] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:05:42.408731] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-19T19:05:43.165143] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (8.12 seconds). [2025-09-19T19:05:43.167922] [INFO ] [REMOTE ] GNE: Full fetch complete (22055 records). [2025-09-19T19:05:43.167994] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-19T19:05:43.556692] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-19T19:05:43.556873] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-19T19:05:43.557483] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-19T19:05:43.557768] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-19T19:05:43.559368] [DEBUG] [LOCAL ] GNE: Trimmed 22055 records to 17580 (keeping 200 days of data) [2025-09-19T19:05:43.665450] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T19:05:43.681469] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-19T19:05:43.715176] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:05:43.744231] [DEBUG] [LOCAL ] GNE: Primary data saved (17580 records). [2025-09-19T19:05:43.744386] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-19T19:05:43.744489] [INFO ] [MAIN ] Update Progress: 947/2372 symbols completed. GNE took 34.9s. Estimated remaining: 3h 9m 5s. Rate: 7.5 symbols/min [2025-09-19T19:05:43.847554] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-19T19:05:43.920535] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:43.930796] [DEBUG] [LOCAL ] GNT: Loaded 7870 existing records from primary storage. [2025-09-19T19:05:43.930888] [INFO ] [MAIN ] GNT: Loaded 7870 existing records. [2025-09-19T19:05:44.115193] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:44.115477] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-19T19:05:44.115524] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-19T19:05:44.115939] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-19T19:05:44.115999] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-19T19:05:44.492766] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:44.643281] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-19T19:05:45.445788] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T19:05:45.447465] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-19T19:05:45.482254] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T19:05:45.605560] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T19:05:45.748851] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (5.91 seconds). [2025-09-19T19:05:45.754482] [INFO ] [REMOTE ] GNK: Full fetch complete (57003 records). [2025-09-19T19:05:45.754580] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-19T19:05:46.066081] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T19:05:46.150563] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-19T19:05:46.150710] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-19T19:05:46.151507] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-19T19:05:46.151552] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-19T19:05:46.152929] [DEBUG] [LOCAL ] GNK: Trimmed 57003 records to 41479 (keeping 200 days of data) [2025-09-19T19:05:46.245794] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-19T19:05:46.409227] [DEBUG] [LOCAL ] GNK: Primary data saved (41479 records). [2025-09-19T19:05:46.409365] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-19T19:05:46.409463] [INFO ] [MAIN ] Update Progress: 948/2372 symbols completed. GNK took 33.2s. Estimated remaining: 3h 8m 49s. Rate: 7.5 symbols/min [2025-09-19T19:05:46.591791] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:46.601069] [DEBUG] [LOCAL ] GNTY: Loaded 7043 existing records from primary storage. [2025-09-19T19:05:46.601205] [INFO ] [MAIN ] GNTY: Loaded 7043 existing records. [2025-09-19T19:05:46.786563] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:46.786919] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-19T19:05:46.786998] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-19T19:05:46.787408] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-19T19:05:46.787470] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-19T19:05:47.056078] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-19T19:05:47.220144] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:47.843293] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-19T19:05:47.889959] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T19:05:48.136980] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T19:05:48.144071] [INFO ] [REMOTE ] GNL: Full fetch complete (68602 records). [2025-09-19T19:05:48.144235] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-19T19:05:48.553472] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-19T19:05:48.553554] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-19T19:05:48.554439] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-19T19:05:48.554502] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-19T19:05:48.555968] [DEBUG] [LOCAL ] GNL: Trimmed 68602 records to 48190 (keeping 200 days of data) [2025-09-19T19:05:48.643401] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-19T19:05:48.839139] [DEBUG] [LOCAL ] GNL: Primary data saved (48190 records). [2025-09-19T19:05:48.839277] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-19T19:05:48.839352] [INFO ] [MAIN ] Update Progress: 949/2372 symbols completed. GNL took 30.9s. Estimated remaining: 3h 8m 33s. Rate: 7.5 symbols/min [2025-09-19T19:05:49.008111] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:49.061052] [DEBUG] [LOCAL ] GNW: Loaded 51708 existing records from primary storage. [2025-09-19T19:05:49.061242] [INFO ] [MAIN ] GNW: Loaded 51708 existing records. [2025-09-19T19:05:49.252853] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:49.253157] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-19T19:05:49.253218] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-19T19:05:49.254272] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-19T19:05:49.254341] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-19T19:05:49.461468] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-19T19:05:49.600901] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T19:05:49.623429] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:49.726806] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T19:05:50.243261] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-19T19:05:50.482213] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T19:05:51.043274] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-19T19:05:51.843265] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-19T19:05:51.949339] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T19:05:52.172413] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T19:05:52.643251] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-19T19:05:53.168690] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:05:53.175802] [INFO ] [REMOTE ] GNRC: Full fetch complete (64995 records). [2025-09-19T19:05:53.175958] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-19T19:05:53.314113] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T19:05:53.448354] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-19T19:05:53.617476] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-19T19:05:53.617575] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-19T19:05:53.618441] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-19T19:05:53.618507] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-19T19:05:53.619969] [DEBUG] [LOCAL ] GNRC: Trimmed 64995 records to 45796 (keeping 200 days of data) [2025-09-19T19:05:53.917614] [DEBUG] [LOCAL ] GNRC: Primary data saved (45796 records). [2025-09-19T19:05:53.917795] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-19T19:05:53.917893] [INFO ] [MAIN ] Update Progress: 950/2372 symbols completed. GNRC took 29.7s. Estimated remaining: 3h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T19:05:54.114153] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:54.114345] [DEBUG] [LOCAL ] GOF: No existing data file found in primary storage. [2025-09-19T19:05:54.114385] [WARN ] [MAIN ] GOF: No existing data found, performing full refresh instead. [2025-09-19T19:05:54.114530] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-19T19:05:54.114575] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-19T19:05:54.114618] [DEBUG] [LOCAL ] GOF: No primary data file found to delete. [2025-09-19T19:05:54.114678] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-19T19:05:54.248377] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-19T19:05:54.492436] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:54.503922] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T19:05:55.043268] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-19T19:05:55.311477] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T19:05:55.843273] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-19T19:05:56.643274] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-19T19:05:56.707844] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T19:05:56.943197] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:05:57.127949] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T19:05:57.443276] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-19T19:05:58.021507] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T19:05:58.243258] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-19T19:05:58.975578] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T19:05:59.043224] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-19T19:05:59.837748] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T19:05:59.843210] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-19T19:06:00.566374] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T19:06:00.643238] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-19T19:06:01.443274] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-19T19:06:01.823490] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T19:06:01.832557] [INFO ] [REMOTE ] GNT: Full fetch complete (10385 records). [2025-09-19T19:06:01.832831] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-19T19:06:02.250566] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-19T19:06:02.338314] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-19T19:06:02.338418] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-19T19:06:02.338805] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-19T19:06:02.339418] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-19T19:06:02.340393] [DEBUG] [LOCAL ] GNT: Trimmed 10385 records to 7944 (keeping 200 days of data) [2025-09-19T19:06:02.395113] [DEBUG] [LOCAL ] GNT: Primary data saved (7944 records). [2025-09-19T19:06:02.395282] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-19T19:06:02.395418] [INFO ] [MAIN ] Update Progress: 951/2372 symbols completed. GNT took 18.7s. Estimated remaining: 3h 8m 14s. Rate: 7.5 symbols/min [2025-09-19T19:06:02.600295] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:02.637130] [DEBUG] [LOCAL ] GOLF: Loaded 32291 existing records from primary storage. [2025-09-19T19:06:02.637275] [INFO ] [MAIN ] GOLF: Loaded 32291 existing records. [2025-09-19T19:06:02.813669] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:02.813950] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-19T19:06:02.814000] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-19T19:06:02.814826] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-19T19:06:02.814889] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-19T19:06:03.060974] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-19T19:06:03.187731] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:03.421140] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T19:06:03.843313] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-19T19:06:04.643334] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-19T19:06:04.827758] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-19T19:06:05.302755] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T19:06:05.443226] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-19T19:06:05.638020] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-19T19:06:05.989505] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T19:06:06.243291] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-19T19:06:06.384507] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T19:06:07.043291] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-19T19:06:07.763716] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T19:06:07.843271] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-19T19:06:08.617833] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T19:06:08.643235] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-19T19:06:09.443281] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-19T19:06:09.895446] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T19:06:09.937293] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:06:10.243281] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-19T19:06:10.341493] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-19T19:06:11.043327] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-19T19:06:11.843289] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-19T19:06:12.194430] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:06:12.273451] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T19:06:12.643285] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-19T19:06:13.443285] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-19T19:06:14.154487] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T19:06:14.243276] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-19T19:06:15.043322] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-19T19:06:15.160516] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T19:06:15.162301] [INFO ] [REMOTE ] GNTY: Full fetch complete (10151 records). [2025-09-19T19:06:15.162378] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-19T19:06:15.541801] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-19T19:06:15.541927] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-19T19:06:15.542363] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-19T19:06:15.542448] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-19T19:06:15.543058] [DEBUG] [LOCAL ] GNTY: Trimmed 10151 records to 7131 (keeping 200 days of data) [2025-09-19T19:06:15.614431] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-19T19:06:15.637183] [DEBUG] [LOCAL ] GNTY: Primary data saved (7131 records). [2025-09-19T19:06:15.637301] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-19T19:06:15.637404] [INFO ] [MAIN ] Update Progress: 952/2372 symbols completed. GNTY took 29.2s. Estimated remaining: 3h 8m 13s. Rate: 7.5 symbols/min [2025-09-19T19:06:15.808596] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:15.846439] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-19T19:06:15.867593] [DEBUG] [LOCAL ] GOOS: Loaded 46206 existing records from primary storage. [2025-09-19T19:06:15.867798] [INFO ] [MAIN ] GOOS: Loaded 46206 existing records. [2025-09-19T19:06:16.049755] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:16.050052] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-19T19:06:16.050145] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-19T19:06:16.051157] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-19T19:06:16.051220] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-19T19:06:16.429626] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:16.457970] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-19T19:06:16.643225] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-19T19:06:16.923909] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:06:17.263087] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T19:06:17.443271] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-19T19:06:18.243267] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-19T19:06:18.521961] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T19:06:19.043327] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-19T19:06:19.430517] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:06:19.529151] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T19:06:19.843274] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-19T19:06:20.643298] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-19T19:06:21.166329] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T19:06:21.342545] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T19:06:21.443236] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-19T19:06:22.243250] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-19T19:06:22.717351] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:06:23.043301] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-19T19:06:23.432793] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:06:23.441504] [INFO ] [REMOTE ] GNW: Full fetch complete (73410 records). [2025-09-19T19:06:23.441898] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-19T19:06:23.851191] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-19T19:06:23.915209] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-19T19:06:23.915334] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-19T19:06:23.916354] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-19T19:06:23.916451] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-19T19:06:23.920630] [DEBUG] [LOCAL ] GNW: Trimmed 73410 records to 52097 (keeping 200 days of data) [2025-09-19T19:06:24.066516] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T19:06:24.273559] [DEBUG] [LOCAL ] GNW: Primary data saved (52097 records). [2025-09-19T19:06:24.273765] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-19T19:06:24.273898] [INFO ] [MAIN ] Update Progress: 953/2372 symbols completed. GNW took 35.4s. Estimated remaining: 3h 8m 7s. Rate: 7.5 symbols/min [2025-09-19T19:06:24.465143] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:24.508618] [DEBUG] [LOCAL ] GOTU: Loaded 39755 existing records from primary storage. [2025-09-19T19:06:24.508815] [INFO ] [MAIN ] GOTU: Loaded 39755 existing records. [2025-09-19T19:06:24.648476] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-19T19:06:24.691460] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:24.691779] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-19T19:06:24.691861] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-19T19:06:24.692679] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-19T19:06:24.692773] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-19T19:06:25.071960] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:25.102766] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T19:06:25.323941] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T19:06:25.443254] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-19T19:06:26.243279] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-19T19:06:26.594190] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T19:06:26.895793] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T19:06:27.043315] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-19T19:06:27.843266] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-19T19:06:28.220515] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T19:06:28.481017] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T19:06:28.488195] [INFO ] [REMOTE ] GOLF: Full fetch complete (44765 records). [2025-09-19T19:06:28.488358] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-19T19:06:28.648372] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-19T19:06:28.887281] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-19T19:06:28.887369] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-19T19:06:28.888137] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-19T19:06:28.888201] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-19T19:06:28.889251] [DEBUG] [LOCAL ] GOLF: Trimmed 44765 records to 32439 (keeping 200 days of data) [2025-09-19T19:06:29.105407] [DEBUG] [LOCAL ] GOLF: Primary data saved (32439 records). [2025-09-19T19:06:29.105547] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-19T19:06:29.105699] [INFO ] [MAIN ] Update Progress: 954/2372 symbols completed. GOLF took 26.7s. Estimated remaining: 3h 7m 54s. Rate: 7.5 symbols/min [2025-09-19T19:06:29.287274] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:29.318988] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T19:06:29.370904] [DEBUG] [LOCAL ] GPC: Loaded 47187 existing records from primary storage. [2025-09-19T19:06:29.371074] [INFO ] [MAIN ] GPC: Loaded 47187 existing records. [2025-09-19T19:06:29.452149] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-19T19:06:29.564534] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:29.564821] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-19T19:06:29.564876] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-19T19:06:29.566160] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-19T19:06:29.566226] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-19T19:06:29.930803] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:30.243269] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-19T19:06:30.515506] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T19:06:30.982776] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T19:06:31.043289] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-19T19:06:31.843282] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-19T19:06:32.128173] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T19:06:32.643277] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-19T19:06:32.899801] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:06:33.443264] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-19T19:06:33.786110] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T19:06:34.243259] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-19T19:06:34.734295] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T19:06:34.885836] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:06:35.043285] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-19T19:06:35.843271] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-19T19:06:36.086543] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:06:36.643257] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-19T19:06:36.822170] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T19:06:37.344684] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T19:06:37.443227] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-19T19:06:38.243319] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-19T19:06:38.436692] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T19:06:38.443625] [INFO ] [REMOTE ] GOF: Full fetch complete (62252 records). [2025-09-19T19:06:38.443769] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-19T19:06:38.834226] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-19T19:06:38.834328] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-19T19:06:38.835186] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-19T19:06:38.835252] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-19T19:06:38.836573] [DEBUG] [LOCAL ] GOF: Trimmed 62252 records to 43673 (keeping 200 days of data) [2025-09-19T19:06:39.062869] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-19T19:06:39.122817] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T19:06:39.173466] [DEBUG] [LOCAL ] GOF: Primary data saved (43673 records). [2025-09-19T19:06:39.173615] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-19T19:06:39.173763] [INFO ] [MAIN ] Update Progress: 955/2372 symbols completed. GOF took 45.3s. Estimated remaining: 3h 7m 49s. Rate: 7.5 symbols/min [2025-09-19T19:06:39.340772] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:39.357778] [DEBUG] [LOCAL ] GPI: Loaded 15301 existing records from primary storage. [2025-09-19T19:06:39.357932] [INFO ] [MAIN ] GPI: Loaded 15301 existing records. [2025-09-19T19:06:39.531372] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:39.531612] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-19T19:06:39.531689] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-19T19:06:39.532282] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-19T19:06:39.532343] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-19T19:06:39.853976] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-19T19:06:39.890824] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:40.363966] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:06:40.643271] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-19T19:06:41.009782] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T19:06:41.492524] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-19T19:06:41.513803] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:06:41.887086] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:06:42.243289] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-19T19:06:43.043286] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-19T19:06:43.379351] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:06:43.843296] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-19T19:06:44.065204] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T19:06:44.643320] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-19T19:06:44.711281] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T19:06:45.372926] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:06:45.379575] [INFO ] [REMOTE ] GOOS: Full fetch complete (66198 records). [2025-09-19T19:06:45.379760] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-19T19:06:45.449142] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-19T19:06:45.795436] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-19T19:06:45.795534] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-19T19:06:45.796407] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-19T19:06:45.796473] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-19T19:06:45.801303] [DEBUG] [LOCAL ] GOOS: Trimmed 66198 records to 46476 (keeping 200 days of data) [2025-09-19T19:06:46.089189] [DEBUG] [LOCAL ] GOOS: Primary data saved (46476 records). [2025-09-19T19:06:46.089530] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-19T19:06:46.089709] [INFO ] [MAIN ] Update Progress: 956/2372 symbols completed. GOOS took 30.5s. Estimated remaining: 3h 7m 40s. Rate: 7.5 symbols/min [2025-09-19T19:06:46.248149] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-19T19:06:46.268229] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:46.299399] [DEBUG] [LOCAL ] GPJA: Loaded 4052 existing records from primary storage. [2025-09-19T19:06:46.301505] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T19:06:46.301872] [INFO ] [MAIN ] GPJA: Loaded 4052 existing records. [2025-09-19T19:06:46.450470] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T19:06:46.515818] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:46.516116] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-19T19:06:46.516166] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-19T19:06:46.516705] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-19T19:06:46.516765] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-19T19:06:46.881958] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:47.043272] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-19T19:06:47.843274] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-19T19:06:48.003546] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T19:06:48.035493] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:06:48.554109] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T19:06:48.643294] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-19T19:06:49.443270] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-19T19:06:50.136396] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T19:06:50.243292] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-19T19:06:50.740170] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T19:06:51.042485] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T19:06:51.045321] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-19T19:06:51.843205] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-19T19:06:52.546411] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T19:06:52.643264] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-19T19:06:52.967102] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T19:06:53.088123] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-19T19:06:53.443268] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-19T19:06:54.243290] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-19T19:06:55.043302] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-19T19:06:55.349327] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:06:55.358349] [INFO ] [REMOTE ] GPC: Full fetch complete (69142 records). [2025-09-19T19:06:55.358564] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-19T19:06:55.800026] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T19:06:55.830503] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T19:06:55.844006] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-19T19:06:55.864201] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-19T19:06:55.865583] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-19T19:06:55.866670] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-19T19:06:55.866860] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-19T19:06:55.869397] [DEBUG] [LOCAL ] GPC: Trimmed 69142 records to 47474 (keeping 200 days of data) [2025-09-19T19:06:56.192790] [DEBUG] [LOCAL ] GPC: Primary data saved (47474 records). [2025-09-19T19:06:56.192942] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-19T19:06:56.193042] [INFO ] [MAIN ] Update Progress: 957/2372 symbols completed. GPC took 27.1s. Estimated remaining: 3h 7m 35s. Rate: 7.5 symbols/min [2025-09-19T19:06:56.643328] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-19T19:06:56.916058] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-19T19:06:57.443265] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-19T19:06:58.243271] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-19T19:06:58.288830] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T19:06:58.313440] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T19:06:58.832973] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-19T19:06:59.043287] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-19T19:06:59.813663] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T19:06:59.843223] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-19T19:07:00.569195] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T19:07:00.643298] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-19T19:07:01.347977] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T19:07:01.443318] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-19T19:07:02.243354] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-19T19:07:03.043351] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-19T19:07:03.080372] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T19:07:03.293739] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T19:07:03.295119] [INFO ] [REMOTE ] GPJA: Full fetch complete (7285 records). [2025-09-19T19:07:03.295194] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-19T19:07:03.675788] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-19T19:07:03.675893] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-19T19:07:03.676094] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-19T19:07:03.676145] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-19T19:07:03.676583] [DEBUG] [LOCAL ] GPJA: Trimmed 7285 records to 4084 (keeping 200 days of data) [2025-09-19T19:07:03.702220] [DEBUG] [LOCAL ] GPJA: Primary data saved (4084 records). [2025-09-19T19:07:03.702354] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-19T19:07:03.702444] [INFO ] [MAIN ] Update Progress: 958/2372 symbols completed. GPJA took 17.6s. Estimated remaining: 3h 7m 26s. Rate: 7.5 symbols/min [2025-09-19T19:07:03.843301] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-19T19:07:04.175036] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T19:07:04.643279] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-19T19:07:05.433020] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:07:05.438947] [INFO ] [REMOTE ] GOTU: Full fetch complete (59973 records). [2025-09-19T19:07:05.439116] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-19T19:07:05.830444] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-19T19:07:05.830556] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-19T19:07:05.831449] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-19T19:07:05.831515] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-19T19:07:05.832851] [DEBUG] [LOCAL ] GOTU: Trimmed 59973 records to 40002 (keeping 200 days of data) [2025-09-19T19:07:06.053004] [DEBUG] [LOCAL ] GOTU: Primary data saved (40002 records). [2025-09-19T19:07:06.053140] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-19T19:07:06.053234] [INFO ] [MAIN ] Update Progress: 959/2372 symbols completed. GOTU took 41.8s. Estimated remaining: 3h 7m 10s. Rate: 7.5 symbols/min [2025-09-19T19:07:06.126821] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T19:07:06.131333] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-19T19:07:07.385956] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:07:07.389278] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-19T19:07:08.471403] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T19:07:08.474108] [INFO ] [REMOTE ] GPI: Full fetch complete (20862 records). [2025-09-19T19:07:08.474190] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-19T19:07:08.845771] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-19T19:07:08.845855] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-19T19:07:08.846403] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-19T19:07:08.846476] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-19T19:07:08.847213] [DEBUG] [LOCAL ] GPI: Trimmed 20862 records to 15365 (keeping 200 days of data) [2025-09-19T19:07:08.942278] [DEBUG] [LOCAL ] GPI: Primary data saved (15365 records). [2025-09-19T19:07:08.942428] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-19T19:07:08.942530] [INFO ] [MAIN ] Update Progress: 960/2372 symbols completed. GPI took 29.8s. Estimated remaining: 3h 6m 55s. Rate: 7.6 symbols/min [2025-09-19T19:07:09.540999] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:09.563275] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:09.700691] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:09.722605] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:09.748260] [DEBUG] [LOCAL ] GPOR: Loaded 23255 existing records from primary storage. [2025-09-19T19:07:09.748479] [INFO ] [MAIN ] GPOR: Loaded 23255 existing records. [2025-09-19T19:07:09.864236] [DEBUG] [LOCAL ] GPMT: Loaded 27022 existing records from primary storage. [2025-09-19T19:07:09.917852] [INFO ] [MAIN ] GPMT: Loaded 27022 existing records. [2025-09-19T19:07:10.031152] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:10.068437] [DEBUG] [LOCAL ] GPN: Loaded 52458 existing records from primary storage. [2025-09-19T19:07:10.068575] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-19T19:07:10.089830] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-19T19:07:10.089582] [INFO ] [MAIN ] GPN: Loaded 52458 existing records. [2025-09-19T19:07:10.148817] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-19T19:07:10.187406] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-19T19:07:10.188210] [DEBUG] [LOCAL ] GPK: Loaded 53057 existing records from primary storage. [2025-09-19T19:07:10.275219] [INFO ] [MAIN ] GPK: Loaded 53057 existing records. [2025-09-19T19:07:10.407575] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:10.509768] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-19T19:07:10.550981] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-19T19:07:10.597187] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-19T19:07:10.607750] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-19T19:07:10.597326] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:10.706952] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-19T19:07:10.707099] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-19T19:07:10.877226] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-19T19:07:10.877326] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:10.897712] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-19T19:07:10.972703] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-19T19:07:10.992673] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-19T19:07:11.056838] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-19T19:07:11.067196] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-19T19:07:11.458436] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:11.501557] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-19T19:07:11.987859] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:11.991322] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-19T19:07:11.990783] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:11.997671] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-19T19:07:12.073481] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:12.073770] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-19T19:07:13.062775] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T19:07:13.071602] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-19T19:07:13.340750] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T19:07:13.351314] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-19T19:07:13.509557] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T19:07:13.515742] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-19T19:07:14.117024] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T19:07:14.127344] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-19T19:07:14.609017] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T19:07:14.615559] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-19T19:07:14.630062] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T19:07:14.635778] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-19T19:07:15.570868] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T19:07:15.576291] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-19T19:07:15.591676] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T19:07:15.656564] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T19:07:15.843263] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-19T19:07:16.072969] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T19:07:16.359498] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T19:07:16.643284] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-19T19:07:17.330861] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:07:17.443264] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-19T19:07:18.243306] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-19T19:07:18.794569] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T19:07:19.043292] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-19T19:07:19.384396] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T19:07:19.537259] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T19:07:19.843296] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-19T19:07:20.598359] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:07:20.643219] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-19T19:07:21.349332] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:07:21.443234] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-19T19:07:22.215784] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T19:07:22.243246] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-19T19:07:22.985765] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:07:23.043230] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-19T19:07:23.546692] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T19:07:23.843362] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-19T19:07:24.643313] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-19T19:07:24.985087] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T19:07:25.443293] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-19T19:07:25.836258] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:07:25.874081] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T19:07:26.243368] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-19T19:07:26.982089] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T19:07:27.043277] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-19T19:07:27.683517] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T19:07:27.843311] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-19T19:07:28.643287] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-19T19:07:28.710524] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T19:07:29.023709] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T19:07:29.443298] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-19T19:07:29.884865] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T19:07:30.243322] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-19T19:07:30.587683] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T19:07:30.591043] [INFO ] [REMOTE ] GPMT: Full fetch complete (38103 records). [2025-09-19T19:07:30.591177] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-19T19:07:30.992966] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-19T19:07:30.993107] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-19T19:07:30.994311] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-19T19:07:30.994386] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-19T19:07:30.995758] [DEBUG] [LOCAL ] GPMT: Trimmed 38103 records to 27210 (keeping 200 days of data) [2025-09-19T19:07:31.046928] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-19T19:07:31.171013] [DEBUG] [LOCAL ] GPMT: Primary data saved (27210 records). [2025-09-19T19:07:31.171219] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-19T19:07:31.171352] [INFO ] [MAIN ] Update Progress: 961/2372 symbols completed. GPMT took 22.2s. Estimated remaining: 3h 7m 8s. Rate: 7.5 symbols/min [2025-09-19T19:07:31.357874] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:31.407319] [DEBUG] [LOCAL ] GPRK: Loaded 39501 existing records from primary storage. [2025-09-19T19:07:31.407488] [INFO ] [MAIN ] GPRK: Loaded 39501 existing records. [2025-09-19T19:07:31.585190] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:31.585487] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-19T19:07:31.585548] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-19T19:07:31.587300] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-19T19:07:31.587361] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-19T19:07:31.848614] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-19T19:07:31.960107] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:32.395009] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T19:07:32.425175] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T19:07:32.643273] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-19T19:07:33.443270] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-19T19:07:33.994611] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T19:07:34.243289] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-19T19:07:34.400887] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T19:07:35.043303] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-19T19:07:35.159881] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T19:07:35.405757] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T19:07:35.843278] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-19T19:07:36.643261] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-19T19:07:36.772043] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T19:07:37.443295] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-19T19:07:37.938099] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:07:37.965220] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:07:37.969515] [INFO ] [REMOTE ] GPOR: Full fetch complete (34854 records). [2025-09-19T19:07:37.969637] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-19T19:07:38.250705] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-19T19:07:38.352864] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-19T19:07:38.352955] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-19T19:07:38.353706] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-19T19:07:38.353771] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-19T19:07:38.354779] [DEBUG] [LOCAL ] GPOR: Trimmed 34854 records to 23489 (keeping 200 days of data) [2025-09-19T19:07:38.496403] [DEBUG] [LOCAL ] GPOR: Primary data saved (23489 records). [2025-09-19T19:07:38.496536] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-19T19:07:38.496621] [INFO ] [MAIN ] Update Progress: 962/2372 symbols completed. GPOR took 29.6s. Estimated remaining: 3h 6m 59s. Rate: 7.5 symbols/min [2025-09-19T19:07:38.676061] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:38.702323] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T19:07:38.732159] [DEBUG] [LOCAL ] GRBK: Loaded 27495 existing records from primary storage. [2025-09-19T19:07:38.732327] [INFO ] [MAIN ] GRBK: Loaded 27495 existing records. [2025-09-19T19:07:38.964244] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:38.964550] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-19T19:07:38.964715] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-19T19:07:38.965740] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-19T19:07:38.965802] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-19T19:07:39.048431] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-19T19:07:39.360639] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:39.843251] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-19T19:07:40.338345] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:07:40.552390] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T19:07:40.643240] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-19T19:07:41.443271] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-19T19:07:41.787732] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T19:07:42.167262] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-19T19:07:42.175406] [INFO ] [REMOTE ] GPK: Full fetch complete (75364 records). [2025-09-19T19:07:42.175544] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-19T19:07:42.248451] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-19T19:07:42.623065] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-19T19:07:42.623152] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-19T19:07:42.624214] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-19T19:07:42.624279] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-19T19:07:42.625856] [DEBUG] [LOCAL ] GPK: Trimmed 75364 records to 53444 (keeping 200 days of data) [2025-09-19T19:07:42.877754] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:07:43.006778] [DEBUG] [LOCAL ] GPK: Primary data saved (53444 records). [2025-09-19T19:07:43.007126] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-19T19:07:43.007460] [INFO ] [MAIN ] Update Progress: 963/2372 symbols completed. GPK took 34.1s. Estimated remaining: 3h 6m 46s. Rate: 7.5 symbols/min [2025-09-19T19:07:43.048462] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-19T19:07:43.198614] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:43.209045] [DEBUG] [LOCAL ] GRC: Loaded 8903 existing records from primary storage. [2025-09-19T19:07:43.209182] [INFO ] [MAIN ] GRC: Loaded 8903 existing records. [2025-09-19T19:07:43.407505] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:43.407824] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-19T19:07:43.407875] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-19T19:07:43.408246] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-19T19:07:43.408311] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-19T19:07:43.791109] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:43.808417] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T19:07:43.843215] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-19T19:07:44.643268] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-19T19:07:45.045238] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T19:07:45.129631] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T19:07:45.443284] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-19T19:07:45.612204] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:07:46.243280] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-19T19:07:47.001020] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:07:47.020538] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-19T19:07:47.043345] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-19T19:07:47.843333] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-19T19:07:48.643313] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-19T19:07:48.798420] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:07:48.929937] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T19:07:49.443266] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-19T19:07:50.243273] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-19T19:07:50.655022] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T19:07:50.663526] [INFO ] [REMOTE ] GPN: Full fetch complete (74790 records). [2025-09-19T19:07:50.663762] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-19T19:07:51.045819] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-19T19:07:51.089033] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-19T19:07:51.089259] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-19T19:07:51.090367] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-19T19:07:51.090670] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-19T19:07:51.099988] [DEBUG] [LOCAL ] GPN: Trimmed 74790 records to 52839 (keeping 200 days of data) [2025-09-19T19:07:51.115240] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T19:07:51.251639] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T19:07:51.484900] [DEBUG] [LOCAL ] GPN: Primary data saved (52839 records). [2025-09-19T19:07:51.485069] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-19T19:07:51.485194] [INFO ] [MAIN ] Update Progress: 964/2372 symbols completed. GPN took 42.5s. Estimated remaining: 3h 6m 39s. Rate: 7.5 symbols/min [2025-09-19T19:07:51.654754] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:51.674512] [DEBUG] [LOCAL ] GRDN: Loaded 19403 existing records from primary storage. [2025-09-19T19:07:51.674669] [INFO ] [MAIN ] GRDN: Loaded 19403 existing records. [2025-09-19T19:07:51.848423] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-19T19:07:51.852694] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:51.854068] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-19T19:07:51.854128] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-19T19:07:51.854905] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-19T19:07:51.854968] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-19T19:07:51.979863] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:07:52.253761] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:52.643275] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-19T19:07:53.295366] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:07:53.311060] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T19:07:53.443270] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-19T19:07:54.243270] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-19T19:07:54.986779] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T19:07:55.001507] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T19:07:55.043278] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-19T19:07:55.843262] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-19T19:07:56.643270] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-19T19:07:56.772321] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T19:07:57.177900] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T19:07:57.232808] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-19T19:07:57.443256] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-19T19:07:58.243297] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-19T19:07:59.030091] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T19:07:59.043230] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-19T19:07:59.573076] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:07:59.843223] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-19T19:08:00.363325] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:08:00.367688] [INFO ] [REMOTE ] GRBK: Full fetch complete (40721 records). [2025-09-19T19:08:00.367849] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-19T19:08:00.648451] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-19T19:08:00.763797] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-19T19:08:00.763878] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-19T19:08:00.764613] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-19T19:08:00.764682] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-19T19:08:00.765589] [DEBUG] [LOCAL ] GRBK: Trimmed 40721 records to 27675 (keeping 200 days of data) [2025-09-19T19:08:00.935343] [DEBUG] [LOCAL ] GRBK: Primary data saved (27675 records). [2025-09-19T19:08:00.935478] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-19T19:08:00.935560] [INFO ] [MAIN ] Update Progress: 965/2372 symbols completed. GRBK took 22.4s. Estimated remaining: 3h 6m 33s. Rate: 7.5 symbols/min [2025-09-19T19:08:01.107827] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:01.153759] [DEBUG] [LOCAL ] GRMN: Loaded 41972 existing records from primary storage. [2025-09-19T19:08:01.153907] [INFO ] [MAIN ] GRMN: Loaded 41972 existing records. [2025-09-19T19:08:01.338459] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:01.338828] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-19T19:08:01.338907] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-19T19:08:01.341035] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-19T19:08:01.341107] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-19T19:08:01.447894] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-19T19:08:01.575240] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T19:08:01.737620] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T19:08:01.780882] [INFO ] [REMOTE ] GPRK: Full fetch complete (57245 records). [2025-09-19T19:08:01.803924] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-19T19:08:01.803833] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:02.199929] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-19T19:08:02.200027] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-19T19:08:02.200949] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-19T19:08:02.201031] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-19T19:08:02.202438] [DEBUG] [LOCAL ] GPRK: Trimmed 57245 records to 39827 (keeping 200 days of data) [2025-09-19T19:08:02.256346] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-19T19:08:02.445521] [DEBUG] [LOCAL ] GPRK: Primary data saved (39827 records). [2025-09-19T19:08:02.445712] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-19T19:08:02.446794] [INFO ] [MAIN ] Update Progress: 966/2372 symbols completed. GPRK took 31.3s. Estimated remaining: 3h 6m 16s. Rate: 7.5 symbols/min [2025-09-19T19:08:02.622461] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:02.677905] [DEBUG] [LOCAL ] GRND: Loaded 50546 existing records from primary storage. [2025-09-19T19:08:02.678113] [INFO ] [MAIN ] GRND: Loaded 50546 existing records. [2025-09-19T19:08:02.854770] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:08:02.881472] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:02.881760] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-19T19:08:02.881854] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-19T19:08:02.883334] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-19T19:08:02.883398] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-19T19:08:03.048480] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-19T19:08:03.270077] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:03.278187] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-19T19:08:03.843284] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-19T19:08:04.112499] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T19:08:04.486904] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-19T19:08:04.643257] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-19T19:08:05.443278] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-19T19:08:05.534991] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T19:08:05.536988] [INFO ] [REMOTE ] GRC: Full fetch complete (12932 records). [2025-09-19T19:08:05.537061] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-19T19:08:05.919865] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-19T19:08:05.919949] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-19T19:08:05.920268] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-19T19:08:05.920310] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-19T19:08:05.920857] [DEBUG] [LOCAL ] GRC: Trimmed 12932 records to 8977 (keeping 200 days of data) [2025-09-19T19:08:05.982473] [DEBUG] [LOCAL ] GRC: Primary data saved (8977 records). [2025-09-19T19:08:05.982660] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-19T19:08:05.982774] [INFO ] [MAIN ] Update Progress: 967/2372 symbols completed. GRC took 23.0s. Estimated remaining: 3h 6m 1s. Rate: 7.6 symbols/min [2025-09-19T19:08:06.149151] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:06.182092] [DEBUG] [LOCAL ] GRNT: Loaded 34239 existing records from primary storage. [2025-09-19T19:08:06.182248] [INFO ] [MAIN ] GRNT: Loaded 34239 existing records. [2025-09-19T19:08:06.248512] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-19T19:08:06.361769] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:06.362046] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-19T19:08:06.362098] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-19T19:08:06.363249] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-19T19:08:06.363311] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-19T19:08:06.724303] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:07.043284] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-19T19:08:07.232128] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T19:08:07.369139] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T19:08:07.843278] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-19T19:08:08.643270] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-19T19:08:08.701667] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T19:08:08.955630] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T19:08:09.443274] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-19T19:08:10.000942] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T19:08:10.230102] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T19:08:10.243222] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-19T19:08:11.043288] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-19T19:08:11.404622] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T19:08:11.843264] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-19T19:08:12.454931] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:08:12.643264] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-19T19:08:13.410260] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:08:13.443235] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-19T19:08:14.243290] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-19T19:08:14.558922] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:08:14.741945] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T19:08:15.043279] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-19T19:08:15.843309] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-19T19:08:16.066245] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T19:08:16.643268] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-19T19:08:16.693781] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:08:17.443309] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-19T19:08:17.819887] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T19:08:18.070485] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T19:08:18.243257] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-19T19:08:18.664427] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T19:08:19.043264] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-19T19:08:19.730400] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T19:08:19.843279] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-19T19:08:20.466753] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T19:08:20.643261] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-19T19:08:21.072611] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T19:08:21.443282] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-19T19:08:22.096729] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T19:08:22.243263] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-19T19:08:23.043274] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-19T19:08:23.125874] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:08:23.843313] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-19T19:08:24.231024] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:08:24.573751] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:08:24.578596] [INFO ] [REMOTE ] GRDN: Full fetch complete (25738 records). [2025-09-19T19:08:24.578761] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-19T19:08:24.648430] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-19T19:08:24.981750] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-19T19:08:24.981891] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-19T19:08:24.982622] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-19T19:08:24.982721] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-19T19:08:24.983578] [DEBUG] [LOCAL ] GRDN: Trimmed 25738 records to 19583 (keeping 200 days of data) [2025-09-19T19:08:25.107701] [DEBUG] [LOCAL ] GRDN: Primary data saved (19583 records). [2025-09-19T19:08:25.107849] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-19T19:08:25.107961] [INFO ] [MAIN ] Update Progress: 968/2372 symbols completed. GRDN took 33.6s. Estimated remaining: 3h 6m 9s. Rate: 7.5 symbols/min [2025-09-19T19:08:25.278323] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:25.289225] [DEBUG] [LOCAL ] GROV: Loaded 9242 existing records from primary storage. [2025-09-19T19:08:25.289338] [INFO ] [MAIN ] GROV: Loaded 9242 existing records. [2025-09-19T19:08:25.448037] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-19T19:08:25.469544] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:25.470840] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-19T19:08:25.470892] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-19T19:08:25.471256] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-19T19:08:25.471375] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-19T19:08:25.853370] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T19:08:25.893836] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:26.061282] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T19:08:26.243302] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-19T19:08:26.907822] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T19:08:27.043314] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-19T19:08:27.331023] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T19:08:27.843314] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-19T19:08:28.643273] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-19T19:08:29.030805] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:08:29.066487] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T19:08:29.443267] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-19T19:08:29.854291] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:08:30.243320] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-19T19:08:30.995866] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:08:31.043224] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-19T19:08:31.285878] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T19:08:31.843282] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-19T19:08:32.500903] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T19:08:32.643240] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-19T19:08:32.955918] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T19:08:33.443262] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-19T19:08:33.833523] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T19:08:34.243270] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-19T19:08:35.043262] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-19T19:08:35.375879] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T19:08:35.483573] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T19:08:35.843295] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-19T19:08:36.388135] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T19:08:36.643274] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-19T19:08:36.760866] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T19:08:37.443307] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-19T19:08:38.136432] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:08:38.148827] [INFO ] [REMOTE ] GRND: Full fetch complete (70139 records). [2025-09-19T19:08:38.149088] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-19T19:08:38.251254] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-19T19:08:38.548715] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-19T19:08:38.548833] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-19T19:08:38.549877] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-19T19:08:38.549973] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-19T19:08:38.551532] [DEBUG] [LOCAL ] GRND: Trimmed 70139 records to 50876 (keeping 200 days of data) [2025-09-19T19:08:38.875589] [DEBUG] [LOCAL ] GRND: Primary data saved (50876 records). [2025-09-19T19:08:38.875768] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-19T19:08:38.876214] [INFO ] [MAIN ] Update Progress: 969/2372 symbols completed. GRND took 36.4s. Estimated remaining: 3h 6m 10s. Rate: 7.5 symbols/min [2025-09-19T19:08:39.057573] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:39.053850] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-19T19:08:39.075523] [DEBUG] [LOCAL ] GRX: Loaded 4423 existing records from primary storage. [2025-09-19T19:08:39.075697] [INFO ] [MAIN ] GRX: Loaded 4423 existing records. [2025-09-19T19:08:39.258470] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:39.259323] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-19T19:08:39.259403] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-19T19:08:39.259894] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-19T19:08:39.259991] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-19T19:08:39.356477] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:08:39.391807] [INFO ] [REMOTE ] GRMN: Full fetch complete (60315 records). [2025-09-19T19:08:39.431725] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-19T19:08:39.572352] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:08:39.639106] [INFO ] [REMOTE ] GRNT: Full fetch complete (48407 records). [2025-09-19T19:08:39.644448] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-19T19:08:40.102891] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:40.164844] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-19T19:08:40.211391] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T19:08:40.383044] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-19T19:08:40.399292] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-19T19:08:40.408270] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-19T19:08:40.408359] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-19T19:08:40.462278] [DEBUG] [LOCAL ] GRMN: Trimmed 60315 records to 42296 (keeping 200 days of data) [2025-09-19T19:08:40.556353] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-19T19:08:40.565963] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-19T19:08:40.566886] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-19T19:08:40.593007] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-19T19:08:40.608014] [DEBUG] [LOCAL ] GRNT: Trimmed 48407 records to 34483 (keeping 200 days of data) [2025-09-19T19:08:40.671334] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-19T19:08:40.968197] [DEBUG] [LOCAL ] GRNT: Primary data saved (34483 records). [2025-09-19T19:08:40.969174] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-19T19:08:40.969808] [INFO ] [MAIN ] Update Progress: 970/2372 symbols completed. GRNT took 35.0s. Estimated remaining: 3h 5m 53s. Rate: 7.5 symbols/min [2025-09-19T19:08:41.119567] [DEBUG] [LOCAL ] GRMN: Primary data saved (42296 records). [2025-09-19T19:08:41.136321] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-19T19:08:41.131028] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:08:41.136628] [INFO ] [MAIN ] Update Progress: 971/2372 symbols completed. GRMN took 40.2s. Estimated remaining: 3h 5m 34s. Rate: 7.5 symbols/min [2025-09-19T19:08:41.338592] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:41.439960] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:41.443250] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-19T19:08:41.526027] [DEBUG] [LOCAL ] GSBD: Loaded 39568 existing records from primary storage. [2025-09-19T19:08:41.526916] [INFO ] [MAIN ] GSBD: Loaded 39568 existing records. [2025-09-19T19:08:41.527198] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T19:08:41.528426] [DEBUG] [LOCAL ] GS: Loaded 52557 existing records from primary storage. [2025-09-19T19:08:41.561083] [INFO ] [MAIN ] GS: Loaded 52557 existing records. [2025-09-19T19:08:41.910766] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:41.917213] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-19T19:08:41.917314] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-19T19:08:41.916968] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:41.917591] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-19T19:08:41.917673] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-19T19:08:41.918415] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-19T19:08:41.918506] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-19T19:08:41.952317] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-19T19:08:41.969778] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-19T19:08:42.033156] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-19T19:08:42.263898] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-19T19:08:42.674159] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:42.669060] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:43.043274] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-19T19:08:43.548992] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T19:08:43.843273] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-19T19:08:44.643283] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-19T19:08:44.924251] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T19:08:45.334840] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T19:08:45.443271] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-19T19:08:45.708940] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T19:08:46.243283] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-19T19:08:47.043272] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-19T19:08:47.796539] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T19:08:47.843226] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-19T19:08:47.952757] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T19:08:48.231164] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:08:48.643287] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-19T19:08:49.443325] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-19T19:08:50.037492] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-19T19:08:50.083761] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-19T19:08:50.243259] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-19T19:08:50.291812] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T19:08:51.043291] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-19T19:08:51.843296] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-19T19:08:52.646297] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T19:08:52.646098] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-19T19:08:52.648999] [INFO ] [REMOTE ] GROV: Full fetch complete (14758 records). [2025-09-19T19:08:52.649139] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-19T19:08:52.791865] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-19T19:08:53.076038] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-19T19:08:53.076282] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-19T19:08:53.076692] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-19T19:08:53.076870] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-19T19:08:53.077609] [DEBUG] [LOCAL ] GROV: Trimmed 14758 records to 9258 (keeping 200 days of data) [2025-09-19T19:08:53.146798] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T19:08:53.166717] [DEBUG] [LOCAL ] GROV: Primary data saved (9258 records). [2025-09-19T19:08:53.166830] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-19T19:08:53.166911] [INFO ] [MAIN ] Update Progress: 972/2372 symbols completed. GROV took 28.1s. Estimated remaining: 3h 5m 32s. Rate: 7.5 symbols/min [2025-09-19T19:08:53.335720] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:53.402270] [DEBUG] [LOCAL ] GSK: Loaded 53892 existing records from primary storage. [2025-09-19T19:08:53.402432] [INFO ] [MAIN ] GSK: Loaded 53892 existing records. [2025-09-19T19:08:53.446598] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-19T19:08:53.524088] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T19:08:53.606102] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:53.606422] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-19T19:08:53.606472] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-19T19:08:53.607980] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-19T19:08:53.608044] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-19T19:08:53.974697] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:54.243268] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-19T19:08:55.043245] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-19T19:08:55.365172] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T19:08:55.843308] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-19T19:08:56.301330] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T19:08:56.643278] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-19T19:08:57.443239] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-19T19:08:57.489731] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T19:08:57.600493] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:08:58.187162] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:08:58.243405] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-19T19:08:58.684495] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T19:08:59.043382] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-19T19:08:59.843265] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-19T19:09:00.647421] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-19T19:09:00.651317] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-19T19:09:00.686806] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:09:01.309759] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T19:09:01.443256] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-19T19:09:01.564216] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T19:09:02.243321] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-19T19:09:03.043298] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-19T19:09:03.843279] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-19T19:09:04.493460] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T19:09:04.643262] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-19T19:09:05.236338] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-09-19T19:09:05.251213] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T19:09:05.388400] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (3.95 seconds). [2025-09-19T19:09:05.443219] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-19T19:09:06.031415] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-09-19T19:09:06.243297] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-19T19:09:07.043302] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-19T19:09:07.558266] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:09:07.843304] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-19T19:09:08.554901] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T19:09:08.643251] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-19T19:09:08.701815] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T19:09:09.443307] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-19T19:09:10.211616] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T19:09:10.243246] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-19T19:09:10.834593] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T19:09:11.035086] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:09:11.041422] [INFO ] [REMOTE ] GSBD: Full fetch complete (58411 records). [2025-09-19T19:09:11.041597] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-19T19:09:11.053999] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-19T19:09:11.453502] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-19T19:09:11.453764] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-19T19:09:11.454850] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-19T19:09:11.454926] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-19T19:09:11.456770] [DEBUG] [LOCAL ] GSBD: Trimmed 58411 records to 39847 (keeping 200 days of data) [2025-09-19T19:09:11.732135] [DEBUG] [LOCAL ] GSBD: Primary data saved (39847 records). [2025-09-19T19:09:11.732334] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-19T19:09:11.732518] [INFO ] [MAIN ] Update Progress: 973/2372 symbols completed. GSBD took 30.6s. Estimated remaining: 3h 5m 39s. Rate: 7.5 symbols/min [2025-09-19T19:09:11.853389] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-19T19:09:11.939625] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:11.963602] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T19:09:11.976118] [INFO ] [REMOTE ] GRX: Full fetch complete (6479 records). [2025-09-19T19:09:11.976357] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-19T19:09:12.144848] [DEBUG] [LOCAL ] GSL: Loaded 34128 existing records from primary storage. [2025-09-19T19:09:12.161123] [INFO ] [MAIN ] GSL: Loaded 34128 existing records. [2025-09-19T19:09:12.516998] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-19T19:09:12.529412] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-19T19:09:12.535093] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-19T19:09:12.540668] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-19T19:09:12.574942] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:12.575265] [DEBUG] [LOCAL ] GRX: Trimmed 6479 records to 4454 (keeping 200 days of data) [2025-09-19T19:09:12.597407] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-19T19:09:12.598287] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-19T19:09:12.612308] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T19:09:12.612598] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-19T19:09:12.622993] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-19T19:09:12.641723] [INFO ] [REMOTE ] GS: Full fetch complete (75895 records). [2025-09-19T19:09:12.661724] [DEBUG] [LOCAL ] GRX: Primary data saved (4454 records). [2025-09-19T19:09:12.674320] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-19T19:09:12.693097] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-19T19:09:12.693543] [INFO ] [MAIN ] Update Progress: 974/2372 symbols completed. GRX took 33.8s. Estimated remaining: 3h 5m 21s. Rate: 7.5 symbols/min [2025-09-19T19:09:13.363517] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:13.581817] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:13.586517] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-19T19:09:13.690015] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-19T19:09:13.690327] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-19T19:09:13.705037] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-19T19:09:13.705195] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-19T19:09:13.706959] [DEBUG] [LOCAL ] GS: Trimmed 75895 records to 52916 (keeping 200 days of data) [2025-09-19T19:09:13.791379] [DEBUG] [LOCAL ] GTES: Loaded 51111 existing records from primary storage. [2025-09-19T19:09:13.819508] [INFO ] [MAIN ] GTES: Loaded 51111 existing records. [2025-09-19T19:09:14.035228] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:14.036840] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-19T19:09:14.039521] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-19T19:09:14.101284] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-19T19:09:14.110625] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-19T19:09:14.562005] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:14.564420] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-19T19:09:14.661427] [DEBUG] [LOCAL ] GS: Primary data saved (52916 records). [2025-09-19T19:09:14.661556] [INFO ] [MAIN ] GS: Full history saved. [2025-09-19T19:09:14.661671] [INFO ] [MAIN ] Update Progress: 975/2372 symbols completed. GS took 33.7s. Estimated remaining: 3h 5m 5s. Rate: 7.5 symbols/min [2025-09-19T19:09:14.829032] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:14.877214] [DEBUG] [LOCAL ] GTLS: Loaded 43542 existing records from primary storage. [2025-09-19T19:09:14.877375] [INFO ] [MAIN ] GTLS: Loaded 43542 existing records. [2025-09-19T19:09:15.056848] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:15.057220] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-19T19:09:15.057298] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-19T19:09:15.058674] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-19T19:09:15.058739] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-19T19:09:15.392408] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (3.54 seconds). [2025-09-19T19:09:15.455119] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-19T19:09:15.499325] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:15.499673] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-19T19:09:16.010513] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T19:09:16.017531] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-19T19:09:16.053585] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T19:09:16.643288] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-19T19:09:16.743933] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:09:17.260037] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T19:09:17.397810] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T19:09:17.443228] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-19T19:09:18.243272] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-19T19:09:18.393007] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T19:09:19.043233] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-19T19:09:19.533445] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:09:19.625833] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T19:09:19.843264] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-19T19:09:20.643266] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-19T19:09:20.788457] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T19:09:21.443274] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-19T19:09:21.526981] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:09:22.243259] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-19T19:09:22.705814] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T19:09:22.801214] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T19:09:22.810172] [INFO ] [REMOTE ] GSK: Full fetch complete (77480 records). [2025-09-19T19:09:22.810300] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-19T19:09:23.048434] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-19T19:09:23.202797] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-19T19:09:23.202896] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-19T19:09:23.203874] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-19T19:09:23.203976] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-19T19:09:23.205675] [DEBUG] [LOCAL ] GSK: Trimmed 77480 records to 54278 (keeping 200 days of data) [2025-09-19T19:09:23.565002] [DEBUG] [LOCAL ] GSK: Primary data saved (54278 records). [2025-09-19T19:09:23.565202] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-19T19:09:23.565314] [INFO ] [MAIN ] Update Progress: 976/2372 symbols completed. GSK took 30.4s. Estimated remaining: 3h 4m 58s. Rate: 7.5 symbols/min [2025-09-19T19:09:23.789826] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:23.834975] [DEBUG] [LOCAL ] GTN: Loaded 46167 existing records from primary storage. [2025-09-19T19:09:23.835134] [INFO ] [MAIN ] GTN: Loaded 46167 existing records. [2025-09-19T19:09:23.866584] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-19T19:09:24.025430] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T19:09:24.073491] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:24.073781] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-19T19:09:24.073850] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-19T19:09:24.075225] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-19T19:09:24.075290] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-19T19:09:24.449662] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:24.643321] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-19T19:09:24.864486] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T19:09:25.443251] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-19T19:09:25.978933] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:09:26.034060] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T19:09:26.243269] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-19T19:09:26.818457] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T19:09:27.043272] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-19T19:09:27.848774] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-19T19:09:27.855973] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T19:09:28.643278] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-19T19:09:28.866481] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T19:09:29.218472] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:09:29.443277] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-19T19:09:30.202210] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T19:09:30.243224] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-19T19:09:30.921578] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T19:09:31.043267] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-19T19:09:31.843272] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-19T19:09:31.865832] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T19:09:32.391168] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T19:09:32.643265] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-19T19:09:33.443265] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-19T19:09:33.590337] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T19:09:34.045496] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T19:09:34.243297] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-19T19:09:35.043269] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-19T19:09:35.084970] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T19:09:35.659786] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T19:09:35.843232] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-19T19:09:36.643253] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-19T19:09:36.818873] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T19:09:37.309145] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T19:09:37.443278] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-19T19:09:37.778199] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T19:09:37.783344] [INFO ] [REMOTE ] GSL: Full fetch complete (48298 records). [2025-09-19T19:09:37.783453] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-19T19:09:38.157858] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-19T19:09:38.157945] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-19T19:09:38.158639] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-19T19:09:38.158727] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-19T19:09:38.159755] [DEBUG] [LOCAL ] GSL: Trimmed 48298 records to 34370 (keeping 200 days of data) [2025-09-19T19:09:38.247465] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-19T19:09:38.370579] [DEBUG] [LOCAL ] GSL: Primary data saved (34370 records). [2025-09-19T19:09:38.370750] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-19T19:09:38.370846] [INFO ] [MAIN ] Update Progress: 977/2372 symbols completed. GSL took 26.6s. Estimated remaining: 3h 5m 0s. Rate: 7.5 symbols/min [2025-09-19T19:09:38.536603] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:38.567061] [DEBUG] [LOCAL ] GTY: Loaded 30629 existing records from primary storage. [2025-09-19T19:09:38.567233] [INFO ] [MAIN ] GTY: Loaded 30629 existing records. [2025-09-19T19:09:38.747895] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:38.748198] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-19T19:09:38.748253] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-19T19:09:38.749207] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-19T19:09:38.749268] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-19T19:09:39.044698] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-19T19:09:39.125720] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:39.149748] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T19:09:39.158554] [INFO ] [REMOTE ] GTES: Full fetch complete (74009 records). [2025-09-19T19:09:39.158805] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-19T19:09:39.555858] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-19T19:09:39.556086] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-19T19:09:39.557116] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-19T19:09:39.557199] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-19T19:09:39.558823] [DEBUG] [LOCAL ] GTES: Trimmed 74009 records to 51492 (keeping 200 days of data) [2025-09-19T19:09:39.668313] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T19:09:39.852684] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-19T19:09:39.895470] [DEBUG] [LOCAL ] GTES: Primary data saved (51492 records). [2025-09-19T19:09:39.895591] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-19T19:09:39.895696] [INFO ] [MAIN ] Update Progress: 978/2372 symbols completed. GTES took 27.2s. Estimated remaining: 3h 4m 43s. Rate: 7.5 symbols/min [2025-09-19T19:09:40.067902] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:40.081585] [DEBUG] [LOCAL ] GUG: Loaded 12397 existing records from primary storage. [2025-09-19T19:09:40.081748] [INFO ] [MAIN ] GUG: Loaded 12397 existing records. [2025-09-19T19:09:40.261464] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:40.261747] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-19T19:09:40.261813] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-19T19:09:40.262248] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-19T19:09:40.262306] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-19T19:09:40.621220] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:40.645266] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-19T19:09:40.647688] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T19:09:40.678182] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T19:09:41.443261] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-19T19:09:42.104303] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T19:09:42.243253] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-19T19:09:43.043263] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-19T19:09:43.324079] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T19:09:43.703418] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T19:09:43.843214] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-19T19:09:44.287879] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:09:44.643262] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-19T19:09:45.309247] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:09:45.443264] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-19T19:09:45.907776] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T19:09:46.243275] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-19T19:09:47.043319] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-19T19:09:47.197535] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T19:09:47.381079] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T19:09:47.388435] [INFO ] [REMOTE ] GTLS: Full fetch complete (61451 records). [2025-09-19T19:09:47.388605] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-19T19:09:47.773221] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-19T19:09:47.773362] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-19T19:09:47.774208] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-19T19:09:47.774270] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-19T19:09:47.775476] [DEBUG] [LOCAL ] GTLS: Trimmed 61451 records to 43830 (keeping 200 days of data) [2025-09-19T19:09:47.860845] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-19T19:09:48.040368] [DEBUG] [LOCAL ] GTLS: Primary data saved (43830 records). [2025-09-19T19:09:48.040499] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-19T19:09:48.040582] [INFO ] [MAIN ] Update Progress: 979/2372 symbols completed. GTLS took 33.4s. Estimated remaining: 3h 4m 35s. Rate: 7.5 symbols/min [2025-09-19T19:09:48.217696] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:48.237871] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T19:09:48.255179] [DEBUG] [LOCAL ] GUT: Loaded 15707 existing records from primary storage. [2025-09-19T19:09:48.255286] [INFO ] [MAIN ] GUT: Loaded 15707 existing records. [2025-09-19T19:09:48.431064] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:48.431308] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-19T19:09:48.431367] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-19T19:09:48.431960] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-19T19:09:48.432020] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-19T19:09:48.652029] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-19T19:09:48.789409] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:49.443284] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-19T19:09:49.655122] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T19:09:49.757533] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T19:09:50.243278] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-19T19:09:50.633621] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T19:09:51.043283] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-19T19:09:51.401830] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T19:09:51.843295] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-19T19:09:52.643282] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-19T19:09:52.941316] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T19:09:53.443285] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-19T19:09:53.478766] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T19:09:53.595551] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T19:09:54.160905] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T19:09:54.243245] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-19T19:09:55.043281] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-19T19:09:55.395016] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T19:09:55.843264] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-19T19:09:56.606555] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T19:09:56.643220] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-19T19:09:56.975671] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T19:09:57.443220] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-19T19:09:57.990516] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T19:09:58.243274] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-19T19:09:59.043260] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-19T19:09:59.353231] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T19:09:59.531437] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:09:59.843292] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-19T19:09:59.882898] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T19:10:00.643253] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-19T19:10:00.757496] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T19:10:01.443289] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-19T19:10:02.243326] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-19T19:10:02.575056] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:10:02.656413] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T19:10:02.664556] [INFO ] [REMOTE ] GTN: Full fetch complete (66391 records). [2025-09-19T19:10:02.664812] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-19T19:10:03.048361] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-19T19:10:03.096836] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-19T19:10:03.096932] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-19T19:10:03.097916] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-19T19:10:03.097989] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-19T19:10:03.100864] [DEBUG] [LOCAL ] GTN: Trimmed 66391 records to 46463 (keeping 200 days of data) [2025-09-19T19:10:03.392881] [DEBUG] [LOCAL ] GTN: Primary data saved (46463 records). [2025-09-19T19:10:03.393119] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-19T19:10:03.393399] [INFO ] [MAIN ] Update Progress: 980/2372 symbols completed. GTN took 39.8s. Estimated remaining: 3h 4m 38s. Rate: 7.5 symbols/min [2025-09-19T19:10:03.569418] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:03.605702] [DEBUG] [LOCAL ] GVA: Loaded 34379 existing records from primary storage. [2025-09-19T19:10:03.605857] [INFO ] [MAIN ] GVA: Loaded 34379 existing records. [2025-09-19T19:10:03.791801] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:03.792398] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-19T19:10:03.792489] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-19T19:10:03.793534] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-19T19:10:03.793602] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-19T19:10:03.853918] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-19T19:10:04.000218] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T19:10:04.215173] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:04.380143] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:10:04.491920] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T19:10:04.643261] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-19T19:10:05.443278] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-19T19:10:06.243258] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-19T19:10:06.326253] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T19:10:06.866399] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T19:10:07.014365] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T19:10:07.043215] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-19T19:10:07.843308] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-19T19:10:08.165611] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T19:10:08.643270] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-19T19:10:08.905288] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T19:10:09.443272] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-19T19:10:09.797390] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T19:10:09.800106] [INFO ] [REMOTE ] GUT: Full fetch complete (23107 records). [2025-09-19T19:10:09.800210] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-19T19:10:10.167991] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-19T19:10:10.168097] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-19T19:10:10.168611] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-19T19:10:10.169300] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-19T19:10:10.170002] [DEBUG] [LOCAL ] GUT: Trimmed 23107 records to 15779 (keeping 200 days of data) [2025-09-19T19:10:10.243324] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-19T19:10:10.266717] [DEBUG] [LOCAL ] GUT: Primary data saved (15779 records). [2025-09-19T19:10:10.266829] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-19T19:10:10.266934] [INFO ] [MAIN ] Update Progress: 981/2372 symbols completed. GUT took 22.2s. Estimated remaining: 3h 4m 28s. Rate: 7.5 symbols/min [2025-09-19T19:10:10.439131] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:10.439343] [DEBUG] [LOCAL ] GWH: No existing data file found in primary storage. [2025-09-19T19:10:10.439404] [WARN ] [MAIN ] GWH: No existing data found, performing full refresh instead. [2025-09-19T19:10:10.439555] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-19T19:10:10.439598] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-19T19:10:10.439660] [DEBUG] [LOCAL ] GWH: No primary data file found to delete. [2025-09-19T19:10:10.439719] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-19T19:10:10.797799] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:11.043285] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-19T19:10:11.240446] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T19:10:11.843257] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-19T19:10:12.017675] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:10:12.643252] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-19T19:10:13.444940] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-19T19:10:13.454332] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T19:10:13.623427] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T19:10:14.146824] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T19:10:14.243292] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-19T19:10:15.043289] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-19T19:10:15.843252] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-19T19:10:15.905286] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T19:10:15.953231] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (5.71 seconds). [2025-09-19T19:10:15.962968] [INFO ] [REMOTE ] GTY: Full fetch complete (43037 records). [2025-09-19T19:10:15.963694] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-19T19:10:15.963613] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T19:10:15.997666] [INFO ] [REMOTE ] GUG: Full fetch complete (20015 records). [2025-09-19T19:10:16.030172] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-19T19:10:16.644393] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-19T19:10:16.655328] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-19T19:10:16.665741] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-19T19:10:16.693049] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T19:10:16.703520] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-19T19:10:16.741897] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-19T19:10:16.742676] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-19T19:10:16.742754] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-19T19:10:16.743003] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-19T19:10:16.743252] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-19T19:10:16.744211] [DEBUG] [LOCAL ] GUG: Trimmed 20015 records to 12453 (keeping 200 days of data) [2025-09-19T19:10:16.744123] [DEBUG] [LOCAL ] GTY: Trimmed 43037 records to 30827 (keeping 200 days of data) [2025-09-19T19:10:16.934792] [DEBUG] [LOCAL ] GUG: Primary data saved (12453 records). [2025-09-19T19:10:16.935409] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-19T19:10:16.935833] [INFO ] [MAIN ] Update Progress: 982/2372 symbols completed. GUG took 37.0s. Estimated remaining: 3h 4m 19s. Rate: 7.5 symbols/min [2025-09-19T19:10:17.162782] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:17.179030] [DEBUG] [LOCAL ] GTY: Primary data saved (30827 records). [2025-09-19T19:10:17.179156] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-19T19:10:17.179261] [INFO ] [MAIN ] Update Progress: 983/2372 symbols completed. GTY took 38.8s. Estimated remaining: 3h 3m 60s. Rate: 7.5 symbols/min [2025-09-19T19:10:17.372386] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:17.374279] [DEBUG] [LOCAL ] GWRE: Loaded 41721 existing records from primary storage. [2025-09-19T19:10:17.374451] [INFO ] [MAIN ] GWRE: Loaded 41721 existing records. [2025-09-19T19:10:17.443883] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-19T19:10:17.569623] [DEBUG] [LOCAL ] GWW: Loaded 20219 existing records from primary storage. [2025-09-19T19:10:17.569229] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:17.569927] [INFO ] [MAIN ] GWW: Loaded 20219 existing records. [2025-09-19T19:10:17.569866] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-19T19:10:17.570024] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-19T19:10:17.612674] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-19T19:10:17.634029] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-19T19:10:17.918093] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:17.951665] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-19T19:10:17.962692] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-19T19:10:18.015868] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-19T19:10:18.036726] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-19T19:10:18.234859] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:18.259069] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-19T19:10:18.433536] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T19:10:18.487584] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:18.726064] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T19:10:19.043292] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-19T19:10:19.843275] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-19T19:10:20.310942] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T19:10:20.586555] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T19:10:20.643285] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-19T19:10:21.429917] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:10:21.443213] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-19T19:10:22.107456] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T19:10:22.243262] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-19T19:10:22.787799] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:10:23.043262] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-19T19:10:23.767790] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T19:10:23.843240] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-19T19:10:24.419497] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T19:10:24.643253] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-19T19:10:25.406639] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:10:25.444101] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T19:10:25.443621] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-19T19:10:26.243267] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-19T19:10:26.993386] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:10:27.043243] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-19T19:10:27.597919] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:10:27.843268] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-19T19:10:28.643299] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-19T19:10:28.869406] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:10:28.893329] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T19:10:29.443265] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-19T19:10:30.243253] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-19T19:10:30.662601] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T19:10:30.747435] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T19:10:31.043270] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-19T19:10:31.149063] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T19:10:31.843290] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-19T19:10:32.643260] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-19T19:10:32.763782] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T19:10:33.153677] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:10:33.407515] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T19:10:33.443251] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-19T19:10:34.243279] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-19T19:10:34.866767] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T19:10:35.043249] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-19T19:10:35.565535] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T19:10:35.843256] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-19T19:10:35.936434] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T19:10:36.643273] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-19T19:10:37.443280] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-19T19:10:37.640612] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:10:38.225914] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T19:10:38.231981] [INFO ] [REMOTE ] GVA: Full fetch complete (48872 records). [2025-09-19T19:10:38.232101] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-19T19:10:38.248437] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-19T19:10:38.630261] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-19T19:10:38.630354] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-19T19:10:38.631123] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-19T19:10:38.631187] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-19T19:10:38.632386] [DEBUG] [LOCAL ] GVA: Trimmed 48872 records to 34588 (keeping 200 days of data) [2025-09-19T19:10:38.849847] [DEBUG] [LOCAL ] GVA: Primary data saved (34588 records). [2025-09-19T19:10:38.850015] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-19T19:10:38.850124] [INFO ] [MAIN ] Update Progress: 984/2372 symbols completed. GVA took 35.5s. Estimated remaining: 3h 4m 11s. Rate: 7.5 symbols/min [2025-09-19T19:10:39.032769] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:39.049738] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-19T19:10:39.051236] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T19:10:39.100467] [DEBUG] [LOCAL ] GXO: Loaded 48164 existing records from primary storage. [2025-09-19T19:10:39.100663] [INFO ] [MAIN ] GXO: Loaded 48164 existing records. [2025-09-19T19:10:39.283362] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:39.283622] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-19T19:10:39.283705] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-19T19:10:39.285241] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-19T19:10:39.285305] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-19T19:10:39.660892] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:39.843291] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-19T19:10:40.093001] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T19:10:40.508827] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T19:10:40.512388] [INFO ] [REMOTE ] GWW: Full fetch complete (29126 records). [2025-09-19T19:10:40.512483] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-19T19:10:40.653130] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-19T19:10:40.886882] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-19T19:10:40.886964] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-19T19:10:40.887548] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-19T19:10:40.887621] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-19T19:10:40.888410] [DEBUG] [LOCAL ] GWW: Trimmed 29126 records to 20360 (keeping 200 days of data) [2025-09-19T19:10:41.029143] [DEBUG] [LOCAL ] GWW: Primary data saved (20360 records). [2025-09-19T19:10:41.029274] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-19T19:10:41.029358] [INFO ] [MAIN ] Update Progress: 985/2372 symbols completed. GWW took 23.8s. Estimated remaining: 3h 3m 55s. Rate: 7.5 symbols/min [2025-09-19T19:10:41.199297] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:41.202592] [DEBUG] [LOCAL ] GYLD: Loaded 1538 existing records from primary storage. [2025-09-19T19:10:41.202695] [INFO ] [MAIN ] GYLD: Loaded 1538 existing records. [2025-09-19T19:10:41.381813] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:41.382182] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-19T19:10:41.382288] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-19T19:10:41.382556] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-19T19:10:41.382625] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-19T19:10:41.445872] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-19T19:10:41.781261] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T19:10:41.831335] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:42.169693] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T19:10:42.243268] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-19T19:10:43.043282] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-19T19:10:43.134277] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T19:10:43.137138] [INFO ] [REMOTE ] GWH: Full fetch complete (20491 records). [2025-09-19T19:10:43.137298] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-19T19:10:43.354841] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T19:10:43.528946] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T19:10:43.716351] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-19T19:10:43.716480] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-19T19:10:43.717413] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-19T19:10:43.717497] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-19T19:10:43.718983] [DEBUG] [LOCAL ] GWH: Trimmed 20491 records to 15335 (keeping 200 days of data) [2025-09-19T19:10:43.849094] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-19T19:10:43.849480] [DEBUG] [LOCAL ] GWH: Primary data saved (15335 records). [2025-09-19T19:10:43.849850] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-19T19:10:43.851323] [INFO ] [MAIN ] Update Progress: 986/2372 symbols completed. GWH took 33.6s. Estimated remaining: 3h 3m 40s. Rate: 7.5 symbols/min [2025-09-19T19:10:44.119533] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:44.194314] [DEBUG] [LOCAL ] H: Loaded 45362 existing records from primary storage. [2025-09-19T19:10:44.194570] [INFO ] [MAIN ] H: Loaded 45362 existing records. [2025-09-19T19:10:44.382758] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-19T19:10:44.430600] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:44.430994] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-19T19:10:44.431058] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-19T19:10:44.432333] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-19T19:10:44.432406] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-19T19:10:44.649786] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-19T19:10:44.822538] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:45.173499] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-19T19:10:45.443268] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-19T19:10:46.037509] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-19T19:10:46.243274] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-19T19:10:46.829795] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-19T19:10:47.043264] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-19T19:10:47.843268] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-19T19:10:48.643275] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-19T19:10:48.975579] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T19:10:48.985614] [INFO ] [REMOTE ] GWRE: Full fetch complete (61724 records). [2025-09-19T19:10:48.985779] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-19T19:10:49.086693] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-19T19:10:49.384477] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-19T19:10:49.384562] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-19T19:10:49.385394] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-19T19:10:49.385456] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-19T19:10:49.386741] [DEBUG] [LOCAL ] GWRE: Trimmed 61724 records to 41935 (keeping 200 days of data) [2025-09-19T19:10:49.445541] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-19T19:10:49.649533] [DEBUG] [LOCAL ] GWRE: Primary data saved (41935 records). [2025-09-19T19:10:49.649689] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-19T19:10:49.650978] [INFO ] [MAIN ] Update Progress: 987/2372 symbols completed. GWRE took 32.7s. Estimated remaining: 3h 3m 29s. Rate: 7.5 symbols/min [2025-09-19T19:10:49.849829] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:49.854835] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:10:49.913197] [DEBUG] [LOCAL ] HAE: Loaded 39825 existing records from primary storage. [2025-09-19T19:10:49.913367] [INFO ] [MAIN ] HAE: Loaded 39825 existing records. [2025-09-19T19:10:50.017303] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T19:10:50.109739] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:50.110067] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-19T19:10:50.110129] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-19T19:10:50.111134] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-19T19:10:50.111205] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-19T19:10:50.255429] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-19T19:10:50.477827] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:50.867031] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T19:10:51.043260] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-19T19:10:51.843341] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-19T19:10:52.643262] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-19T19:10:52.836556] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T19:10:53.366625] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T19:10:53.389301] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T19:10:53.443276] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-19T19:10:54.243290] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-19T19:10:55.043267] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-19T19:10:55.335114] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T19:10:55.843286] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-19T19:10:56.016502] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T19:10:56.173548] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T19:10:56.643308] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-19T19:10:57.247756] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-19T19:10:57.249132] [INFO ] [REMOTE ] GYLD: Full fetch complete (2039 records). [2025-09-19T19:10:57.249276] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-19T19:10:57.448541] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-19T19:10:57.656082] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-19T19:10:57.656441] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-19T19:10:57.656749] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-19T19:10:57.656881] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-19T19:10:57.657600] [DEBUG] [LOCAL ] GYLD: Trimmed 2039 records to 1576 (keeping 200 days of data) [2025-09-19T19:10:57.669891] [DEBUG] [LOCAL ] GYLD: Primary data saved (1576 records). [2025-09-19T19:10:57.669957] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-19T19:10:57.670088] [INFO ] [MAIN ] Update Progress: 988/2372 symbols completed. GYLD took 16.6s. Estimated remaining: 3h 3m 21s. Rate: 7.5 symbols/min [2025-09-19T19:10:57.860317] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:57.893127] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T19:10:57.957025] [DEBUG] [LOCAL ] HAFN: Loaded 44198 existing records from primary storage. [2025-09-19T19:10:57.957204] [INFO ] [MAIN ] HAFN: Loaded 44198 existing records. [2025-09-19T19:10:58.151805] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:58.152110] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-19T19:10:58.152174] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-19T19:10:58.153362] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-19T19:10:58.153438] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-19T19:10:58.250223] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-19T19:10:58.555921] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:59.054076] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-19T19:10:59.061081] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T19:10:59.843311] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-19T19:11:00.247549] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T19:11:00.643262] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-19T19:11:01.052495] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T19:11:01.366474] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T19:11:01.443272] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-19T19:11:01.847158] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T19:11:02.243279] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-19T19:11:03.043285] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-19T19:11:03.273500] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T19:11:03.430696] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T19:11:03.843299] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-19T19:11:04.643280] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-19T19:11:04.771827] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T19:11:05.443313] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-19T19:11:05.688458] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T19:11:06.078568] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:11:06.243318] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-19T19:11:07.051598] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-19T19:11:07.061810] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T19:11:07.843271] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-19T19:11:08.046508] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:11:08.643283] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-19T19:11:08.926559] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T19:11:09.443291] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-19T19:11:09.504842] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:11:10.041590] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T19:11:10.243316] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-19T19:11:11.043267] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-19T19:11:11.431191] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T19:11:11.563565] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:11:11.843264] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-19T19:11:12.435997] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T19:11:12.643257] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-19T19:11:13.443286] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-19T19:11:13.500750] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T19:11:14.243280] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-19T19:11:14.420498] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T19:11:14.427340] [INFO ] [REMOTE ] H: Full fetch complete (61641 records). [2025-09-19T19:11:14.427536] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-19T19:11:14.820407] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-19T19:11:14.820821] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-19T19:11:14.821920] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-19T19:11:14.822099] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-19T19:11:14.835429] [DEBUG] [LOCAL ] H: Trimmed 61641 records to 45614 (keeping 200 days of data) [2025-09-19T19:11:14.854833] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T19:11:15.053630] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-19T19:11:15.160329] [DEBUG] [LOCAL ] H: Primary data saved (45614 records). [2025-09-19T19:11:15.160469] [INFO ] [MAIN ] H: Full history saved. [2025-09-19T19:11:15.160587] [INFO ] [MAIN ] Update Progress: 989/2372 symbols completed. H took 31.3s. Estimated remaining: 3h 3m 27s. Rate: 7.5 symbols/min [2025-09-19T19:11:15.328204] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:15.395337] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-09-19T19:11:15.395740] [INFO ] [MAIN ] HAL: Loaded 54108 existing records. [2025-09-19T19:11:15.574146] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:15.574470] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-19T19:11:15.574526] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-19T19:11:15.576069] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-19T19:11:15.576131] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-19T19:11:15.852417] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-19T19:11:15.934067] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:16.310525] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T19:11:16.317368] [INFO ] [REMOTE ] GXO: Full fetch complete (70070 records). [2025-09-19T19:11:16.317492] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-19T19:11:16.648431] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-19T19:11:16.722951] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-19T19:11:16.723137] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-19T19:11:16.724064] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-19T19:11:16.724128] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-19T19:11:16.725628] [DEBUG] [LOCAL ] GXO: Trimmed 70070 records to 48518 (keeping 200 days of data) [2025-09-19T19:11:17.031708] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T19:11:17.032821] [DEBUG] [LOCAL ] GXO: Primary data saved (48518 records). [2025-09-19T19:11:17.039960] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-19T19:11:17.040202] [INFO ] [MAIN ] Update Progress: 990/2372 symbols completed. GXO took 38.2s. Estimated remaining: 3h 3m 10s. Rate: 7.5 symbols/min [2025-09-19T19:11:17.218266] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:17.246499] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T19:11:17.298963] [DEBUG] [LOCAL ] HASI: Loaded 47604 existing records from primary storage. [2025-09-19T19:11:17.299121] [INFO ] [MAIN ] HASI: Loaded 47604 existing records. [2025-09-19T19:11:17.448426] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-19T19:11:17.478852] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:17.479136] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-19T19:11:17.479340] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-19T19:11:17.480746] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-19T19:11:17.480807] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-19T19:11:17.841587] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:18.243273] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-19T19:11:18.883220] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T19:11:19.043237] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-19T19:11:19.174060] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T19:11:19.843270] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-19T19:11:19.898967] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T19:11:20.643246] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-19T19:11:21.277448] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T19:11:21.443272] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-19T19:11:21.674176] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:11:21.829475] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T19:11:22.243277] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-19T19:11:22.822143] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T19:11:23.043331] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-19T19:11:23.678537] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T19:11:23.686559] [INFO ] [REMOTE ] HAE: Full fetch complete (57554 records). [2025-09-19T19:11:23.686808] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-19T19:11:23.849717] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-19T19:11:24.094833] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-19T19:11:24.094939] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-19T19:11:24.095770] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-19T19:11:24.095844] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-19T19:11:24.098093] [DEBUG] [LOCAL ] HAE: Trimmed 57554 records to 40186 (keeping 200 days of data) [2025-09-19T19:11:24.339191] [DEBUG] [LOCAL ] HAE: Primary data saved (40186 records). [2025-09-19T19:11:24.339331] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-19T19:11:24.340076] [INFO ] [MAIN ] Update Progress: 991/2372 symbols completed. HAE took 34.7s. Estimated remaining: 3h 3m 1s. Rate: 7.5 symbols/min [2025-09-19T19:11:24.508946] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:24.561433] [DEBUG] [LOCAL ] HAYW: Loaded 49112 existing records from primary storage. [2025-09-19T19:11:24.561605] [INFO ] [MAIN ] HAYW: Loaded 49112 existing records. [2025-09-19T19:11:24.650743] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-19T19:11:24.745260] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:24.745530] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-19T19:11:24.745579] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-19T19:11:24.746766] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-19T19:11:24.746827] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-19T19:11:25.137897] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:25.169479] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T19:11:25.443271] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-19T19:11:25.586920] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:11:25.989236] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:11:26.243275] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-19T19:11:27.043256] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-19T19:11:27.373841] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T19:11:27.699423] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T19:11:27.843268] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-19T19:11:28.275740] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T19:11:28.643260] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-19T19:11:29.051872] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T19:11:29.443317] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-19T19:11:30.243288] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-19T19:11:30.487483] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:11:31.043276] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-19T19:11:31.280735] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:11:31.287016] [INFO ] [REMOTE ] HAFN: Full fetch complete (66131 records). [2025-09-19T19:11:31.287148] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-19T19:11:31.676942] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-19T19:11:31.677064] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-19T19:11:31.677946] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-19T19:11:31.678011] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-19T19:11:31.679389] [DEBUG] [LOCAL ] HAFN: Trimmed 66131 records to 44465 (keeping 200 days of data) [2025-09-19T19:11:31.853858] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-19T19:11:31.949710] [DEBUG] [LOCAL ] HAFN: Primary data saved (44465 records). [2025-09-19T19:11:31.949854] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-19T19:11:31.949952] [INFO ] [MAIN ] Update Progress: 992/2372 symbols completed. HAFN took 34.3s. Estimated remaining: 3h 2m 53s. Rate: 7.5 symbols/min [2025-09-19T19:11:32.125498] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:32.134254] [DEBUG] [LOCAL ] HBB: Loaded 7008 existing records from primary storage. [2025-09-19T19:11:32.134348] [INFO ] [MAIN ] HBB: Loaded 7008 existing records. [2025-09-19T19:11:32.314531] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:32.314906] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-19T19:11:32.315045] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-19T19:11:32.315420] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-19T19:11:32.315523] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-19T19:11:32.688009] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T19:11:32.726119] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:32.727202] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-19T19:11:32.935492] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T19:11:33.283831] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T19:11:33.333266] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T19:11:33.443250] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-19T19:11:34.243312] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-19T19:11:34.860903] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T19:11:35.043277] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-19T19:11:35.211212] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T19:11:35.843270] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-19T19:11:36.140087] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T19:11:36.643348] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-19T19:11:37.443319] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-19T19:11:37.654353] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T19:11:38.233453] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T19:11:38.243204] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-19T19:11:38.507055] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T19:11:39.043858] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-19T19:11:39.601599] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T19:11:39.843274] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-19T19:11:40.643255] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-19T19:11:40.746158] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T19:11:41.443272] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-19T19:11:41.740998] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-19T19:11:42.243269] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-19T19:11:42.432550] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:11:42.877136] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:11:43.043247] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-19T19:11:43.843292] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-19T19:11:44.284910] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T19:11:44.590927] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T19:11:44.643266] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-19T19:11:44.992717] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T19:11:45.443279] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-19T19:11:45.547798] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T19:11:46.243266] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-19T19:11:47.043268] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-19T19:11:47.098194] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T19:11:47.469757] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T19:11:47.843200] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-19T19:11:48.559239] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T19:11:48.560458] [INFO ] [REMOTE ] HBB: Full fetch complete (10087 records). [2025-09-19T19:11:48.560553] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-19T19:11:48.648392] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-19T19:11:48.951821] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-19T19:11:48.952080] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-19T19:11:48.952399] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-19T19:11:48.952497] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-19T19:11:48.953356] [DEBUG] [LOCAL ] HBB: Trimmed 10087 records to 7028 (keeping 200 days of data) [2025-09-19T19:11:48.998689] [DEBUG] [LOCAL ] HBB: Primary data saved (7028 records). [2025-09-19T19:11:48.998838] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-19T19:11:48.998926] [INFO ] [MAIN ] Update Progress: 993/2372 symbols completed. HBB took 17.0s. Estimated remaining: 3h 2m 57s. Rate: 7.5 symbols/min [2025-09-19T19:11:49.205822] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:49.202419] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T19:11:49.268073] [DEBUG] [LOCAL ] HBI: Loaded 53417 existing records from primary storage. [2025-09-19T19:11:49.268236] [INFO ] [MAIN ] HBI: Loaded 53417 existing records. [2025-09-19T19:11:49.445681] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-19T19:11:49.449174] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:49.450208] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-19T19:11:49.450293] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-19T19:11:49.451488] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-19T19:11:49.451552] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-19T19:11:49.808705] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:50.243313] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-19T19:11:50.472452] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T19:11:51.043310] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-19T19:11:51.788287] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T19:11:51.843313] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-19T19:11:52.097508] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T19:11:52.104519] [INFO ] [REMOTE ] HASI: Full fetch complete (67976 records). [2025-09-19T19:11:52.104680] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-19T19:11:52.503783] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-19T19:11:52.504100] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-19T19:11:52.505182] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-19T19:11:52.505296] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-19T19:11:52.522600] [DEBUG] [LOCAL ] HASI: Trimmed 67976 records to 47924 (keeping 200 days of data) [2025-09-19T19:11:52.537184] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T19:11:52.649796] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-19T19:11:52.846010] [DEBUG] [LOCAL ] HASI: Primary data saved (47924 records). [2025-09-19T19:11:52.846173] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-19T19:11:52.846316] [INFO ] [MAIN ] Update Progress: 994/2372 symbols completed. HASI took 35.8s. Estimated remaining: 3h 2m 44s. Rate: 7.5 symbols/min [2025-09-19T19:11:53.019368] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:53.075614] [DEBUG] [LOCAL ] HBM: Loaded 53302 existing records from primary storage. [2025-09-19T19:11:53.075837] [INFO ] [MAIN ] HBM: Loaded 53302 existing records. [2025-09-19T19:11:53.255870] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:53.256164] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-19T19:11:53.256226] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-19T19:11:53.257321] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-19T19:11:53.257383] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-19T19:11:53.452527] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-19T19:11:53.655560] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:53.748755] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T19:11:54.243277] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-19T19:11:54.498428] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T19:11:55.043330] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-19T19:11:55.650943] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T19:11:55.780446] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T19:11:55.843226] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-19T19:11:56.643285] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-19T19:11:56.908417] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T19:11:56.917331] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-19T19:11:56.917848] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-19T19:11:57.349538] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-19T19:11:57.349662] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-19T19:11:57.350782] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-19T19:11:57.350850] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-19T19:11:57.352622] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54498 (keeping 200 days of data) [2025-09-19T19:11:57.444348] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-19T19:11:57.718936] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T19:11:57.755502] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-09-19T19:11:57.755704] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-19T19:11:57.755826] [INFO ] [MAIN ] Update Progress: 995/2372 symbols completed. HAL took 42.6s. Estimated remaining: 3h 2m 32s. Rate: 7.5 symbols/min [2025-09-19T19:11:57.926727] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:57.972756] [DEBUG] [LOCAL ] HCA: Loaded 47753 existing records from primary storage. [2025-09-19T19:11:57.972907] [INFO ] [MAIN ] HCA: Loaded 47753 existing records. [2025-09-19T19:11:58.152739] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:58.153016] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-19T19:11:58.153069] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-19T19:11:58.154281] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-19T19:11:58.154340] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-19T19:11:58.248421] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-19T19:11:58.531774] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:58.560793] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T19:11:58.940274] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T19:11:58.947969] [INFO ] [REMOTE ] HAYW: Full fetch complete (71047 records). [2025-09-19T19:11:58.948115] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-19T19:11:59.050774] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-19T19:11:59.376400] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-19T19:11:59.376527] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-19T19:11:59.377793] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-19T19:11:59.377862] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-19T19:11:59.379428] [DEBUG] [LOCAL ] HAYW: Trimmed 71047 records to 49501 (keeping 200 days of data) [2025-09-19T19:11:59.656107] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T19:11:59.737846] [DEBUG] [LOCAL ] HAYW: Primary data saved (49501 records). [2025-09-19T19:11:59.738003] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-19T19:11:59.738516] [INFO ] [MAIN ] Update Progress: 996/2372 symbols completed. HAYW took 35.4s. Estimated remaining: 3h 2m 15s. Rate: 7.5 symbols/min [2025-09-19T19:11:59.843261] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-19T19:11:59.929200] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:59.979909] [DEBUG] [LOCAL ] HCC: Loaded 45777 existing records from primary storage. [2025-09-19T19:11:59.980092] [INFO ] [MAIN ] HCC: Loaded 45777 existing records. [2025-09-19T19:12:00.175016] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:00.175331] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-19T19:12:00.175387] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-19T19:12:00.176378] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-19T19:12:00.176439] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-19T19:12:00.531734] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:00.593911] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T19:12:00.643243] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-19T19:12:01.443338] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-19T19:12:01.952315] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:12:02.243293] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-19T19:12:02.969880] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-19T19:12:03.043241] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-19T19:12:03.843271] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-19T19:12:04.644433] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (3.20 seconds). [2025-09-19T19:12:04.652510] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-19T19:12:04.829518] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-19T19:12:04.962160] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:12:05.443316] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-19T19:12:06.024719] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T19:12:06.243272] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-19T19:12:06.359002] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T19:12:07.043321] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-19T19:12:07.697689] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-19T19:12:07.833244] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T19:12:07.843928] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-19T19:12:08.299634] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T19:12:08.643237] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-19T19:12:09.443288] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-19T19:12:09.732162] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T19:12:10.243302] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-19T19:12:10.334384] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T19:12:10.866127] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T19:12:11.043277] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-19T19:12:11.843283] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-19T19:12:12.094449] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T19:12:12.643268] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-19T19:12:12.993421] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T19:12:13.349583] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:12:13.443262] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-19T19:12:14.243274] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-19T19:12:15.043307] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-19T19:12:16.098072] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (3.45 seconds). [2025-09-19T19:12:16.110460] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-19T19:12:16.297499] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-19T19:12:16.574332] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T19:12:16.643267] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-19T19:12:17.443396] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-19T19:12:17.540974] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T19:12:18.163632] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T19:12:18.243262] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-19T19:12:18.514360] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-19T19:12:19.043288] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-19T19:12:19.406073] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T19:12:19.843300] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-19T19:12:20.238023] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:12:20.643288] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-19T19:12:21.116059] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T19:12:21.124264] [INFO ] [REMOTE ] HBM: Full fetch complete (76020 records). [2025-09-19T19:12:21.124451] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-19T19:12:21.445920] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-19T19:12:21.530976] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-19T19:12:21.531261] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-19T19:12:21.532339] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-19T19:12:21.543932] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-19T19:12:21.568148] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T19:12:21.579571] [DEBUG] [LOCAL ] HBM: Trimmed 76020 records to 53681 (keeping 200 days of data) [2025-09-19T19:12:21.910816] [DEBUG] [LOCAL ] HBM: Primary data saved (53681 records). [2025-09-19T19:12:21.910958] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-19T19:12:21.911041] [INFO ] [MAIN ] Update Progress: 997/2372 symbols completed. HBM took 29.1s. Estimated remaining: 3h 2m 27s. Rate: 7.5 symbols/min [2025-09-19T19:12:21.959272] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:12:22.243269] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-19T19:12:23.043291] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-19T19:12:23.433729] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T19:12:23.843316] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-19T19:12:24.089934] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T19:12:24.096742] [INFO ] [REMOTE ] HCC: Full fetch complete (64165 records). [2025-09-19T19:12:24.096911] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-19T19:12:24.496810] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-19T19:12:24.496901] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-19T19:12:24.497756] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-19T19:12:24.497819] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-19T19:12:24.499174] [DEBUG] [LOCAL ] HCC: Trimmed 64165 records to 46078 (keeping 200 days of data) [2025-09-19T19:12:24.778739] [DEBUG] [LOCAL ] HCC: Primary data saved (46078 records). [2025-09-19T19:12:24.778899] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-19T19:12:24.780091] [INFO ] [MAIN ] Update Progress: 998/2372 symbols completed. HCC took 25.0s. Estimated remaining: 3h 2m 12s. Rate: 7.5 symbols/min [2025-09-19T19:12:24.829395] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T19:12:24.840256] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-19T19:12:25.745443] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T19:12:25.756381] [INFO ] [REMOTE ] HCA: Full fetch complete (69292 records). [2025-09-19T19:12:25.756563] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-19T19:12:26.155008] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-19T19:12:26.155098] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-19T19:12:26.156072] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-19T19:12:26.156181] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-19T19:12:26.157943] [DEBUG] [LOCAL ] HCA: Trimmed 69292 records to 48109 (keeping 200 days of data) [2025-09-19T19:12:26.426600] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T19:12:26.442979] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-19T19:12:26.520230] [DEBUG] [LOCAL ] HCA: Primary data saved (48109 records). [2025-09-19T19:12:26.520442] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-19T19:12:26.520603] [INFO ] [MAIN ] Update Progress: 999/2372 symbols completed. HCA took 28.8s. Estimated remaining: 3h 1m 56s. Rate: 7.5 symbols/min [2025-09-19T19:12:28.120149] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T19:12:28.131367] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-19T19:12:30.090243] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T19:12:30.098358] [INFO ] [REMOTE ] HBI: Full fetch complete (76915 records). [2025-09-19T19:12:30.098515] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-19T19:12:30.502911] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-19T19:12:30.503000] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-19T19:12:30.504041] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-19T19:12:30.504108] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-19T19:12:30.505637] [DEBUG] [LOCAL ] HBI: Trimmed 76915 records to 53802 (keeping 200 days of data) [2025-09-19T19:12:30.835630] [DEBUG] [LOCAL ] HBI: Primary data saved (53802 records). [2025-09-19T19:12:30.835831] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-19T19:12:30.835965] [INFO ] [MAIN ] Update Progress: 1000/2372 symbols completed. HBI took 41.8s. Estimated remaining: 3h 1m 43s. Rate: 7.6 symbols/min [2025-09-19T19:12:31.400794] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:31.583920] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:31.575807] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:31.607471] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:31.608111] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-19T19:12:31.608165] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-19T19:12:31.608300] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-19T19:12:31.608341] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-19T19:12:31.608381] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-19T19:12:31.608426] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-19T19:12:31.710530] [DEBUG] [LOCAL ] HCI: Loaded 14062 existing records from primary storage. [2025-09-19T19:12:31.721525] [INFO ] [MAIN ] HCI: Loaded 14062 existing records. [2025-09-19T19:12:32.140430] [DEBUG] [LOCAL ] HDB: Loaded 52320 existing records from primary storage. [2025-09-19T19:12:32.168385] [INFO ] [MAIN ] HDB: Loaded 52320 existing records. [2025-09-19T19:12:32.174580] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:32.141493] [DEBUG] [LOCAL ] HD: Loaded 53908 existing records from primary storage. [2025-09-19T19:12:32.215282] [INFO ] [MAIN ] HD: Loaded 53908 existing records. [2025-09-19T19:12:32.241418] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-19T19:12:32.325210] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-19T19:12:32.433251] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-19T19:12:32.414722] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:32.466492] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-19T19:12:32.460376] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-19T19:12:32.677326] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:32.715307] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-19T19:12:32.720664] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-19T19:12:32.725927] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-19T19:12:32.782280] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-19T19:12:32.796035] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:32.958532] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T19:12:32.984308] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-19T19:12:33.027953] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-19T19:12:33.052633] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-19T19:12:33.070052] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-19T19:12:33.080483] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-19T19:12:33.222892] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:33.316936] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-19T19:12:33.344066] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-19T19:12:33.407820] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-19T19:12:33.646878] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:33.679713] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-19T19:12:33.786622] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:33.786954] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-19T19:12:33.836802] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-19T19:12:33.837633] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-19T19:12:34.555549] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-19T19:12:34.556840] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-19T19:12:34.567546] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:12:34.571095] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-19T19:12:34.823078] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-19T19:12:34.824006] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-19T19:12:35.101584] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-19T19:12:35.102518] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-19T19:12:35.478018] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T19:12:35.649232] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T19:12:35.843280] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-19T19:12:35.881875] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T19:12:35.940804] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T19:12:36.643256] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-19T19:12:36.806596] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T19:12:36.907322] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-19T19:12:37.443341] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-19T19:12:38.243319] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-19T19:12:38.625935] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-19T19:12:39.043260] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-19T19:12:39.226006] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:12:39.843293] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-19T19:12:40.177883] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T19:12:40.201046] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-19T19:12:40.201779] [INFO ] [REMOTE ] HCXY: Full fetch complete (606 records). [2025-09-19T19:12:40.201853] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-19T19:12:40.381228] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-19T19:12:40.381437] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:12:40.381521] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:12:40.381595] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-19T19:12:40.381709] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-19T19:12:40.381757] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-19T19:12:40.381838] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-19T19:12:40.381939] [INFO ] [MAIN ] Update Progress: 1001/2372 symbols completed. HCXY took 9.5s. Estimated remaining: 3h 1m 37s. Rate: 7.5 symbols/min [2025-09-19T19:12:40.551030] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:40.609791] [DEBUG] [LOCAL ] HE: Loaded 49698 existing records from primary storage. [2025-09-19T19:12:40.609977] [INFO ] [MAIN ] HE: Loaded 49698 existing records. [2025-09-19T19:12:40.648569] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-19T19:12:40.790118] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:40.790393] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-19T19:12:40.790440] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-19T19:12:40.791753] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-19T19:12:40.791813] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-19T19:12:41.164751] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:41.443268] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-19T19:12:42.243275] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-19T19:12:42.625769] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T19:12:43.043261] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-19T19:12:43.631422] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T19:12:43.843260] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-19T19:12:44.364362] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T19:12:44.409348] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:12:44.643250] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-19T19:12:45.443267] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-19T19:12:46.243267] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-19T19:12:46.328215] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-19T19:12:46.784065] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T19:12:46.802757] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T19:12:47.043315] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-19T19:12:47.677175] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T19:12:47.843340] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-19T19:12:48.604147] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T19:12:48.643310] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-19T19:12:48.965532] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T19:12:49.443278] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-19T19:12:50.243282] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-19T19:12:50.628465] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T19:12:51.043290] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-19T19:12:51.267119] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-19T19:12:51.843294] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-19T19:12:52.194258] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T19:12:52.449212] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T19:12:52.643308] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-19T19:12:53.443257] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-19T19:12:53.837335] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T19:12:54.225897] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T19:12:54.243214] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-19T19:12:55.043276] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-19T19:12:55.428792] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T19:12:55.843230] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-19T19:12:56.529942] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-19T19:12:56.644560] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-19T19:12:56.647936] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T19:12:57.443230] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-19T19:12:57.778181] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T19:12:57.879440] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T19:12:57.883718] [INFO ] [REMOTE ] HCI: Full fetch complete (19541 records). [2025-09-19T19:12:57.883854] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-19T19:12:58.246450] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-19T19:12:58.275707] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-19T19:12:58.275803] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-19T19:12:58.276290] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-19T19:12:58.276380] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-19T19:12:58.277406] [DEBUG] [LOCAL ] HCI: Trimmed 19541 records to 14144 (keeping 200 days of data) [2025-09-19T19:12:58.374921] [DEBUG] [LOCAL ] HCI: Primary data saved (14144 records). [2025-09-19T19:12:58.375065] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-19T19:12:58.375180] [INFO ] [MAIN ] Update Progress: 1002/2372 symbols completed. HCI took 27.5s. Estimated remaining: 3h 1m 43s. Rate: 7.5 symbols/min [2025-09-19T19:12:58.546295] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:58.586786] [DEBUG] [LOCAL ] HEI: Loaded 33217 existing records from primary storage. [2025-09-19T19:12:58.586924] [INFO ] [MAIN ] HEI: Loaded 33217 existing records. [2025-09-19T19:12:58.773972] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:58.774417] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-19T19:12:58.774543] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-19T19:12:58.775427] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-19T19:12:58.775517] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-19T19:12:59.048394] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-19T19:12:59.138059] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:59.629103] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T19:12:59.843261] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-19T19:13:00.131440] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:13:00.643283] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-19T19:13:00.819160] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:13:01.443271] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-19T19:13:02.206932] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-19T19:13:02.243233] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-19T19:13:02.400045] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T19:13:03.043231] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-19T19:13:03.391678] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T19:13:03.843274] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-19T19:13:04.213431] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:13:04.221459] [INFO ] [REMOTE ] HD: Full fetch complete (77436 records). [2025-09-19T19:13:04.221679] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-19T19:13:04.630908] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-19T19:13:04.631000] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-19T19:13:04.632104] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-19T19:13:04.632171] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-19T19:13:04.635997] [DEBUG] [LOCAL ] HD: Trimmed 77436 records to 54298 (keeping 200 days of data) [2025-09-19T19:13:04.643238] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-19T19:13:05.020344] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:13:05.034804] [DEBUG] [LOCAL ] HD: Primary data saved (54298 records). [2025-09-19T19:13:05.034934] [INFO ] [MAIN ] HD: Full history saved. [2025-09-19T19:13:05.035458] [INFO ] [MAIN ] Update Progress: 1003/2372 symbols completed. HD took 34.2s. Estimated remaining: 3h 1m 33s. Rate: 7.5 symbols/min [2025-09-19T19:13:05.209883] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:05.221284] [DEBUG] [LOCAL ] HEQ: Loaded 6239 existing records from primary storage. [2025-09-19T19:13:05.221397] [INFO ] [MAIN ] HEQ: Loaded 6239 existing records. [2025-09-19T19:13:05.398017] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:05.398275] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-19T19:13:05.398324] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-19T19:13:05.398713] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-19T19:13:05.398774] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-19T19:13:05.461560] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-19T19:13:05.759203] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:05.877425] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:13:05.916962] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T19:13:06.243262] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-19T19:13:07.043310] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-19T19:13:07.584389] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:13:07.803369] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T19:13:07.843223] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-19T19:13:08.643274] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-19T19:13:08.938930] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:13:09.443245] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-19T19:13:10.003366] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T19:13:10.011451] [INFO ] [REMOTE ] HE: Full fetch complete (72508 records). [2025-09-19T19:13:10.011572] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-19T19:13:10.244502] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-19T19:13:10.469671] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-19T19:13:10.469925] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-19T19:13:10.470904] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-19T19:13:10.478407] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-19T19:13:10.493639] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T19:13:10.501756] [DEBUG] [LOCAL ] HE: Trimmed 72508 records to 50053 (keeping 200 days of data) [2025-09-19T19:13:10.809548] [DEBUG] [LOCAL ] HE: Primary data saved (50053 records). [2025-09-19T19:13:10.809719] [INFO ] [MAIN ] HE: Full history saved. [2025-09-19T19:13:10.810174] [INFO ] [MAIN ] Update Progress: 1004/2372 symbols completed. HE took 30.4s. Estimated remaining: 3h 1m 22s. Rate: 7.5 symbols/min [2025-09-19T19:13:10.992635] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:11.016459] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T19:13:11.024601] [INFO ] [REMOTE ] HDB: Full fetch complete (75227 records). [2025-09-19T19:13:11.024845] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-19T19:13:11.060075] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-19T19:13:11.255586] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T19:13:11.374564] [DEBUG] [LOCAL ] HESM: Loaded 48477 existing records from primary storage. [2025-09-19T19:13:11.374796] [INFO ] [MAIN ] HESM: Loaded 48477 existing records. [2025-09-19T19:13:11.629586] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-19T19:13:11.649223] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-19T19:13:11.652069] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-19T19:13:11.659058] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-19T19:13:11.672834] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:11.673310] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-19T19:13:11.673465] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-19T19:13:11.673932] [DEBUG] [LOCAL ] HDB: Trimmed 75227 records to 52707 (keeping 200 days of data) [2025-09-19T19:13:11.674922] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-19T19:13:11.674984] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-19T19:13:11.856216] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-19T19:13:12.274740] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:12.383593] [DEBUG] [LOCAL ] HDB: Primary data saved (52707 records). [2025-09-19T19:13:12.383774] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-19T19:13:12.383928] [INFO ] [MAIN ] Update Progress: 1005/2372 symbols completed. HDB took 41.5s. Estimated remaining: 3h 1m 5s. Rate: 7.5 symbols/min [2025-09-19T19:13:12.563681] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:12.563944] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-19T19:13:12.564000] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-19T19:13:12.564149] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-19T19:13:12.564194] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-19T19:13:12.564235] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-19T19:13:12.564268] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-19T19:13:12.656509] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-19T19:13:12.680382] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T19:13:12.936281] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:12.959078] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T19:13:13.443306] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-19T19:13:14.021830] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T19:13:14.223808] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T19:13:14.243238] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-19T19:13:15.043234] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-19T19:13:15.221320] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T19:13:15.843258] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-19T19:13:16.643270] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-19T19:13:16.781873] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T19:13:16.809915] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:13:17.443262] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-19T19:13:18.148408] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T19:13:18.243225] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-19T19:13:19.025904] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T19:13:19.043210] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-19T19:13:19.843265] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-19T19:13:19.987938] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:13:20.599317] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:13:20.643226] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-19T19:13:20.690379] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T19:13:21.443265] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-19T19:13:22.177540] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T19:13:22.243307] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-19T19:13:22.292810] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T19:13:22.753067] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T19:13:23.043260] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-19T19:13:23.843272] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-19T19:13:23.884164] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-19T19:13:24.643308] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-19T19:13:25.340940] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T19:13:25.443269] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-19T19:13:25.646921] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T19:13:25.651430] [INFO ] [REMOTE ] HEI: Full fetch complete (49246 records). [2025-09-19T19:13:25.651530] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-19T19:13:26.045021] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-19T19:13:26.045104] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-19T19:13:26.045846] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-19T19:13:26.045908] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-19T19:13:26.047143] [DEBUG] [LOCAL ] HEI: Trimmed 49246 records to 33376 (keeping 200 days of data) [2025-09-19T19:13:26.243427] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-19T19:13:26.266815] [DEBUG] [LOCAL ] HEI: Primary data saved (33376 records). [2025-09-19T19:13:26.266914] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-19T19:13:26.267007] [INFO ] [MAIN ] Update Progress: 1006/2372 symbols completed. HEI took 27.9s. Estimated remaining: 3h 1m 6s. Rate: 7.5 symbols/min [2025-09-19T19:13:26.439332] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:26.439541] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-19T19:13:26.439583] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-19T19:13:26.439777] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-19T19:13:26.439819] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-19T19:13:26.439864] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-19T19:13:26.439955] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-19T19:13:26.683085] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-19T19:13:26.798358] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:26.903323] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T19:13:27.043276] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-19T19:13:27.559836] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-19T19:13:27.843270] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-19T19:13:28.643250] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-19T19:13:28.865565] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T19:13:28.868308] [INFO ] [REMOTE ] HEQ: Full fetch complete (9071 records). [2025-09-19T19:13:28.868393] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-19T19:13:29.239184] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-19T19:13:29.239260] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-19T19:13:29.239488] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-19T19:13:29.239525] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-19T19:13:29.239966] [DEBUG] [LOCAL ] HEQ: Trimmed 9071 records to 6366 (keeping 200 days of data) [2025-09-19T19:13:29.277771] [DEBUG] [LOCAL ] HEQ: Primary data saved (6366 records). [2025-09-19T19:13:29.277890] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-19T19:13:29.277973] [INFO ] [MAIN ] Update Progress: 1007/2372 symbols completed. HEQ took 24.2s. Estimated remaining: 3h 0m 51s. Rate: 7.5 symbols/min [2025-09-19T19:13:29.448326] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-19T19:13:29.481339] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:29.501000] [DEBUG] [LOCAL ] HFRO: Loaded 17680 existing records from primary storage. [2025-09-19T19:13:29.501130] [INFO ] [MAIN ] HFRO: Loaded 17680 existing records. [2025-09-19T19:13:29.682729] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:29.682989] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-19T19:13:29.683048] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-19T19:13:29.683632] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-19T19:13:29.683719] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-19T19:13:29.945761] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T19:13:30.065423] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:30.243260] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-19T19:13:30.421282] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T19:13:31.043269] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-19T19:13:31.555350] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T19:13:31.806203] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T19:13:31.843254] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-19T19:13:32.370366] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T19:13:32.643353] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-19T19:13:32.937536] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-19T19:13:33.443278] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-19T19:13:33.831391] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T19:13:34.243282] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-19T19:13:34.653512] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T19:13:35.043270] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-19T19:13:35.457585] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-19T19:13:35.843272] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-19T19:13:36.643312] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-19T19:13:37.222476] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T19:13:37.443314] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-19T19:13:37.948856] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T19:13:38.243274] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-19T19:13:38.737235] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-19T19:13:39.043274] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-19T19:13:39.217098] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:13:39.543912] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-19T19:13:39.544835] [INFO ] [REMOTE ] HFND: Full fetch complete (1810 records). [2025-09-19T19:13:39.544905] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-19T19:13:39.732511] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-19T19:13:39.732808] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:13:39.732882] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:13:39.732951] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-19T19:13:39.733015] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-19T19:13:39.733053] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-19T19:13:39.733108] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-19T19:13:39.733189] [INFO ] [MAIN ] Update Progress: 1008/2372 symbols completed. HFND took 13.5s. Estimated remaining: 3h 0m 46s. Rate: 7.5 symbols/min [2025-09-19T19:13:39.848383] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-19T19:13:39.908921] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:39.926024] [DEBUG] [LOCAL ] HGER: Loaded 12752 existing records from primary storage. [2025-09-19T19:13:39.926151] [INFO ] [MAIN ] HGER: Loaded 12752 existing records. [2025-09-19T19:13:40.108787] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:40.109066] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-19T19:13:40.109115] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-19T19:13:40.109678] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-19T19:13:40.109740] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-19T19:13:40.480355] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:40.643217] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-19T19:13:41.120586] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:13:41.443281] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-19T19:13:41.520027] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T19:13:42.243280] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-19T19:13:42.542629] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-19T19:13:43.043276] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-19T19:13:43.443378] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T19:13:43.843264] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-19T19:13:44.109094] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T19:13:44.643264] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-19T19:13:45.443262] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-19T19:13:45.528459] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T19:13:45.683975] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:13:45.716197] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-19T19:13:46.243288] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-19T19:13:47.043273] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-19T19:13:47.731863] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:13:47.739227] [INFO ] [REMOTE ] HESM: Full fetch complete (68575 records). [2025-09-19T19:13:47.739371] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-19T19:13:47.845686] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-19T19:13:47.858205] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T19:13:48.147423] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-19T19:13:48.143939] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-19T19:13:48.147686] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-19T19:13:48.148887] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-19T19:13:48.149710] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-19T19:13:48.151334] [DEBUG] [LOCAL ] HESM: Trimmed 68575 records to 48865 (keeping 200 days of data) [2025-09-19T19:13:48.456321] [DEBUG] [LOCAL ] HESM: Primary data saved (48865 records). [2025-09-19T19:13:48.456487] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-19T19:13:48.457112] [INFO ] [MAIN ] Update Progress: 1009/2372 symbols completed. HESM took 37.6s. Estimated remaining: 3h 0m 39s. Rate: 7.5 symbols/min [2025-09-19T19:13:48.626936] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:48.638369] [DEBUG] [LOCAL ] HGLB: Loaded 9804 existing records from primary storage. [2025-09-19T19:13:48.638493] [INFO ] [MAIN ] HGLB: Loaded 9804 existing records. [2025-09-19T19:13:48.643278] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-19T19:13:48.820763] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:48.821066] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-19T19:13:48.821129] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-19T19:13:48.821607] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-19T19:13:48.821701] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-19T19:13:49.180523] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:49.443295] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-19T19:13:49.940490] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T19:13:50.243281] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-19T19:13:50.314856] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T19:13:50.502137] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-19T19:13:51.043310] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-19T19:13:51.843306] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-19T19:13:52.012786] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T19:13:52.643251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-19T19:13:52.809874] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:13:52.904581] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-19T19:13:53.443276] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-19T19:13:54.243305] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-19T19:13:54.360568] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T19:13:54.504901] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-19T19:13:55.043275] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-19T19:13:55.843269] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-19T19:13:55.928412] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T19:13:56.332747] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-19T19:13:56.643298] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-19T19:13:57.443241] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-19T19:13:57.851975] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:13:58.243279] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-19T19:13:58.605526] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-19T19:13:58.606248] [INFO ] [REMOTE ] HF: Full fetch complete (511 records). [2025-09-19T19:13:58.606318] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-19T19:13:58.784979] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-19T19:13:58.785229] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:13:58.785325] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:13:58.785416] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-19T19:13:58.785600] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-19T19:13:58.785765] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-19T19:13:58.785987] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-19T19:13:58.786231] [INFO ] [MAIN ] Update Progress: 1010/2372 symbols completed. HF took 46.4s. Estimated remaining: 3h 0m 35s. Rate: 7.5 symbols/min [2025-09-19T19:13:58.858245] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T19:13:58.967193] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:58.981558] [DEBUG] [LOCAL ] HGTY: Loaded 12987 existing records from primary storage. [2025-09-19T19:13:58.981723] [INFO ] [MAIN ] HGTY: Loaded 12987 existing records. [2025-09-19T19:13:59.048441] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-19T19:13:59.162078] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:59.162344] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-19T19:13:59.162425] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-19T19:13:59.163000] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-19T19:13:59.163090] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-19T19:13:59.521546] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:59.843281] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-19T19:14:00.014524] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T19:14:00.652102] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-19T19:14:00.654404] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T19:14:01.443301] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-19T19:14:01.630533] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T19:14:02.243285] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-19T19:14:02.381493] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T19:14:03.043319] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-19T19:14:03.239728] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-19T19:14:03.712290] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:14:03.843262] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-19T19:14:04.643274] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-19T19:14:04.686607] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T19:14:05.443280] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-19T19:14:05.824350] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T19:14:06.243259] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-19T19:14:06.617913] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T19:14:07.043287] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-19T19:14:07.288510] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T19:14:07.843281] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-19T19:14:07.985412] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T19:14:08.643292] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-19T19:14:09.165913] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:14:09.443273] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-19T19:14:09.877837] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T19:14:09.881790] [INFO ] [REMOTE ] HFRO: Full fetch complete (28801 records). [2025-09-19T19:14:09.882036] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-19T19:14:10.248230] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-19T19:14:10.282184] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-19T19:14:10.282314] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-19T19:14:10.283789] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-19T19:14:10.284081] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-19T19:14:10.285717] [DEBUG] [LOCAL ] HFRO: Trimmed 28801 records to 17764 (keeping 200 days of data) [2025-09-19T19:14:10.377920] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:14:10.416164] [DEBUG] [LOCAL ] HFRO: Primary data saved (17764 records). [2025-09-19T19:14:10.416407] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-19T19:14:10.416533] [INFO ] [MAIN ] Update Progress: 1011/2372 symbols completed. HFRO took 41.1s. Estimated remaining: 3h 0m 32s. Rate: 7.5 symbols/min [2025-09-19T19:14:10.600239] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:10.653078] [DEBUG] [LOCAL ] HGV: Loaded 47467 existing records from primary storage. [2025-09-19T19:14:10.653297] [INFO ] [MAIN ] HGV: Loaded 47467 existing records. [2025-09-19T19:14:10.854629] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:10.854998] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-19T19:14:10.855091] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-19T19:14:10.856469] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-19T19:14:10.856532] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-19T19:14:11.052030] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-19T19:14:11.219962] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:11.499533] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T19:14:11.502992] [INFO ] [REMOTE ] HGER: Full fetch complete (15867 records). [2025-09-19T19:14:11.503064] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-19T19:14:11.849862] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-19T19:14:11.868390] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-19T19:14:11.868477] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-19T19:14:11.868868] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-19T19:14:11.868929] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-19T19:14:11.869582] [DEBUG] [LOCAL ] HGER: Trimmed 15867 records to 12933 (keeping 200 days of data) [2025-09-19T19:14:11.947368] [DEBUG] [LOCAL ] HGER: Primary data saved (12933 records). [2025-09-19T19:14:11.947520] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-19T19:14:11.947622] [INFO ] [MAIN ] Update Progress: 1012/2372 symbols completed. HGER took 32.2s. Estimated remaining: 3h 0m 15s. Rate: 7.5 symbols/min [2025-09-19T19:14:12.126104] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:12.126349] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T19:14:12.164109] [DEBUG] [LOCAL ] HHH: Loaded 33111 existing records from primary storage. [2025-09-19T19:14:12.164251] [INFO ] [MAIN ] HHH: Loaded 33111 existing records. [2025-09-19T19:14:12.339812] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:12.340088] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-19T19:14:12.340135] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-19T19:14:12.341146] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-19T19:14:12.341206] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-19T19:14:12.654235] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-19T19:14:12.701229] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:13.443288] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-19T19:14:13.638685] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T19:14:13.874249] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T19:14:14.243273] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-19T19:14:14.381616] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T19:14:15.043266] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-19T19:14:15.571256] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:14:15.843345] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-19T19:14:16.373505] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T19:14:16.643326] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-19T19:14:17.394940] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T19:14:17.443276] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-19T19:14:17.753968] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T19:14:18.243343] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-19T19:14:19.027495] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T19:14:19.043219] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-19T19:14:19.218667] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T19:14:19.843292] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-19T19:14:20.467577] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T19:14:20.643268] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-19T19:14:20.734081] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:14:21.443308] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-19T19:14:21.610898] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T19:14:22.243243] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-19T19:14:22.774993] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T19:14:23.043274] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-19T19:14:23.843265] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-19T19:14:24.040544] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T19:14:24.643309] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-19T19:14:24.829266] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T19:14:24.856056] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T19:14:25.443286] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-19T19:14:26.243294] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-19T19:14:26.284744] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-19T19:14:26.588790] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:14:27.043271] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-19T19:14:27.656242] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T19:14:27.843272] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-19T19:14:28.607156] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T19:14:28.611288] [INFO ] [REMOTE ] HGTY: Full fetch complete (17091 records). [2025-09-19T19:14:28.611373] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-19T19:14:28.648480] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-19T19:14:28.967415] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T19:14:29.008903] [INFO ] [REMOTE ] HGLB: Full fetch complete (14259 records). [2025-09-19T19:14:29.027756] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-19T19:14:29.036966] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-19T19:14:29.037133] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-19T19:14:29.037563] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-19T19:14:29.068708] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-19T19:14:29.141719] [DEBUG] [LOCAL ] HGTY: Trimmed 17091 records to 13154 (keeping 200 days of data) [2025-09-19T19:14:29.445406] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-19T19:14:29.488050] [DEBUG] [LOCAL ] HGTY: Primary data saved (13154 records). [2025-09-19T19:14:29.500068] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-19T19:14:29.500201] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-19T19:14:29.500313] [INFO ] [MAIN ] Update Progress: 1013/2372 symbols completed. HGTY took 30.7s. Estimated remaining: 3h 0m 20s. Rate: 7.5 symbols/min [2025-09-19T19:14:29.500396] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-19T19:14:29.501009] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-19T19:14:29.547354] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-19T19:14:29.613096] [DEBUG] [LOCAL ] HGLB: Trimmed 14259 records to 9853 (keeping 200 days of data) [2025-09-19T19:14:29.749776] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:29.761594] [DEBUG] [LOCAL ] HGLB: Primary data saved (9853 records). [2025-09-19T19:14:29.761809] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-19T19:14:29.761925] [INFO ] [MAIN ] Update Progress: 1014/2372 symbols completed. HGLB took 41.3s. Estimated remaining: 3h 0m 2s. Rate: 7.5 symbols/min [2025-09-19T19:14:29.980075] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:29.981624] [DEBUG] [LOCAL ] HI: Loaded 35349 existing records from primary storage. [2025-09-19T19:14:29.982237] [INFO ] [MAIN ] HI: Loaded 35349 existing records. [2025-09-19T19:14:30.183996] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:30.184528] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-19T19:14:30.184593] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-19T19:14:30.200997] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-19T19:14:30.201179] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-19T19:14:30.367122] [DEBUG] [LOCAL ] HIG: Loaded 51670 existing records from primary storage. [2025-09-19T19:14:30.386609] [INFO ] [MAIN ] HIG: Loaded 51670 existing records. [2025-09-19T19:14:30.748128] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:30.759025] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-19T19:14:30.772806] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-19T19:14:30.814859] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:30.815277] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-19T19:14:30.816791] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-19T19:14:30.816864] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-19T19:14:31.025781] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T19:14:31.126894] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-19T19:14:31.233595] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:31.256544] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T19:14:31.843260] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-19T19:14:32.340552] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T19:14:32.484928] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T19:14:32.643237] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-19T19:14:33.443265] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-19T19:14:33.660444] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T19:14:33.979959] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T19:14:34.243292] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-19T19:14:35.054308] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-19T19:14:35.062174] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T19:14:35.843284] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-19T19:14:36.181202] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T19:14:36.239437] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T19:14:36.643266] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-19T19:14:37.374254] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:14:37.379518] [INFO ] [REMOTE ] HHH: Full fetch complete (44917 records). [2025-09-19T19:14:37.379631] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-19T19:14:37.448350] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-19T19:14:37.797248] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-19T19:14:37.797355] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-19T19:14:37.798251] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-19T19:14:37.798319] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-19T19:14:37.799464] [DEBUG] [LOCAL ] HHH: Trimmed 44917 records to 33300 (keeping 200 days of data) [2025-09-19T19:14:38.018043] [DEBUG] [LOCAL ] HHH: Primary data saved (33300 records). [2025-09-19T19:14:38.018228] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-19T19:14:38.018374] [INFO ] [MAIN ] Update Progress: 1015/2372 symbols completed. HHH took 26.1s. Estimated remaining: 2h 59m 54s. Rate: 7.5 symbols/min [2025-09-19T19:14:38.205939] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:38.243730] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-19T19:14:38.245804] [DEBUG] [LOCAL ] HII: Loaded 35965 existing records from primary storage. [2025-09-19T19:14:38.245968] [INFO ] [MAIN ] HII: Loaded 35965 existing records. [2025-09-19T19:14:38.450109] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:38.450474] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-19T19:14:38.450576] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-19T19:14:38.452038] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-19T19:14:38.452124] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-19T19:14:38.596277] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T19:14:38.648671] [INFO ] [REMOTE ] HGV: Full fetch complete (65735 records). [2025-09-19T19:14:38.658681] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-19T19:14:39.101974] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:39.112511] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-19T19:14:39.310507] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-19T19:14:39.311109] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-19T19:14:39.312293] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-19T19:14:39.312387] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-19T19:14:39.317745] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T19:14:39.329049] [DEBUG] [LOCAL ] HGV: Trimmed 65735 records to 47765 (keeping 200 days of data) [2025-09-19T19:14:39.622243] [DEBUG] [LOCAL ] HGV: Primary data saved (47765 records). [2025-09-19T19:14:39.622446] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-19T19:14:39.622590] [INFO ] [MAIN ] Update Progress: 1016/2372 symbols completed. HGV took 29.2s. Estimated remaining: 2h 59m 38s. Rate: 7.5 symbols/min [2025-09-19T19:14:39.808774] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:39.843267] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-19T19:14:39.866997] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-09-19T19:14:39.867172] [INFO ] [MAIN ] HIMS: Loaded 54207 existing records. [2025-09-19T19:14:40.060382] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:40.061043] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-19T19:14:40.061174] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-19T19:14:40.062712] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-19T19:14:40.062775] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-19T19:14:40.373007] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T19:14:40.469760] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:40.496725] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T19:14:40.643236] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-19T19:14:41.371979] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T19:14:41.443257] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-19T19:14:41.776133] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T19:14:42.243278] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-19T19:14:43.043274] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-19T19:14:43.495758] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T19:14:43.571639] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T19:14:43.843247] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-19T19:14:44.093415] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T19:14:44.643291] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-19T19:14:45.443251] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-19T19:14:45.524493] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:14:46.243236] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-19T19:14:46.366820] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T19:14:47.043288] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-19T19:14:47.542073] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T19:14:47.843262] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-19T19:14:48.417056] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T19:14:48.643289] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-19T19:14:49.443315] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-19T19:14:49.478987] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T19:14:49.732388] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-19T19:14:50.243258] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-19T19:14:50.528392] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T19:14:51.043306] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-19T19:14:51.257808] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T19:14:51.803707] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T19:14:51.843243] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-19T19:14:52.643285] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-19T19:14:53.024444] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:14:53.169892] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T19:14:53.443291] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-19T19:14:53.908502] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T19:14:54.243333] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-19T19:14:55.043285] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-19T19:14:55.525817] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T19:14:55.843328] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-19T19:14:55.976871] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T19:14:56.643275] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-19T19:14:56.663945] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T19:14:57.450317] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-19T19:14:57.452354] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T19:14:57.748943] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T19:14:57.756164] [INFO ] [REMOTE ] HI: Full fetch complete (49677 records). [2025-09-19T19:14:57.756335] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-19T19:14:58.147089] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-19T19:14:58.147182] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-19T19:14:58.148332] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-19T19:14:58.148397] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-19T19:14:58.149932] [DEBUG] [LOCAL ] HI: Trimmed 49677 records to 35665 (keeping 200 days of data) [2025-09-19T19:14:58.243906] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-19T19:14:58.375946] [DEBUG] [LOCAL ] HI: Primary data saved (35665 records). [2025-09-19T19:14:58.376089] [INFO ] [MAIN ] HI: Full history saved. [2025-09-19T19:14:58.376179] [INFO ] [MAIN ] Update Progress: 1017/2372 symbols completed. HI took 28.9s. Estimated remaining: 2h 59m 44s. Rate: 7.5 symbols/min [2025-09-19T19:14:58.562175] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:58.587382] [DEBUG] [LOCAL ] HIO: Loaded 24268 existing records from primary storage. [2025-09-19T19:14:58.587528] [INFO ] [MAIN ] HIO: Loaded 24268 existing records. [2025-09-19T19:14:58.774950] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:58.775221] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-19T19:14:58.775272] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-19T19:14:58.776309] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-19T19:14:58.776379] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-19T19:14:59.053318] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-19T19:14:59.155373] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:59.804040] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T19:14:59.811539] [INFO ] [REMOTE ] HIG: Full fetch complete (73263 records). [2025-09-19T19:14:59.811758] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-19T19:14:59.854615] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-19T19:15:00.234147] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-19T19:15:00.234487] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-19T19:15:00.235613] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-19T19:15:00.235777] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-19T19:15:00.238341] [DEBUG] [LOCAL ] HIG: Trimmed 73263 records to 52033 (keeping 200 days of data) [2025-09-19T19:15:00.356263] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T19:15:00.395248] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-09-19T19:15:00.642916] [DEBUG] [LOCAL ] HIG: Primary data saved (52033 records). [2025-09-19T19:15:00.643055] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-19T19:15:00.644828] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-19T19:15:00.644764] [INFO ] [MAIN ] Update Progress: 1018/2372 symbols completed. HIG took 30.9s. Estimated remaining: 2h 59m 29s. Rate: 7.5 symbols/min [2025-09-19T19:15:00.817554] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:00.840105] [DEBUG] [LOCAL ] HIPO: Loaded 23127 existing records from primary storage. [2025-09-19T19:15:00.840233] [INFO ] [MAIN ] HIPO: Loaded 23127 existing records. [2025-09-19T19:15:01.017916] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:01.018189] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-19T19:15:01.018238] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-19T19:15:01.019048] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-19T19:15:01.019108] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-19T19:15:01.374954] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:01.399902] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T19:15:01.443216] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-19T19:15:02.243304] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-19T19:15:03.043285] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-19T19:15:04.428494] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (3.78 seconds). [2025-09-19T19:15:04.440053] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-19T19:15:05.157524] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-09-19T19:15:05.162963] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-19T19:15:05.649453] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-09-19T19:15:05.657046] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-19T19:15:05.773964] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-19T19:15:05.920431] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T19:15:06.243284] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-19T19:15:07.043331] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-19T19:15:07.399391] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:15:07.405022] [INFO ] [REMOTE ] HII: Full fetch complete (53446 records). [2025-09-19T19:15:07.405182] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-19T19:15:07.759719] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T19:15:07.868885] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-19T19:15:07.911542] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-19T19:15:07.917298] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-19T19:15:07.918280] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-19T19:15:07.918436] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-19T19:15:07.917192] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (3.48 seconds). [2025-09-19T19:15:07.934052] [DEBUG] [LOCAL ] HII: Trimmed 53446 records to 36225 (keeping 200 days of data) [2025-09-19T19:15:08.173597] [DEBUG] [LOCAL ] HII: Primary data saved (36225 records). [2025-09-19T19:15:08.173801] [INFO ] [MAIN ] HII: Full history saved. [2025-09-19T19:15:08.173918] [INFO ] [MAIN ] Update Progress: 1019/2372 symbols completed. HII took 30.2s. Estimated remaining: 2h 59m 20s. Rate: 7.5 symbols/min [2025-09-19T19:15:08.360997] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:08.374760] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T19:15:08.425923] [DEBUG] [LOCAL ] HIW: Loaded 45221 existing records from primary storage. [2025-09-19T19:15:08.426077] [INFO ] [MAIN ] HIW: Loaded 45221 existing records. [2025-09-19T19:15:08.612394] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:08.612712] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-19T19:15:08.612769] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-19T19:15:08.614075] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-19T19:15:08.614133] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-19T19:15:08.648424] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-19T19:15:09.011378] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:09.443265] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-19T19:15:09.506790] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T19:15:10.243268] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-19T19:15:11.043247] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-19T19:15:11.193727] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T19:15:11.477112] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T19:15:11.614497] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-19T19:15:11.843482] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-19T19:15:12.417254] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:15:12.643261] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-19T19:15:13.114062] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T19:15:13.443265] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-19T19:15:14.243268] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-19T19:15:15.043261] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-19T19:15:15.517080] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:15:15.623461] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (2.98 seconds). [2025-09-19T19:15:15.843236] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-19T19:15:15.863064] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T19:15:16.589441] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T19:15:16.643222] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-19T19:15:17.354683] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-19T19:15:17.378213] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T19:15:17.443226] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-19T19:15:18.243264] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-19T19:15:18.709944] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T19:15:19.043265] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-19T19:15:19.208712] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T19:15:19.843262] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-19T19:15:20.529022] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:15:20.533285] [INFO ] [REMOTE ] HIO: Full fetch complete (36881 records). [2025-09-19T19:15:20.533383] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-19T19:15:20.648350] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-19T19:15:20.920198] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-19T19:15:20.920279] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-19T19:15:20.920948] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-19T19:15:20.921034] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-19T19:15:20.921951] [DEBUG] [LOCAL ] HIO: Trimmed 36881 records to 24386 (keeping 200 days of data) [2025-09-19T19:15:21.069491] [DEBUG] [LOCAL ] HIO: Primary data saved (24386 records). [2025-09-19T19:15:21.069678] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-19T19:15:21.069803] [INFO ] [MAIN ] Update Progress: 1020/2372 symbols completed. HIO took 22.7s. Estimated remaining: 2h 59m 19s. Rate: 7.5 symbols/min [2025-09-19T19:15:21.264712] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:21.284632] [DEBUG] [LOCAL ] HIX: Loaded 20398 existing records from primary storage. [2025-09-19T19:15:21.284795] [INFO ] [MAIN ] HIX: Loaded 20398 existing records. [2025-09-19T19:15:21.451682] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-19T19:15:21.475819] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:21.476054] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-19T19:15:21.476133] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-19T19:15:21.476817] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-19T19:15:21.476893] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-19T19:15:21.812846] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T19:15:21.887928] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:22.243268] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-19T19:15:22.695792] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-19T19:15:23.043321] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-19T19:15:23.306819] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:15:23.486441] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T19:15:23.843262] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-19T19:15:24.643286] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-19T19:15:24.986468] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T19:15:24.990366] [INFO ] [REMOTE ] HIPO: Full fetch complete (31817 records). [2025-09-19T19:15:24.990498] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-19T19:15:25.380207] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-19T19:15:25.380302] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-19T19:15:25.381009] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-19T19:15:25.381074] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-19T19:15:25.382064] [DEBUG] [LOCAL ] HIPO: Trimmed 31817 records to 23241 (keeping 200 days of data) [2025-09-19T19:15:25.444504] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-19T19:15:25.539573] [DEBUG] [LOCAL ] HIPO: Primary data saved (23241 records). [2025-09-19T19:15:25.539744] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-19T19:15:25.539853] [INFO ] [MAIN ] Update Progress: 1021/2372 symbols completed. HIPO took 24.9s. Estimated remaining: 2h 59m 6s. Rate: 7.5 symbols/min [2025-09-19T19:15:25.718175] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:25.762820] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-19T19:15:25.784007] [DEBUG] [LOCAL ] HKD: Loaded 18070 existing records from primary storage. [2025-09-19T19:15:25.784141] [INFO ] [MAIN ] HKD: Loaded 18070 existing records. [2025-09-19T19:15:25.963582] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:25.963871] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-19T19:15:25.963922] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-19T19:15:25.964514] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-19T19:15:25.964576] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-19T19:15:26.244940] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-19T19:15:26.326281] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:26.839466] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:15:27.043408] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-19T19:15:27.095197] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-19T19:15:27.843292] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-19T19:15:28.538227] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T19:15:28.643268] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-19T19:15:29.211075] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-19T19:15:29.222076] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-19T19:15:29.222280] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-19T19:15:29.447766] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-19T19:15:29.582570] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T19:15:29.739414] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-19T19:15:29.739519] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-19T19:15:29.740509] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-19T19:15:29.740620] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-19T19:15:29.742490] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54597 (keeping 200 days of data) [2025-09-19T19:15:29.855463] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T19:15:30.119849] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-09-19T19:15:30.120005] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-19T19:15:30.120095] [INFO ] [MAIN ] Update Progress: 1022/2372 symbols completed. HIMS took 50.5s. Estimated remaining: 2h 58m 54s. Rate: 7.5 symbols/min [2025-09-19T19:15:30.247639] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-19T19:15:30.302566] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:30.363778] [DEBUG] [LOCAL ] HL: Loaded 54060 existing records from primary storage. [2025-09-19T19:15:30.363963] [INFO ] [MAIN ] HL: Loaded 54060 existing records. [2025-09-19T19:15:30.555681] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:30.556051] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-19T19:15:30.556113] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-19T19:15:30.557368] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-19T19:15:30.557440] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-19T19:15:30.940721] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T19:15:30.964818] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:31.043287] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-19T19:15:31.309601] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T19:15:31.843264] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-19T19:15:32.402076] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T19:15:32.643277] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-19T19:15:33.443247] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-19T19:15:33.674882] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T19:15:33.766035] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T19:15:34.243282] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-19T19:15:34.653290] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T19:15:35.043279] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-19T19:15:35.843273] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-19T19:15:36.390569] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T19:15:36.648939] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-19T19:15:36.663216] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T19:15:37.443296] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-19T19:15:37.552345] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:15:37.640494] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T19:15:38.243269] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-19T19:15:39.043264] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-19T19:15:39.143296] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T19:15:39.372149] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:15:39.843265] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-19T19:15:40.287863] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:15:40.643261] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-19T19:15:41.262715] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T19:15:41.286277] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T19:15:41.443258] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-19T19:15:42.243263] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-19T19:15:42.801842] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T19:15:43.043223] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-19T19:15:43.595001] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T19:15:43.843274] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-19T19:15:44.643395] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-19T19:15:45.094352] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T19:15:45.118464] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T19:15:45.443259] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-19T19:15:45.757289] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T19:15:46.243263] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-19T19:15:47.043290] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-19T19:15:47.520201] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:15:47.644924] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T19:15:47.650922] [INFO ] [REMOTE ] HKD: Full fetch complete (28636 records). [2025-09-19T19:15:47.651184] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-19T19:15:47.857246] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-19T19:15:48.096320] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-19T19:15:48.096448] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-19T19:15:48.097400] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-19T19:15:48.097506] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-19T19:15:48.099101] [DEBUG] [LOCAL ] HKD: Trimmed 28636 records to 18304 (keeping 200 days of data) [2025-09-19T19:15:48.216252] [DEBUG] [LOCAL ] HKD: Primary data saved (18304 records). [2025-09-19T19:15:48.216433] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-19T19:15:48.216628] [INFO ] [MAIN ] Update Progress: 1023/2372 symbols completed. HKD took 22.7s. Estimated remaining: 2h 58m 59s. Rate: 7.5 symbols/min [2025-09-19T19:15:48.401844] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:48.462956] [DEBUG] [LOCAL ] HLF: Loaded 49283 existing records from primary storage. [2025-09-19T19:15:48.463111] [INFO ] [MAIN ] HLF: Loaded 49283 existing records. [2025-09-19T19:15:48.652985] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-19T19:15:48.660898] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:48.662531] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-19T19:15:48.662596] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-19T19:15:48.664219] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-19T19:15:48.664432] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-19T19:15:49.054467] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T19:15:49.096302] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:49.443247] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-19T19:15:49.909151] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T19:15:49.914013] [INFO ] [REMOTE ] HIX: Full fetch complete (30735 records). [2025-09-19T19:15:49.914097] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-19T19:15:50.246085] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-19T19:15:50.321411] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-19T19:15:50.322160] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-19T19:15:50.323391] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-19T19:15:50.323484] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-19T19:15:50.325487] [DEBUG] [LOCAL ] HIX: Trimmed 30735 records to 20504 (keeping 200 days of data) [2025-09-19T19:15:50.455232] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T19:15:50.507610] [DEBUG] [LOCAL ] HIX: Primary data saved (20504 records). [2025-09-19T19:15:50.507786] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-19T19:15:50.507934] [INFO ] [MAIN ] Update Progress: 1024/2372 symbols completed. HIX took 29.4s. Estimated remaining: 2h 58m 44s. Rate: 7.5 symbols/min [2025-09-19T19:15:50.709290] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:50.763187] [DEBUG] [LOCAL ] HLI: Loaded 31662 existing records from primary storage. [2025-09-19T19:15:50.763337] [INFO ] [MAIN ] HLI: Loaded 31662 existing records. [2025-09-19T19:15:50.962163] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:50.962526] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-19T19:15:50.962631] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-19T19:15:50.964178] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-19T19:15:50.964244] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-19T19:15:51.053182] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-19T19:15:51.281346] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T19:15:51.383932] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:51.654041] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T19:15:51.843288] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-19T19:15:52.643276] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-19T19:15:53.421430] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-19T19:15:53.450386] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-19T19:15:53.453976] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T19:15:54.243262] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-19T19:15:54.513704] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T19:15:54.520719] [INFO ] [REMOTE ] HIW: Full fetch complete (64686 records). [2025-09-19T19:15:54.520869] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-19T19:15:54.919633] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-19T19:15:54.919778] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-19T19:15:54.920877] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-19T19:15:54.920966] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-19T19:15:54.933719] [DEBUG] [LOCAL ] HIW: Trimmed 64686 records to 45529 (keeping 200 days of data) [2025-09-19T19:15:54.959932] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T19:15:55.058890] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-19T19:15:55.248091] [DEBUG] [LOCAL ] HIW: Primary data saved (45529 records). [2025-09-19T19:15:55.248352] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-19T19:15:55.248575] [INFO ] [MAIN ] Update Progress: 1025/2372 symbols completed. HIW took 47.1s. Estimated remaining: 2h 58m 32s. Rate: 7.5 symbols/min [2025-09-19T19:15:55.441410] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:55.447249] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T19:15:55.492065] [DEBUG] [LOCAL ] HLIO: Loaded 28359 existing records from primary storage. [2025-09-19T19:15:55.492249] [INFO ] [MAIN ] HLIO: Loaded 28359 existing records. [2025-09-19T19:15:55.675278] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:55.675704] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-19T19:15:55.675761] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-19T19:15:55.676533] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-19T19:15:55.676592] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-19T19:15:55.848622] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-19T19:15:56.033206] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:56.546988] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T19:15:56.643288] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-19T19:15:57.443279] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-19T19:15:57.818803] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T19:15:57.841132] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T19:15:58.243279] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-19T19:15:59.043232] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-19T19:15:59.289485] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T19:15:59.568900] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T19:15:59.843267] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-19T19:16:00.643345] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-19T19:16:01.392399] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T19:16:01.443239] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-19T19:16:01.489491] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T19:16:01.804324] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T19:16:02.243272] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-19T19:16:02.984146] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:16:03.043248] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-19T19:16:03.843297] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-19T19:16:04.651965] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-19T19:16:04.658242] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T19:16:04.891071] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T19:16:04.985146] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T19:16:05.443268] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-19T19:16:06.243277] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-19T19:16:06.284201] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:16:07.043295] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-19T19:16:07.421193] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T19:16:07.429298] [INFO ] [REMOTE ] HL: Full fetch complete (77651 records). [2025-09-19T19:16:07.429445] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-19T19:16:07.848900] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-19T19:16:07.850713] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-19T19:16:07.850817] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-19T19:16:07.851878] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-19T19:16:07.852092] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-19T19:16:07.856845] [DEBUG] [LOCAL ] HL: Trimmed 77651 records to 54450 (keeping 200 days of data) [2025-09-19T19:16:08.216088] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T19:16:08.246458] [DEBUG] [LOCAL ] HL: Primary data saved (54450 records). [2025-09-19T19:16:08.246614] [INFO ] [MAIN ] HL: Full history saved. [2025-09-19T19:16:08.246749] [INFO ] [MAIN ] Update Progress: 1026/2372 symbols completed. HL took 38.1s. Estimated remaining: 2h 58m 30s. Rate: 7.5 symbols/min [2025-09-19T19:16:08.423382] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:08.457121] [DEBUG] [LOCAL ] HLLY: Loaded 33420 existing records from primary storage. [2025-09-19T19:16:08.457301] [INFO ] [MAIN ] HLLY: Loaded 33420 existing records. [2025-09-19T19:16:08.643854] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-19T19:16:08.647455] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:08.649042] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-19T19:16:08.649098] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-19T19:16:08.649912] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-19T19:16:08.650003] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-19T19:16:08.909587] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:16:09.055668] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:09.070461] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T19:16:09.443348] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-19T19:16:10.136392] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:16:10.243270] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-19T19:16:11.043260] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-19T19:16:11.176850] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T19:16:11.843297] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-19T19:16:12.296749] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T19:16:12.304179] [INFO ] [REMOTE ] HLF: Full fetch complete (71509 records). [2025-09-19T19:16:12.304352] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-19T19:16:12.648221] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-19T19:16:12.749362] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-19T19:16:12.749512] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-19T19:16:12.750544] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-19T19:16:12.750632] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-19T19:16:12.774971] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T19:16:12.775160] [DEBUG] [LOCAL ] HLF: Trimmed 71509 records to 49588 (keeping 200 days of data) [2025-09-19T19:16:13.075979] [DEBUG] [LOCAL ] HLF: Primary data saved (49588 records). [2025-09-19T19:16:13.076139] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-19T19:16:13.076855] [INFO ] [MAIN ] Update Progress: 1027/2372 symbols completed. HLF took 24.9s. Estimated remaining: 2h 58m 18s. Rate: 7.5 symbols/min [2025-09-19T19:16:13.253730] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:13.313235] [DEBUG] [LOCAL ] HLN: Loaded 53472 existing records from primary storage. [2025-09-19T19:16:13.313429] [INFO ] [MAIN ] HLN: Loaded 53472 existing records. [2025-09-19T19:16:13.445770] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-19T19:16:13.546669] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T19:16:13.553787] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:13.561236] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-19T19:16:13.562370] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-19T19:16:13.563604] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-19T19:16:13.563707] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-19T19:16:13.919602] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:14.243333] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-19T19:16:14.398895] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T19:16:15.043269] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-19T19:16:15.177967] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T19:16:15.843269] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-19T19:16:16.452797] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T19:16:16.568092] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T19:16:16.643275] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-19T19:16:17.276419] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:16:17.443282] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-19T19:16:18.245931] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-19T19:16:18.251703] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T19:16:18.729138] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T19:16:19.043301] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-19T19:16:19.132689] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T19:16:19.843278] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-19T19:16:20.205051] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:16:20.209601] [INFO ] [REMOTE ] HLI: Full fetch complete (45145 records). [2025-09-19T19:16:20.209732] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-19T19:16:20.607465] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-19T19:16:20.607555] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-19T19:16:20.608270] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-19T19:16:20.608334] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-19T19:16:20.609438] [DEBUG] [LOCAL ] HLI: Trimmed 45145 records to 31874 (keeping 200 days of data) [2025-09-19T19:16:20.669321] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-19T19:16:20.818496] [DEBUG] [LOCAL ] HLI: Primary data saved (31874 records). [2025-09-19T19:16:20.818674] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-19T19:16:20.818796] [INFO ] [MAIN ] Update Progress: 1028/2372 symbols completed. HLI took 30.3s. Estimated remaining: 2h 58m 10s. Rate: 7.5 symbols/min [2025-09-19T19:16:21.008767] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:21.067920] [DEBUG] [LOCAL ] HLT: Loaded 51154 existing records from primary storage. [2025-09-19T19:16:21.068085] [INFO ] [MAIN ] HLT: Loaded 51154 existing records. [2025-09-19T19:16:21.283495] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:21.283823] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-19T19:16:21.283893] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-19T19:16:21.285299] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-19T19:16:21.285366] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-19T19:16:21.450193] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-19T19:16:21.665226] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:21.695875] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T19:16:22.238391] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T19:16:22.246515] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-19T19:16:23.043265] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-19T19:16:23.409066] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T19:16:23.843262] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-19T19:16:24.171580] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T19:16:24.643271] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-19T19:16:24.901248] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T19:16:25.443283] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-19T19:16:25.485079] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:16:26.243281] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-19T19:16:26.534285] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T19:16:27.043248] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-19T19:16:27.622235] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T19:16:27.716638] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T19:16:27.843243] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-19T19:16:28.643285] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-19T19:16:28.940183] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T19:16:29.436696] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:16:29.444002] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-19T19:16:29.899903] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T19:16:29.903786] [INFO ] [REMOTE ] HLIO: Full fetch complete (36077 records). [2025-09-19T19:16:29.903884] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-19T19:16:30.248395] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-19T19:16:30.326828] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-19T19:16:30.326911] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-19T19:16:30.327638] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-19T19:16:30.327721] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-19T19:16:30.328695] [DEBUG] [LOCAL ] HLIO: Trimmed 36077 records to 28501 (keeping 200 days of data) [2025-09-19T19:16:30.513943] [DEBUG] [LOCAL ] HLIO: Primary data saved (28501 records). [2025-09-19T19:16:30.514090] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-19T19:16:30.514216] [INFO ] [MAIN ] Update Progress: 1029/2372 symbols completed. HLIO took 35.3s. Estimated remaining: 2h 58m 4s. Rate: 7.5 symbols/min [2025-09-19T19:16:30.708104] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:30.753561] [DEBUG] [LOCAL ] HLX: Loaded 48514 existing records from primary storage. [2025-09-19T19:16:30.753738] [INFO ] [MAIN ] HLX: Loaded 48514 existing records. [2025-09-19T19:16:30.942308] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:30.942747] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-19T19:16:30.942816] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-19T19:16:30.943850] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-19T19:16:30.943913] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-19T19:16:31.052276] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-19T19:16:31.335243] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:31.370240] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T19:16:31.627580] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:16:31.843258] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-19T19:16:32.643275] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-19T19:16:32.938496] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T19:16:33.048345] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:16:33.443272] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-19T19:16:34.180496] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:16:34.243317] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-19T19:16:34.970890] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T19:16:35.043298] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-19T19:16:35.843267] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-19T19:16:36.326349] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T19:16:36.643262] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-19T19:16:37.189903] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T19:16:37.339137] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T19:16:37.443266] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-19T19:16:38.243264] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-19T19:16:38.421409] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:16:39.043277] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-19T19:16:39.087115] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T19:16:39.093155] [INFO ] [REMOTE ] HLLY: Full fetch complete (46246 records). [2025-09-19T19:16:39.093267] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-19T19:16:39.492476] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-19T19:16:39.492664] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-19T19:16:39.493856] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-19T19:16:39.493932] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-19T19:16:39.495442] [DEBUG] [LOCAL ] HLLY: Trimmed 46246 records to 33735 (keeping 200 days of data) [2025-09-19T19:16:39.783821] [DEBUG] [LOCAL ] HLLY: Primary data saved (33735 records). [2025-09-19T19:16:39.784089] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-19T19:16:39.784299] [INFO ] [MAIN ] Update Progress: 1030/2372 symbols completed. HLLY took 31.5s. Estimated remaining: 2h 57m 58s. Rate: 7.5 symbols/min [2025-09-19T19:16:39.846048] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-19T19:16:40.194429] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:40.227319] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:16:40.307191] [DEBUG] [LOCAL ] HMC: Loaded 47409 existing records from primary storage. [2025-09-19T19:16:40.307428] [INFO ] [MAIN ] HMC: Loaded 47409 existing records. [2025-09-19T19:16:40.570265] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:40.570543] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-19T19:16:40.570592] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-19T19:16:40.571623] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-19T19:16:40.571723] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-19T19:16:40.649473] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-19T19:16:40.955296] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:41.166917] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T19:16:41.273342] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T19:16:41.443262] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-19T19:16:42.243264] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-19T19:16:42.681937] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T19:16:43.043270] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-19T19:16:43.430513] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T19:16:43.674246] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T19:16:43.843262] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-19T19:16:44.643275] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-19T19:16:45.037216] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:16:45.045324] [INFO ] [REMOTE ] HLN: Full fetch complete (76753 records). [2025-09-19T19:16:45.045471] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-19T19:16:45.449672] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-19T19:16:45.469439] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-19T19:16:45.469510] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-19T19:16:45.470516] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-19T19:16:45.470705] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-19T19:16:45.472415] [DEBUG] [LOCAL ] HLN: Trimmed 76753 records to 53862 (keeping 200 days of data) [2025-09-19T19:16:45.812794] [DEBUG] [LOCAL ] HLN: Primary data saved (53862 records). [2025-09-19T19:16:45.812981] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-19T19:16:45.813551] [INFO ] [MAIN ] Update Progress: 1031/2372 symbols completed. HLN took 32.7s. Estimated remaining: 2h 57m 48s. Rate: 7.5 symbols/min [2025-09-19T19:16:45.996087] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:46.035923] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T19:16:46.066410] [DEBUG] [LOCAL ] HMN: Loaded 23442 existing records from primary storage. [2025-09-19T19:16:46.066554] [INFO ] [MAIN ] HMN: Loaded 23442 existing records. [2025-09-19T19:16:46.244591] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-19T19:16:46.244808] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:46.246139] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-19T19:16:46.246199] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-19T19:16:46.246783] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-19T19:16:46.246946] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-19T19:16:46.637372] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:47.012317] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T19:16:47.043211] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-19T19:16:47.457426] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T19:16:47.843307] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-19T19:16:48.230603] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:16:48.643305] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-19T19:16:48.975097] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:16:49.443332] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-19T19:16:50.059377] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T19:16:50.243309] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-19T19:16:50.502768] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T19:16:51.043263] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-19T19:16:51.327107] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T19:16:51.843323] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-19T19:16:52.270906] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T19:16:52.278570] [INFO ] [REMOTE ] HLT: Full fetch complete (73452 records). [2025-09-19T19:16:52.278771] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-19T19:16:52.652793] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-19T19:16:52.675910] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-19T19:16:52.675981] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-19T19:16:52.676972] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-19T19:16:52.677042] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-19T19:16:52.678587] [DEBUG] [LOCAL ] HLT: Trimmed 73452 records to 51521 (keeping 200 days of data) [2025-09-19T19:16:52.960068] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T19:16:53.055747] [DEBUG] [LOCAL ] HLT: Primary data saved (51521 records). [2025-09-19T19:16:53.055915] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-19T19:16:53.056019] [INFO ] [MAIN ] Update Progress: 1032/2372 symbols completed. HLT took 32.2s. Estimated remaining: 2h 57m 39s. Rate: 7.5 symbols/min [2025-09-19T19:16:53.225884] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:53.280306] [DEBUG] [LOCAL ] HMY: Loaded 53515 existing records from primary storage. [2025-09-19T19:16:53.280488] [INFO ] [MAIN ] HMY: Loaded 53515 existing records. [2025-09-19T19:16:53.456715] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-19T19:16:53.462274] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:53.463437] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-19T19:16:53.463491] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-19T19:16:53.464664] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-19T19:16:53.464760] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-19T19:16:53.890122] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:53.922078] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:16:54.176536] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T19:16:54.243249] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-19T19:16:55.043258] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-19T19:16:55.437547] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T19:16:55.843253] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-19T19:16:56.243199] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T19:16:56.643233] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-19T19:16:57.315611] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:16:57.443301] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-19T19:16:57.679189] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:16:57.698960] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T19:16:57.704891] [INFO ] [REMOTE ] HLX: Full fetch complete (69112 records). [2025-09-19T19:16:57.705116] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-19T19:16:58.135470] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-19T19:16:58.135552] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-19T19:16:58.136543] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-19T19:16:58.136610] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-19T19:16:58.138010] [DEBUG] [LOCAL ] HLX: Trimmed 69112 records to 48858 (keeping 200 days of data) [2025-09-19T19:16:58.245205] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-19T19:16:58.429170] [DEBUG] [LOCAL ] HLX: Primary data saved (48858 records). [2025-09-19T19:16:58.429449] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-19T19:16:58.429568] [INFO ] [MAIN ] Update Progress: 1033/2372 symbols completed. HLX took 27.9s. Estimated remaining: 2h 57m 27s. Rate: 7.5 symbols/min [2025-09-19T19:16:58.598900] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:58.599138] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-19T19:16:58.599194] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-19T19:16:58.599339] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-19T19:16:58.599381] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-19T19:16:58.599420] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-19T19:16:58.599452] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-19T19:16:58.952551] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:59.043301] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-19T19:16:59.370782] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:16:59.469858] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T19:16:59.843280] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-19T19:17:00.073546] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:00.073909] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-19T19:17:00.643265] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-19T19:17:01.150218] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T19:17:01.443290] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-19T19:17:01.835202] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T19:17:02.243312] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-19T19:17:03.043260] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-19T19:17:03.513237] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T19:17:03.843280] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-19T19:17:04.081150] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T19:17:04.186094] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T19:17:04.643266] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-19T19:17:05.443239] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-19T19:17:05.706543] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:05.706900] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-19T19:17:05.982365] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T19:17:06.243253] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-19T19:17:06.793913] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T19:17:07.043277] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-19T19:17:07.843292] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-19T19:17:08.620051] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T19:17:08.645016] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-19T19:17:08.648788] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T19:17:09.443304] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-19T19:17:09.807916] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T19:17:10.196474] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T19:17:10.243233] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-19T19:17:10.856308] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-19T19:17:11.043236] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-19T19:17:11.843322] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-19T19:17:12.098916] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T19:17:12.105723] [INFO ] [REMOTE ] HMC: Full fetch complete (69725 records). [2025-09-19T19:17:12.105837] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-19T19:17:12.489855] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-19T19:17:12.489957] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-19T19:17:12.490929] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-19T19:17:12.490993] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-19T19:17:12.492505] [DEBUG] [LOCAL ] HMC: Trimmed 69725 records to 47743 (keeping 200 days of data) [2025-09-19T19:17:12.659227] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-19T19:17:12.776682] [DEBUG] [LOCAL ] HMC: Primary data saved (47743 records). [2025-09-19T19:17:12.776857] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-19T19:17:12.776952] [INFO ] [MAIN ] Update Progress: 1034/2372 symbols completed. HMC took 33.0s. Estimated remaining: 2h 57m 28s. Rate: 7.5 symbols/min [2025-09-19T19:17:12.947592] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:12.949272] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:12.949769] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-19T19:17:12.982235] [DEBUG] [LOCAL ] HNI: Loaded 29086 existing records from primary storage. [2025-09-19T19:17:12.982382] [INFO ] [MAIN ] HNI: Loaded 29086 existing records. [2025-09-19T19:17:13.163895] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:13.164783] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-19T19:17:13.164976] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-19T19:17:13.165854] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-19T19:17:13.165915] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-19T19:17:13.458514] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-19T19:17:13.508814] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T19:17:13.580337] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T19:17:13.629783] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:13.987208] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:13.987753] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-19T19:17:14.243293] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-19T19:17:15.043227] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-19T19:17:15.579501] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T19:17:15.843238] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-19T19:17:16.297306] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:17:16.643257] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-19T19:17:17.148560] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T19:17:17.443277] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-19T19:17:17.969639] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:17:17.973505] [INFO ] [REMOTE ] HMN: Full fetch complete (31553 records). [2025-09-19T19:17:17.973606] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-19T19:17:18.248421] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-19T19:17:18.382893] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-19T19:17:18.382981] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-19T19:17:18.383694] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-19T19:17:18.383755] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-19T19:17:18.384544] [DEBUG] [LOCAL ] HMN: Trimmed 31553 records to 23567 (keeping 200 days of data) [2025-09-19T19:17:18.501182] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T19:17:18.551466] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:18.552955] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-19T19:17:18.559185] [DEBUG] [LOCAL ] HMN: Primary data saved (23567 records). [2025-09-19T19:17:18.559330] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-19T19:17:18.559443] [INFO ] [MAIN ] Update Progress: 1035/2372 symbols completed. HMN took 32.7s. Estimated remaining: 2h 57m 17s. Rate: 7.5 symbols/min [2025-09-19T19:17:18.749807] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:18.803141] [DEBUG] [LOCAL ] HOG: Loaded 51670 existing records from primary storage. [2025-09-19T19:17:18.803338] [INFO ] [MAIN ] HOG: Loaded 51670 existing records. [2025-09-19T19:17:18.978523] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:18.978836] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-19T19:17:18.978898] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-19T19:17:18.981563] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-19T19:17:18.981632] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-19T19:17:19.048490] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-19T19:17:19.349876] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:19.843286] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-19T19:17:20.643276] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-19T19:17:21.394866] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-19T19:17:21.443228] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-19T19:17:21.745406] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:17:21.764082] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T19:17:22.243274] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-19T19:17:23.043290] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-19T19:17:23.308428] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T19:17:23.843297] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-19T19:17:23.956129] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:17:24.398274] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T19:17:24.643297] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-19T19:17:25.443222] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-19T19:17:26.058281] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T19:17:26.066821] [INFO ] [REMOTE ] HMY: Full fetch complete (76620 records). [2025-09-19T19:17:26.066967] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-19T19:17:26.249876] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-19T19:17:26.500104] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-19T19:17:26.500238] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-19T19:17:26.501306] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-19T19:17:26.501428] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-19T19:17:26.528406] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T19:17:26.537140] [DEBUG] [LOCAL ] HMY: Trimmed 76620 records to 53905 (keeping 200 days of data) [2025-09-19T19:17:26.864051] [DEBUG] [LOCAL ] HMY: Primary data saved (53905 records). [2025-09-19T19:17:26.864261] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-19T19:17:26.864378] [INFO ] [MAIN ] Update Progress: 1036/2372 symbols completed. HMY took 33.8s. Estimated remaining: 2h 57m 9s. Rate: 7.5 symbols/min [2025-09-19T19:17:27.061227] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:27.061441] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-19T19:17:27.087131] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T19:17:27.132946] [DEBUG] [LOCAL ] HOMB: Loaded 44071 existing records from primary storage. [2025-09-19T19:17:27.133099] [INFO ] [MAIN ] HOMB: Loaded 44071 existing records. [2025-09-19T19:17:27.314914] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:27.315162] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-19T19:17:27.315210] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-19T19:17:27.316261] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-19T19:17:27.316322] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-19T19:17:27.679158] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:27.843248] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-19T19:17:28.272884] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T19:17:28.643237] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-19T19:17:28.775757] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T19:17:29.443263] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-19T19:17:29.851416] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:17:30.243241] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-19T19:17:30.834845] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T19:17:30.956307] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:17:31.043292] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-19T19:17:31.843274] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-19T19:17:32.142414] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T19:17:32.410115] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T19:17:32.643286] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-19T19:17:33.443357] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-19T19:17:33.907511] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T19:17:33.989290] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T19:17:33.997404] [INFO ] [REMOTE ] HNGE: Full fetch complete (25381 records). [2025-09-19T19:17:33.997734] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-19T19:17:34.223318] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 83 unique days, need 200 days [2025-09-19T19:17:34.223878] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:17:34.223985] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:17:34.224086] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-19T19:17:34.224217] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-19T19:17:34.224289] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-19T19:17:34.224368] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-19T19:17:34.224496] [INFO ] [MAIN ] Update Progress: 1037/2372 symbols completed. HNGE took 35.8s. Estimated remaining: 2h 57m 1s. Rate: 7.5 symbols/min [2025-09-19T19:17:34.243302] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-19T19:17:34.850906] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T19:17:35.043272] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-19T19:17:35.599023] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T19:17:35.843280] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-19T19:17:36.643269] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-19T19:17:36.965956] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:17:37.349432] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T19:17:37.443234] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-19T19:17:38.243293] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-19T19:17:38.461278] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T19:17:39.043310] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-19T19:17:39.141302] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:17:39.843344] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-19T19:17:40.216763] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T19:17:40.541076] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T19:17:40.643259] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-19T19:17:41.221210] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T19:17:41.227055] [INFO ] [REMOTE ] HNI: Full fetch complete (40876 records). [2025-09-19T19:17:41.227150] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-19T19:17:41.452625] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-19T19:17:41.605310] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-19T19:17:41.605417] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-19T19:17:41.606183] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-19T19:17:41.606266] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-19T19:17:41.607255] [DEBUG] [LOCAL ] HNI: Trimmed 40876 records to 29351 (keeping 200 days of data) [2025-09-19T19:17:41.792810] [DEBUG] [LOCAL ] HNI: Primary data saved (29351 records). [2025-09-19T19:17:41.792953] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-19T19:17:41.793071] [INFO ] [MAIN ] Update Progress: 1038/2372 symbols completed. HNI took 29.0s. Estimated remaining: 2h 56m 52s. Rate: 7.5 symbols/min [2025-09-19T19:17:42.651863] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T19:17:42.663513] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-19T19:17:42.703340] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T19:17:43.043308] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-19T19:17:44.128286] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T19:17:44.143112] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-19T19:17:44.923885] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:17:44.933267] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-19T19:17:46.121876] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T19:17:46.129393] [INFO ] [REMOTE ] HOG: Full fetch complete (74231 records). [2025-09-19T19:17:46.129559] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-19T19:17:46.540004] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-19T19:17:46.540117] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-19T19:17:46.541229] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-19T19:17:46.541315] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-19T19:17:46.545913] [DEBUG] [LOCAL ] HOG: Trimmed 74231 records to 52045 (keeping 200 days of data) [2025-09-19T19:17:46.827963] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T19:17:46.843521] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-19T19:17:46.940456] [DEBUG] [LOCAL ] HOG: Primary data saved (52045 records). [2025-09-19T19:17:46.940602] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-19T19:17:46.941249] [INFO ] [MAIN ] Update Progress: 1039/2372 symbols completed. HOG took 28.4s. Estimated remaining: 2h 56m 41s. Rate: 7.5 symbols/min [2025-09-19T19:17:48.658279] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:17:48.667563] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-19T19:17:50.437853] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T19:17:50.445842] [INFO ] [REMOTE ] HOMB: Full fetch complete (63563 records). [2025-09-19T19:17:50.445969] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-19T19:17:50.870469] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-19T19:17:50.870558] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-19T19:17:50.871733] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-19T19:17:50.871811] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-19T19:17:50.873402] [DEBUG] [LOCAL ] HOMB: Trimmed 63563 records to 44380 (keeping 200 days of data) [2025-09-19T19:17:51.155271] [DEBUG] [LOCAL ] HOMB: Primary data saved (44380 records). [2025-09-19T19:17:51.155405] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-19T19:17:51.155529] [INFO ] [MAIN ] Update Progress: 1040/2372 symbols completed. HOMB took 24.3s. Estimated remaining: 2h 56m 28s. Rate: 7.5 symbols/min [2025-09-19T19:17:51.793218] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:51.895866] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:51.907748] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:51.918682] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:51.966760] [DEBUG] [LOCAL ] HOV: Loaded 13888 existing records from primary storage. [2025-09-19T19:17:51.966925] [INFO ] [MAIN ] HOV: Loaded 13888 existing records. [2025-09-19T19:17:52.104177] [DEBUG] [LOCAL ] HOUS: Loaded 44321 existing records from primary storage. [2025-09-19T19:17:52.104637] [INFO ] [MAIN ] HOUS: Loaded 44321 existing records. [2025-09-19T19:17:52.309731] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:52.326394] [DEBUG] [LOCAL ] HP: Loaded 52009 existing records from primary storage. [2025-09-19T19:17:52.343243] [INFO ] [MAIN ] HP: Loaded 52009 existing records. [2025-09-19T19:17:52.350932] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-19T19:17:52.439119] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-19T19:17:52.504943] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-09-19T19:17:52.505139] [INFO ] [MAIN ] HPE: Loaded 54087 existing records. [2025-09-19T19:17:52.538714] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:52.495712] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-19T19:17:52.581319] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-19T19:17:52.610658] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-19T19:17:52.627209] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-19T19:17:52.707717] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-19T19:17:52.787391] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-19T19:17:52.907818] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:53.072468] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-19T19:17:53.086261] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-19T19:17:53.117067] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-19T19:17:53.163955] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-19T19:17:53.163867] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:53.288425] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-19T19:17:53.360701] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-19T19:17:53.428699] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-19T19:17:53.491587] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-19T19:17:53.766856] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:53.836307] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-19T19:17:53.959149] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:53.998110] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-19T19:17:54.290024] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:54.300440] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-19T19:17:54.378175] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:54.378463] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-19T19:17:55.113254] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T19:17:55.117008] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-19T19:17:55.486311] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T19:17:55.494544] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-19T19:17:56.068049] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T19:17:56.072612] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-19T19:17:56.210580] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T19:17:56.220898] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-19T19:17:56.687922] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T19:17:56.699146] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-19T19:17:57.006266] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:17:57.010017] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-19T19:17:57.128242] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T19:17:57.137275] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-19T19:17:58.000272] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:17:58.010352] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-19T19:17:58.098609] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T19:17:58.101748] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-19T19:17:58.371161] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T19:17:58.379325] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-19T19:17:58.733332] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T19:17:58.744680] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-19T19:17:58.757342] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T19:17:59.043321] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-19T19:17:59.354219] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:17:59.613173] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T19:17:59.843244] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-19T19:18:00.144292] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T19:18:00.257308] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T19:18:00.643251] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-19T19:18:01.406762] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:18:01.443215] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-19T19:18:02.243371] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-19T19:18:02.615145] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:18:03.043278] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-19T19:18:03.843327] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-19T19:18:04.895335] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T19:18:04.899634] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-19T19:18:05.145494] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T19:18:05.443294] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-19T19:18:05.520945] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (4.08 seconds). [2025-09-19T19:18:05.610185] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T19:18:05.667380] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T19:18:06.243270] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-19T19:18:07.043272] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-19T19:18:07.699435] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T19:18:07.818699] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T19:18:07.843222] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-19T19:18:08.214809] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:18:08.643273] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-19T19:18:09.443274] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-19T19:18:10.004780] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T19:18:10.243287] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-19T19:18:10.357382] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:18:11.043301] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-19T19:18:11.668628] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T19:18:11.843277] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-19T19:18:12.329269] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T19:18:12.331755] [INFO ] [REMOTE ] HOV: Full fetch complete (19429 records). [2025-09-19T19:18:12.331829] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-19T19:18:12.653179] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-19T19:18:12.718224] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T19:18:12.791521] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-19T19:18:12.791625] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-19T19:18:12.792287] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-19T19:18:12.792351] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-19T19:18:12.792967] [DEBUG] [LOCAL ] HOV: Trimmed 19429 records to 13971 (keeping 200 days of data) [2025-09-19T19:18:12.882221] [DEBUG] [LOCAL ] HOV: Primary data saved (13971 records). [2025-09-19T19:18:12.882382] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-19T19:18:12.882480] [INFO ] [MAIN ] Update Progress: 1041/2372 symbols completed. HOV took 21.7s. Estimated remaining: 2h 56m 38s. Rate: 7.5 symbols/min [2025-09-19T19:18:13.049165] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:13.058761] [DEBUG] [LOCAL ] HPF: Loaded 7301 existing records from primary storage. [2025-09-19T19:18:13.058868] [INFO ] [MAIN ] HPF: Loaded 7301 existing records. [2025-09-19T19:18:13.233917] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:13.234194] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-19T19:18:13.234242] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-19T19:18:13.234769] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-19T19:18:13.234832] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-19T19:18:13.454272] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-19T19:18:13.603218] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:13.967823] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:18:14.243277] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-19T19:18:14.423904] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:18:15.043276] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-19T19:18:15.495208] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:18:15.843268] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-19T19:18:15.953622] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T19:18:16.151245] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T19:18:16.643279] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-19T19:18:17.443293] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-19T19:18:17.897100] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T19:18:17.986929] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T19:18:18.243264] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-19T19:18:19.043280] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-19T19:18:19.793102] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T19:18:19.843233] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-19T19:18:19.948532] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-19T19:18:19.956345] [INFO ] [REMOTE ] HP: Full fetch complete (73899 records). [2025-09-19T19:18:19.956475] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-19T19:18:20.359664] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-19T19:18:20.359758] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-19T19:18:20.360701] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-19T19:18:20.360776] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-19T19:18:20.362286] [DEBUG] [LOCAL ] HP: Trimmed 73899 records to 52374 (keeping 200 days of data) [2025-09-19T19:18:20.493814] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T19:18:20.504670] [INFO ] [REMOTE ] HOUS: Full fetch complete (62476 records). [2025-09-19T19:18:20.506107] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-19T19:18:20.678770] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-19T19:18:20.964129] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T19:18:21.058956] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-19T19:18:21.062821] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-19T19:18:21.063927] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-19T19:18:21.093173] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-19T19:18:21.119188] [DEBUG] [LOCAL ] HOUS: Trimmed 62476 records to 44658 (keeping 200 days of data) [2025-09-19T19:18:21.219290] [DEBUG] [LOCAL ] HP: Primary data saved (52374 records). [2025-09-19T19:18:21.220169] [INFO ] [MAIN ] HP: Full history saved. [2025-09-19T19:18:21.221492] [INFO ] [MAIN ] Update Progress: 1042/2372 symbols completed. HP took 30.1s. Estimated remaining: 2h 56m 30s. Rate: 7.5 symbols/min [2025-09-19T19:18:21.420472] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:21.439813] [DEBUG] [LOCAL ] HPI: Loaded 10086 existing records from primary storage. [2025-09-19T19:18:21.440329] [INFO ] [MAIN ] HPI: Loaded 10086 existing records. [2025-09-19T19:18:21.452063] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-19T19:18:21.730794] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:21.731909] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-19T19:18:21.732264] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-19T19:18:21.736695] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-19T19:18:21.736772] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-19T19:18:21.902789] [DEBUG] [LOCAL ] HOUS: Primary data saved (44658 records). [2025-09-19T19:18:21.935298] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-19T19:18:21.951798] [INFO ] [MAIN ] Update Progress: 1043/2372 symbols completed. HOUS took 30.8s. Estimated remaining: 2h 56m 13s. Rate: 7.5 symbols/min [2025-09-19T19:18:22.312397] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:22.309488] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:22.312769] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-19T19:18:22.361708] [DEBUG] [LOCAL ] HPP: Loaded 51117 existing records from primary storage. [2025-09-19T19:18:22.361855] [INFO ] [MAIN ] HPP: Loaded 51117 existing records. [2025-09-19T19:18:22.477572] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T19:18:22.552802] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:22.553090] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-19T19:18:22.553182] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-19T19:18:22.554528] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-19T19:18:22.554589] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-19T19:18:22.903509] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:23.043221] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-19T19:18:23.175037] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-19T19:18:23.191381] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T19:18:23.775683] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T19:18:23.843275] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-19T19:18:24.643280] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-19T19:18:25.266275] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T19:18:25.443324] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-19T19:18:25.788391] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T19:18:25.996230] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-19T19:18:26.243338] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-19T19:18:26.681564] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-19T19:18:27.043286] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-19T19:18:27.843245] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-19T19:18:28.106300] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T19:18:28.643264] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-19T19:18:29.443264] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-19T19:18:30.243275] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-19T19:18:30.393283] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-19T19:18:30.393727] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T19:18:30.405364] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-19T19:18:30.405507] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-19T19:18:30.847169] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-19T19:18:30.847294] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-19T19:18:30.848336] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-19T19:18:30.848470] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-19T19:18:30.924549] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-19T19:18:30.922805] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54477 (keeping 200 days of data) [2025-09-19T19:18:31.043235] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-19T19:18:31.277929] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T19:18:31.303987] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-09-19T19:18:31.304122] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-19T19:18:31.304226] [INFO ] [MAIN ] Update Progress: 1044/2372 symbols completed. HPE took 40.1s. Estimated remaining: 2h 56m 7s. Rate: 7.5 symbols/min [2025-09-19T19:18:31.490309] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:31.544626] [DEBUG] [LOCAL ] HPQ: Loaded 54059 existing records from primary storage. [2025-09-19T19:18:31.544816] [INFO ] [MAIN ] HPQ: Loaded 54059 existing records. [2025-09-19T19:18:31.741097] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:31.741373] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-19T19:18:31.741426] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-19T19:18:31.743109] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-19T19:18:31.743174] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-19T19:18:31.851717] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-19T19:18:32.075784] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T19:18:32.148336] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:32.643275] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-19T19:18:33.443278] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-19T19:18:33.512061] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:18:33.608446] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T19:18:33.610716] [INFO ] [REMOTE ] HPF: Full fetch complete (10803 records). [2025-09-19T19:18:33.610824] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-19T19:18:33.988946] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-19T19:18:33.989056] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-19T19:18:33.989326] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-19T19:18:33.989367] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-19T19:18:33.989868] [DEBUG] [LOCAL ] HPF: Trimmed 10803 records to 7364 (keeping 200 days of data) [2025-09-19T19:18:34.036567] [DEBUG] [LOCAL ] HPF: Primary data saved (7364 records). [2025-09-19T19:18:34.036729] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-19T19:18:34.036835] [INFO ] [MAIN ] Update Progress: 1045/2372 symbols completed. HPF took 21.2s. Estimated remaining: 2h 55m 52s. Rate: 7.5 symbols/min [2025-09-19T19:18:34.203805] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:34.215372] [DEBUG] [LOCAL ] HPS: Loaded 10359 existing records from primary storage. [2025-09-19T19:18:34.215489] [INFO ] [MAIN ] HPS: Loaded 10359 existing records. [2025-09-19T19:18:34.248323] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-19T19:18:34.402132] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:34.402579] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-19T19:18:34.402792] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-19T19:18:34.408815] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-19T19:18:34.409787] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T19:18:34.409539] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-19T19:18:34.801164] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:35.043268] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-19T19:18:35.843282] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-19T19:18:36.309171] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T19:18:36.422198] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T19:18:36.643285] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-19T19:18:36.846767] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T19:18:37.443277] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-19T19:18:38.243270] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-19T19:18:38.327659] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-19T19:18:38.577352] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:18:39.043276] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-19T19:18:39.213551] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T19:18:39.843307] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-19T19:18:40.643266] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-19T19:18:41.164890] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T19:18:41.205385] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-19T19:18:41.257619] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T19:18:41.443310] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-19T19:18:42.243310] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-19T19:18:43.043331] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-19T19:18:43.843411] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-19T19:18:43.974894] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-19T19:18:43.994187] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T19:18:44.027550] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T19:18:44.643282] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-19T19:18:44.855177] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T19:18:45.443280] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-19T19:18:45.544071] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T19:18:46.243285] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-19T19:18:47.043270] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-19T19:18:47.542325] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T19:18:47.577879] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:18:47.581274] [INFO ] [REMOTE ] HPI: Full fetch complete (13399 records). [2025-09-19T19:18:47.581351] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-19T19:18:47.848465] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-19T19:18:47.968002] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-19T19:18:47.968085] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-19T19:18:47.968441] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-19T19:18:47.968487] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-19T19:18:47.969008] [DEBUG] [LOCAL ] HPI: Trimmed 13399 records to 10185 (keeping 200 days of data) [2025-09-19T19:18:48.032263] [DEBUG] [LOCAL ] HPI: Primary data saved (10185 records). [2025-09-19T19:18:48.032399] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-19T19:18:48.032486] [INFO ] [MAIN ] Update Progress: 1046/2372 symbols completed. HPI took 26.8s. Estimated remaining: 2h 55m 52s. Rate: 7.5 symbols/min [2025-09-19T19:18:48.199039] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:48.223241] [DEBUG] [LOCAL ] HQH: Loaded 25114 existing records from primary storage. [2025-09-19T19:18:48.223370] [INFO ] [MAIN ] HQH: Loaded 25114 existing records. [2025-09-19T19:18:48.403731] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:48.404228] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-19T19:18:48.404355] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-19T19:18:48.405295] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-19T19:18:48.405358] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-19T19:18:48.603249] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T19:18:48.646283] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-19T19:18:48.847169] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:49.443281] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-19T19:18:49.662592] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T19:18:50.242765] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T19:18:50.253424] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-19T19:18:51.043258] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-19T19:18:51.301022] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:18:51.843292] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-19T19:18:52.065891] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T19:18:52.170208] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T19:18:52.643337] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-19T19:18:53.443306] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-19T19:18:53.827314] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:18:53.874275] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:18:54.243269] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-19T19:18:55.043272] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-19T19:18:55.135163] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T19:18:55.358126] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T19:18:55.843245] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-19T19:18:56.450861] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:18:56.643249] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-19T19:18:57.057493] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T19:18:57.059910] [INFO ] [REMOTE ] HPS: Full fetch complete (15139 records). [2025-09-19T19:18:57.059996] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-19T19:18:57.445295] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-19T19:18:57.445127] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-19T19:18:57.445677] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-19T19:18:57.447477] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-19T19:18:57.447553] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-19T19:18:57.448564] [DEBUG] [LOCAL ] HPS: Trimmed 15139 records to 10420 (keeping 200 days of data) [2025-09-19T19:18:57.519267] [DEBUG] [LOCAL ] HPS: Primary data saved (10420 records). [2025-09-19T19:18:57.519425] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-19T19:18:57.519515] [INFO ] [MAIN ] Update Progress: 1047/2372 symbols completed. HPS took 23.5s. Estimated remaining: 2h 55m 46s. Rate: 7.5 symbols/min [2025-09-19T19:18:57.694200] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:57.711790] [DEBUG] [LOCAL ] HQL: Loaded 16275 existing records from primary storage. [2025-09-19T19:18:57.711928] [INFO ] [MAIN ] HQL: Loaded 16275 existing records. [2025-09-19T19:18:57.887082] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:57.887371] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-19T19:18:57.887420] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-19T19:18:57.888066] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-19T19:18:57.888128] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-19T19:18:58.197297] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T19:18:58.252719] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-19T19:18:58.296037] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:59.043261] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-19T19:18:59.083066] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T19:18:59.533260] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T19:18:59.843262] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-19T19:19:00.643330] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-19T19:19:01.008162] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T19:19:01.443306] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-19T19:19:01.542218] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T19:19:01.550308] [INFO ] [REMOTE ] HPP: Full fetch complete (73354 records). [2025-09-19T19:19:01.550496] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-19T19:19:01.913130] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T19:19:01.998139] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-19T19:19:01.998236] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-19T19:19:01.999189] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-19T19:19:01.999258] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-19T19:19:02.000829] [DEBUG] [LOCAL ] HPP: Trimmed 73354 records to 51503 (keeping 200 days of data) [2025-09-19T19:19:02.257968] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-19T19:19:02.302134] [DEBUG] [LOCAL ] HPP: Primary data saved (51503 records). [2025-09-19T19:19:02.302348] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-19T19:19:02.302500] [INFO ] [MAIN ] Update Progress: 1048/2372 symbols completed. HPP took 40.3s. Estimated remaining: 2h 55m 34s. Rate: 7.5 symbols/min [2025-09-19T19:19:02.479400] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:02.538776] [DEBUG] [LOCAL ] HR: Loaded 52355 existing records from primary storage. [2025-09-19T19:19:02.538992] [INFO ] [MAIN ] HR: Loaded 52355 existing records. [2025-09-19T19:19:02.651605] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:19:02.733525] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:02.733843] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-19T19:19:02.733923] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-19T19:19:02.735146] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-19T19:19:02.735208] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-19T19:19:03.048360] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-19T19:19:03.091579] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:03.843313] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-19T19:19:03.990519] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T19:19:04.534570] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T19:19:04.643306] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-19T19:19:05.314161] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T19:19:05.443304] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-19T19:19:06.243314] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-19T19:19:06.346948] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T19:19:06.355529] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-19T19:19:06.355743] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-19T19:19:06.805495] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-19T19:19:06.805811] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-19T19:19:06.807918] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-19T19:19:06.808052] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-19T19:19:06.825286] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:19:06.832360] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 54448 (keeping 200 days of data) [2025-09-19T19:19:07.057011] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-19T19:19:07.207321] [DEBUG] [LOCAL ] HPQ: Primary data saved (54448 records). [2025-09-19T19:19:07.207536] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-19T19:19:07.207675] [INFO ] [MAIN ] Update Progress: 1049/2372 symbols completed. HPQ took 35.9s. Estimated remaining: 2h 55m 22s. Rate: 7.5 symbols/min [2025-09-19T19:19:07.397165] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:07.460475] [DEBUG] [LOCAL ] HRB: Loaded 48974 existing records from primary storage. [2025-09-19T19:19:07.460749] [INFO ] [MAIN ] HRB: Loaded 48974 existing records. [2025-09-19T19:19:07.672834] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:19:07.678985] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:07.683564] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-19T19:19:07.683637] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-19T19:19:07.685009] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-19T19:19:07.685078] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-19T19:19:07.846530] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-19T19:19:08.050711] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:08.607085] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:19:08.643270] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-19T19:19:09.443342] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-19T19:19:09.778666] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:19:09.991874] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T19:19:10.243277] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-19T19:19:10.621512] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T19:19:11.043289] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-19T19:19:11.843282] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-19T19:19:11.965780] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T19:19:12.419281] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T19:19:12.423139] [INFO ] [REMOTE ] HQH: Full fetch complete (37417 records). [2025-09-19T19:19:12.423227] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-19T19:19:12.618486] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T19:19:12.648898] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-19T19:19:12.830207] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-19T19:19:12.830310] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-19T19:19:12.831093] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-19T19:19:12.831157] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-19T19:19:12.832004] [DEBUG] [LOCAL ] HQH: Trimmed 37417 records to 25294 (keeping 200 days of data) [2025-09-19T19:19:12.987782] [DEBUG] [LOCAL ] HQH: Primary data saved (25294 records). [2025-09-19T19:19:12.987918] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-19T19:19:12.988033] [INFO ] [MAIN ] Update Progress: 1050/2372 symbols completed. HQH took 25.0s. Estimated remaining: 2h 55m 11s. Rate: 7.5 symbols/min [2025-09-19T19:19:13.158411] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:13.194348] [DEBUG] [LOCAL ] HRI: Loaded 33522 existing records from primary storage. [2025-09-19T19:19:13.194494] [INFO ] [MAIN ] HRI: Loaded 33522 existing records. [2025-09-19T19:19:13.388347] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:13.388731] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-19T19:19:13.388807] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-19T19:19:13.389872] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-19T19:19:13.389952] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-19T19:19:13.454751] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-19T19:19:13.749357] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:14.243287] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-19T19:19:14.661458] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:19:14.682746] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T19:19:15.043282] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-19T19:19:15.391796] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:19:15.843288] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-19T19:19:15.977087] [DEBUG] [REMOTE ] HRI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T19:19:15.977454] [WARN ] [REMOTE ] HRI: No data returned for month 2025-01 [2025-09-19T19:19:16.643270] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-19T19:19:16.856031] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T19:19:17.443312] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-19T19:19:18.243322] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-19T19:19:18.288871] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T19:19:19.043372] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-19T19:19:19.233926] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:19:19.447786] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T19:19:19.843311] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-19T19:19:20.650371] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-19T19:19:20.668693] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:19:21.443309] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-19T19:19:21.750920] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T19:19:22.243276] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-19T19:19:22.583771] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:19:22.803678] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T19:19:23.043276] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-19T19:19:23.492012] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T19:19:23.794020] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:19:23.843296] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-19T19:19:24.643270] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-19T19:19:25.446840] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-19T19:19:25.449288] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T19:19:26.243243] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-19T19:19:26.371629] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T19:19:27.043310] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-19T19:19:27.379140] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:19:27.457508] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T19:19:27.843277] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-19T19:19:28.643275] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-19T19:19:28.861413] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T19:19:28.980276] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T19:19:29.443272] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-19T19:19:30.243288] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-19T19:19:30.518956] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:19:30.615219] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:19:31.043284] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-19T19:19:31.731786] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T19:19:31.843262] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-19T19:19:31.974960] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T19:19:31.977578] [INFO ] [REMOTE ] HQL: Full fetch complete (24072 records). [2025-09-19T19:19:31.977691] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-19T19:19:32.362663] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-19T19:19:32.362759] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-19T19:19:32.363263] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-19T19:19:32.363302] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-19T19:19:32.363990] [DEBUG] [LOCAL ] HQL: Trimmed 24072 records to 16379 (keeping 200 days of data) [2025-09-19T19:19:32.473037] [DEBUG] [LOCAL ] HQL: Primary data saved (16379 records). [2025-09-19T19:19:32.473253] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-19T19:19:32.473400] [INFO ] [MAIN ] Update Progress: 1051/2372 symbols completed. HQL took 35.0s. Estimated remaining: 2h 55m 18s. Rate: 7.5 symbols/min [2025-09-19T19:19:32.652734] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-19T19:19:32.656346] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:32.723387] [DEBUG] [LOCAL ] HRL: Loaded 53469 existing records from primary storage. [2025-09-19T19:19:32.723588] [INFO ] [MAIN ] HRL: Loaded 53469 existing records. [2025-09-19T19:19:32.916278] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:32.916582] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-19T19:19:32.916668] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-19T19:19:32.918039] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-19T19:19:32.918101] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-19T19:19:33.319514] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:33.443264] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-19T19:19:33.880872] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:19:33.911609] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T19:19:34.243266] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-19T19:19:35.043263] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-19T19:19:35.315529] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T19:19:35.405283] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:19:35.410484] [INFO ] [REMOTE ] HRI: Full fetch complete (41920 records). [2025-09-19T19:19:35.410762] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-19T19:19:35.604780] [WARN ] [VALIDATOR ] HRI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T19:19:35.605259] [FATAL] [MAIN ] HRI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:19:35.605330] [WARN ] [MAIN ] HRI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:19:35.605402] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-19T19:19:35.605484] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-09-19T19:19:35.605612] [INFO ] [LOCAL ] HRI: Starting deletion of derivative data. [2025-09-19T19:19:35.606119] [DEBUG] [LOCAL ] HRI: Deleted derivative data file. [2025-09-19T19:19:35.608019] [INFO ] [MAIN ] Update Progress: 1052/2372 symbols completed. HRI took 22.6s. Estimated remaining: 2h 55m 4s. Rate: 7.5 symbols/min [2025-09-19T19:19:35.778134] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:35.812544] [DEBUG] [LOCAL ] HRTG: Loaded 32581 existing records from primary storage. [2025-09-19T19:19:35.812709] [INFO ] [MAIN ] HRTG: Loaded 32581 existing records. [2025-09-19T19:19:35.848373] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-19T19:19:35.996666] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:35.996907] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-19T19:19:35.996962] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-19T19:19:35.998079] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-19T19:19:35.998141] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-19T19:19:36.390392] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:36.643271] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-19T19:19:37.001814] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T19:19:37.443251] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-19T19:19:37.899938] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T19:19:37.937503] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:19:38.243275] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-19T19:19:39.043282] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-19T19:19:39.196716] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:19:39.678010] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T19:19:39.686580] [INFO ] [REMOTE ] HR: Full fetch complete (74806 records). [2025-09-19T19:19:39.686775] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-19T19:19:39.852633] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-19T19:19:40.118748] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-19T19:19:40.118845] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-19T19:19:40.119969] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-19T19:19:40.120037] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-19T19:19:40.121704] [DEBUG] [LOCAL ] HR: Trimmed 74806 records to 52730 (keeping 200 days of data) [2025-09-19T19:19:40.462523] [DEBUG] [LOCAL ] HR: Primary data saved (52730 records). [2025-09-19T19:19:40.462706] [INFO ] [MAIN ] HR: Full history saved. [2025-09-19T19:19:40.462812] [INFO ] [MAIN ] Update Progress: 1053/2372 symbols completed. HR took 38.2s. Estimated remaining: 2h 54m 52s. Rate: 7.5 symbols/min [2025-09-19T19:19:40.644439] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-19T19:19:40.657050] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:40.658281] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-09-19T19:19:40.658338] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-09-19T19:19:40.658491] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-19T19:19:40.658536] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-19T19:19:40.658579] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-09-19T19:19:40.658613] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-19T19:19:41.052114] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:41.083243] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T19:19:41.122640] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T19:19:41.443268] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-19T19:19:42.243315] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-19T19:19:42.700071] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T19:19:43.043244] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-19T19:19:43.390927] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T19:19:43.508951] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:19:43.843271] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-19T19:19:44.361693] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T19:19:44.643266] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-19T19:19:45.443294] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-19T19:19:45.666966] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T19:19:45.674373] [INFO ] [REMOTE ] HRB: Full fetch complete (69819 records). [2025-09-19T19:19:45.674500] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-19T19:19:45.997180] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:19:46.088039] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-19T19:19:46.088120] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-19T19:19:46.089032] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-19T19:19:46.089094] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-19T19:19:46.090434] [DEBUG] [LOCAL ] HRB: Trimmed 69819 records to 49332 (keeping 200 days of data) [2025-09-19T19:19:46.269444] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-19T19:19:46.398876] [DEBUG] [LOCAL ] HRB: Primary data saved (49332 records). [2025-09-19T19:19:46.399057] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-19T19:19:46.399172] [INFO ] [MAIN ] Update Progress: 1054/2372 symbols completed. HRB took 39.2s. Estimated remaining: 2h 54m 42s. Rate: 7.5 symbols/min [2025-09-19T19:19:46.573949] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:46.590474] [DEBUG] [LOCAL ] HSHP: Loaded 15834 existing records from primary storage. [2025-09-19T19:19:46.590610] [INFO ] [MAIN ] HSHP: Loaded 15834 existing records. [2025-09-19T19:19:46.770759] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:46.771017] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-19T19:19:46.771067] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-19T19:19:46.771513] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-19T19:19:46.771582] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-19T19:19:47.048420] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-19T19:19:47.150611] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:47.483415] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T19:19:47.590108] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T19:19:47.843265] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-19T19:19:48.643303] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-19T19:19:49.117904] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T19:19:49.155471] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T19:19:49.443287] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-19T19:19:50.243258] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-19T19:19:50.436486] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:19:50.742152] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T19:19:51.043302] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-19T19:19:51.843285] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-19T19:19:51.897292] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T19:19:52.151896] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T19:19:52.643275] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-19T19:19:53.443274] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-19T19:19:54.194550] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T19:19:54.243273] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-19T19:19:54.605442] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T19:19:54.778295] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T19:19:55.043274] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-19T19:19:55.843256] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-19T19:19:56.216805] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T19:19:56.275667] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T19:19:56.643287] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-19T19:19:57.443830] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-19T19:19:57.446231] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T19:19:58.243222] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-19T19:19:58.630472] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T19:19:58.923462] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:19:59.043264] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-19T19:19:59.205180] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T19:19:59.843254] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-19T19:20:00.643273] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-19T19:20:01.146789] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T19:20:01.372463] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:20:01.377607] [INFO ] [REMOTE ] HRTG: Full fetch complete (41916 records). [2025-09-19T19:20:01.377735] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-19T19:20:01.448402] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-19T19:20:01.814572] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-19T19:20:01.822347] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-19T19:20:01.823416] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-19T19:20:01.823525] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-19T19:20:01.825267] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T19:20:01.829416] [DEBUG] [LOCAL ] HRTG: Trimmed 41916 records to 32937 (keeping 200 days of data) [2025-09-19T19:20:02.045951] [DEBUG] [LOCAL ] HRTG: Primary data saved (32937 records). [2025-09-19T19:20:02.046117] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-19T19:20:02.046250] [INFO ] [MAIN ] Update Progress: 1055/2372 symbols completed. HRTG took 26.4s. Estimated remaining: 2h 54m 43s. Rate: 7.5 symbols/min [2025-09-19T19:20:02.223397] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:02.253734] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-19T19:20:02.284974] [DEBUG] [LOCAL ] HSY: Loaded 50876 existing records from primary storage. [2025-09-19T19:20:02.285178] [INFO ] [MAIN ] HSY: Loaded 50876 existing records. [2025-09-19T19:20:02.466007] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:02.466329] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-19T19:20:02.466497] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-19T19:20:02.467888] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-19T19:20:02.467958] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-19T19:20:02.829809] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:03.043253] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-19T19:20:03.180429] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T19:20:03.571770] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T19:20:03.843252] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-19T19:20:04.643264] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-19T19:20:05.111498] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T19:20:05.443275] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-19T19:20:05.927552] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T19:20:06.120842] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-19T19:20:06.243235] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-19T19:20:06.787993] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T19:20:07.043267] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-19T19:20:07.242866] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-19T19:20:07.843272] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-19T19:20:08.643285] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-19T19:20:09.132353] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T19:20:09.135672] [INFO ] [REMOTE ] HSHP: Full fetch complete (23660 records). [2025-09-19T19:20:09.135772] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-19T19:20:09.255906] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T19:20:09.448720] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-19T19:20:09.569724] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-19T19:20:09.569824] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-19T19:20:09.570385] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-19T19:20:09.570462] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-19T19:20:09.571155] [DEBUG] [LOCAL ] HSHP: Trimmed 23660 records to 16012 (keeping 200 days of data) [2025-09-19T19:20:09.666718] [DEBUG] [LOCAL ] HSHP: Primary data saved (16012 records). [2025-09-19T19:20:09.666862] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-19T19:20:09.666993] [INFO ] [MAIN ] Update Progress: 1056/2372 symbols completed. HSHP took 23.3s. Estimated remaining: 2h 54m 35s. Rate: 7.5 symbols/min [2025-09-19T19:20:09.836622] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:09.836833] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-19T19:20:09.836876] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-19T19:20:09.837026] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-19T19:20:09.837067] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-19T19:20:09.837106] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-19T19:20:09.837148] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-19T19:20:10.204351] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:10.243216] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-19T19:20:10.464521] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:20:10.464917] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-19T19:20:10.867115] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T19:20:11.043282] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-19T19:20:11.738094] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-19T19:20:11.746982] [INFO ] [REMOTE ] HRL: Full fetch complete (76693 records). [2025-09-19T19:20:11.747151] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-19T19:20:11.848839] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-19T19:20:12.171538] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-19T19:20:12.171639] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-19T19:20:12.172893] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-19T19:20:12.172973] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-19T19:20:12.181121] [DEBUG] [LOCAL ] HRL: Trimmed 76693 records to 53857 (keeping 200 days of data) [2025-09-19T19:20:12.528737] [DEBUG] [LOCAL ] HRL: Primary data saved (53857 records). [2025-09-19T19:20:12.528880] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-19T19:20:12.529033] [INFO ] [MAIN ] Update Progress: 1057/2372 symbols completed. HRL took 40.1s. Estimated remaining: 2h 54m 21s. Rate: 7.5 symbols/min [2025-09-19T19:20:12.648382] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-19T19:20:12.717194] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:12.733598] [DEBUG] [LOCAL ] HTD: Loaded 13557 existing records from primary storage. [2025-09-19T19:20:12.733756] [INFO ] [MAIN ] HTD: Loaded 13557 existing records. [2025-09-19T19:20:12.917199] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:12.917523] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-19T19:20:12.917573] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-19T19:20:12.918252] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-19T19:20:12.918322] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-19T19:20:12.961765] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:20:13.004412] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-19T19:20:13.286465] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:13.314520] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T19:20:13.443250] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-19T19:20:14.000846] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T19:20:14.243270] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-19T19:20:14.504174] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T19:20:14.516522] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-19T19:20:15.043265] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-19T19:20:15.843260] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-19T19:20:16.020497] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T19:20:16.643266] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-19T19:20:17.443283] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-19T19:20:17.618549] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T19:20:17.894838] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T19:20:18.243275] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-19T19:20:18.510736] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T19:20:19.043275] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-19T19:20:19.843289] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-19T19:20:20.250555] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:20:20.326367] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:20:20.643265] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-19T19:20:21.443325] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-19T19:20:21.814250] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:20:21.826937] [INFO ] [REMOTE ] HSBC: Full fetch complete (73550 records). [2025-09-19T19:20:21.827097] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-19T19:20:22.230259] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-19T19:20:22.230359] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-19T19:20:22.231394] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-19T19:20:22.231460] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-19T19:20:22.233067] [DEBUG] [LOCAL ] HSBC: Trimmed 73550 records to 51975 (keeping 200 days of data) [2025-09-19T19:20:22.243288] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-19T19:20:22.581956] [DEBUG] [LOCAL ] HSBC: Primary data saved (51975 records). [2025-09-19T19:20:22.582566] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-19T19:20:22.582691] [INFO ] [MAIN ] Update Progress: 1058/2372 symbols completed. HSBC took 42.1s. Estimated remaining: 2h 54m 15s. Rate: 7.5 symbols/min [2025-09-19T19:20:22.762216] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:22.762453] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-19T19:20:22.762510] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-19T19:20:22.762691] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-19T19:20:22.762747] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-19T19:20:22.762792] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-19T19:20:22.762825] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-19T19:20:23.120600] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:23.120946] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-19T19:20:23.341066] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-19T19:20:23.409689] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-19T19:20:23.445471] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T19:20:23.656229] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T19:20:23.843267] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-19T19:20:24.643290] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-19T19:20:25.443264] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-19T19:20:25.508668] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T19:20:25.647402] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T19:20:25.839587] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-19T19:20:26.243263] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-19T19:20:27.043264] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-19T19:20:27.071417] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T19:20:27.843269] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-19T19:20:28.643258] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-19T19:20:28.923004] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T19:20:29.302589] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T19:20:29.443314] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-19T19:20:29.680838] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T19:20:29.684422] [INFO ] [REMOTE ] HTB: Full fetch complete (7314 records). [2025-09-19T19:20:29.684586] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-19T19:20:29.966159] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 141 unique days, need 200 days [2025-09-19T19:20:29.966574] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:20:29.966691] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:20:29.966785] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-19T19:20:29.966881] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-19T19:20:29.966942] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-19T19:20:29.967013] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-19T19:20:29.967133] [INFO ] [MAIN ] Update Progress: 1059/2372 symbols completed. HTB took 20.3s. Estimated remaining: 2h 54m 7s. Rate: 7.5 symbols/min [2025-09-19T19:20:30.215766] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:30.243307] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-19T19:20:30.307714] [DEBUG] [LOCAL ] HTGC: Loaded 48106 existing records from primary storage. [2025-09-19T19:20:30.307908] [INFO ] [MAIN ] HTGC: Loaded 48106 existing records. [2025-09-19T19:20:30.528323] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:30.528593] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-19T19:20:30.528684] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-19T19:20:30.530657] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-19T19:20:30.530728] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-19T19:20:30.936966] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:31.043275] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-19T19:20:31.404858] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T19:20:31.431110] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T19:20:31.542883] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T19:20:31.843261] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-19T19:20:32.643274] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-19T19:20:32.823107] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T19:20:33.443285] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-19T19:20:34.243273] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-19T19:20:34.454596] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T19:20:34.631575] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-19T19:20:34.792033] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T19:20:35.043270] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-19T19:20:35.482598] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T19:20:35.843263] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-19T19:20:36.643350] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-19T19:20:37.443250] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-19T19:20:37.859547] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T19:20:37.888618] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T19:20:37.896123] [INFO ] [REMOTE ] HSY: Full fetch complete (73863 records). [2025-09-19T19:20:37.896277] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-19T19:20:38.248480] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-19T19:20:38.308874] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-19T19:20:38.308989] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-19T19:20:38.310441] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-19T19:20:38.310524] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-19T19:20:38.312255] [DEBUG] [LOCAL ] HSY: Trimmed 73863 records to 51230 (keeping 200 days of data) [2025-09-19T19:20:38.649260] [DEBUG] [LOCAL ] HSY: Primary data saved (51230 records). [2025-09-19T19:20:38.649420] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-19T19:20:38.650058] [INFO ] [MAIN ] Update Progress: 1060/2372 symbols completed. HSY took 36.6s. Estimated remaining: 2h 53m 60s. Rate: 7.5 symbols/min [2025-09-19T19:20:38.723869] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T19:20:38.826236] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:38.868798] [DEBUG] [LOCAL ] HTH: Loaded 33114 existing records from primary storage. [2025-09-19T19:20:38.868943] [INFO ] [MAIN ] HTH: Loaded 33114 existing records. [2025-09-19T19:20:39.048775] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:39.044487] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-19T19:20:39.050256] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-19T19:20:39.050370] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-19T19:20:39.051455] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-19T19:20:39.051523] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-19T19:20:39.436365] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:39.463503] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T19:20:39.843275] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-19T19:20:40.064319] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T19:20:40.643334] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-19T19:20:41.443274] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-19T19:20:41.805333] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T19:20:41.900186] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T19:20:42.243312] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-19T19:20:42.459728] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T19:20:42.462423] [INFO ] [REMOTE ] HTD: Full fetch complete (18833 records). [2025-09-19T19:20:42.462513] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-19T19:20:42.640575] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T19:20:42.833286] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-19T19:20:42.833368] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-19T19:20:42.833797] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-19T19:20:42.833858] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-19T19:20:42.834438] [DEBUG] [LOCAL ] HTD: Trimmed 18833 records to 13659 (keeping 200 days of data) [2025-09-19T19:20:42.919486] [DEBUG] [LOCAL ] HTD: Primary data saved (13659 records). [2025-09-19T19:20:42.919630] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-19T19:20:42.919766] [INFO ] [MAIN ] Update Progress: 1061/2372 symbols completed. HTD took 30.4s. Estimated remaining: 2h 53m 47s. Rate: 7.5 symbols/min [2025-09-19T19:20:43.061991] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-19T19:20:43.096153] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:43.135453] [DEBUG] [LOCAL ] HUBB: Loaded 37812 existing records from primary storage. [2025-09-19T19:20:43.135619] [INFO ] [MAIN ] HUBB: Loaded 37812 existing records. [2025-09-19T19:20:43.311016] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:43.311260] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-19T19:20:43.311308] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-19T19:20:43.312490] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-19T19:20:43.312554] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-19T19:20:43.678188] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:43.843264] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-19T19:20:44.130292] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-19T19:20:44.643292] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-19T19:20:44.817103] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:20:45.443265] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-19T19:20:45.711445] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T19:20:45.817588] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-19T19:20:46.243278] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-19T19:20:47.043270] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-19T19:20:47.520020] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T19:20:47.520751] [INFO ] [REMOTE ] HTFC: Full fetch complete (863 records). [2025-09-19T19:20:47.520821] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-19T19:20:47.707893] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-09-19T19:20:47.708152] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:20:47.708241] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:20:47.708336] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-19T19:20:47.708473] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-19T19:20:47.708547] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-19T19:20:47.708677] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-19T19:20:47.708788] [INFO ] [MAIN ] Update Progress: 1062/2372 symbols completed. HTFC took 25.1s. Estimated remaining: 2h 53m 35s. Rate: 7.5 symbols/min [2025-09-19T19:20:47.848367] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-19T19:20:47.920459] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:47.962494] [DEBUG] [LOCAL ] HUBS: Loaded 40122 existing records from primary storage. [2025-09-19T19:20:47.962669] [INFO ] [MAIN ] HUBS: Loaded 40122 existing records. [2025-09-19T19:20:48.176576] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:48.177178] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-19T19:20:48.177252] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-19T19:20:48.178376] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-19T19:20:48.178440] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-19T19:20:48.366728] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T19:20:48.577532] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:48.643309] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-19T19:20:49.414313] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:20:49.443285] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-19T19:20:50.241867] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T19:20:50.248593] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-19T19:20:51.043269] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-19T19:20:51.457517] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T19:20:51.843305] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-19T19:20:51.942806] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T19:20:52.643267] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-19T19:20:52.777684] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T19:20:53.443301] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-19T19:20:53.499854] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T19:20:54.243243] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-19T19:20:54.369129] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T19:20:55.032605] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T19:20:55.043217] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-19T19:20:55.843316] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-19T19:20:56.021232] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T19:20:56.643254] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-19T19:20:56.763912] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T19:20:57.443303] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-19T19:20:57.581711] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:20:58.243284] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-19T19:20:58.624061] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:20:59.043326] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-19T19:20:59.231927] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:20:59.843287] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-19T19:20:59.995551] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:21:00.304118] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T19:21:00.643319] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-19T19:21:01.443276] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-19T19:21:01.668224] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T19:21:02.243311] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-19T19:21:02.302877] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:21:03.043274] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-19T19:21:03.843283] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-19T19:21:04.612873] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-19T19:21:04.643246] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-19T19:21:04.969715] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (3.53 seconds). [2025-09-19T19:21:05.443331] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-19T19:21:05.649816] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-19T19:21:06.033891] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T19:21:06.215319] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T19:21:06.243235] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-19T19:21:07.043229] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-19T19:21:07.186565] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:21:07.193534] [INFO ] [REMOTE ] HTGC: Full fetch complete (68100 records). [2025-09-19T19:21:07.193689] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-19T19:21:07.604731] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-19T19:21:07.604840] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-19T19:21:07.605868] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-19T19:21:07.605946] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-19T19:21:07.607563] [DEBUG] [LOCAL ] HTGC: Trimmed 68100 records to 48422 (keeping 200 days of data) [2025-09-19T19:21:07.843446] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-19T19:21:07.928971] [DEBUG] [LOCAL ] HTGC: Primary data saved (48422 records). [2025-09-19T19:21:07.929123] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-19T19:21:07.929243] [INFO ] [MAIN ] Update Progress: 1063/2372 symbols completed. HTGC took 38.0s. Estimated remaining: 2h 53m 42s. Rate: 7.5 symbols/min [2025-09-19T19:21:08.116238] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:08.144766] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:21:08.202070] [DEBUG] [LOCAL ] HUM: Loaded 49197 existing records from primary storage. [2025-09-19T19:21:08.202260] [INFO ] [MAIN ] HUM: Loaded 49197 existing records. [2025-09-19T19:21:08.383987] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:08.384480] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-19T19:21:08.384586] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-19T19:21:08.392784] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-19T19:21:08.405764] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-19T19:21:08.412624] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T19:21:08.652121] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-19T19:21:08.786370] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:09.028504] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T19:21:09.443265] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-19T19:21:10.243272] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-19T19:21:10.385515] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T19:21:10.390547] [INFO ] [REMOTE ] HTH: Full fetch complete (46463 records). [2025-09-19T19:21:10.390668] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-19T19:21:10.784925] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-19T19:21:10.785009] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-19T19:21:10.785765] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-19T19:21:10.785829] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-19T19:21:10.787431] [DEBUG] [LOCAL ] HTH: Trimmed 46463 records to 33269 (keeping 200 days of data) [2025-09-19T19:21:10.995111] [DEBUG] [LOCAL ] HTH: Primary data saved (33269 records). [2025-09-19T19:21:10.995260] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-19T19:21:10.995619] [INFO ] [MAIN ] Update Progress: 1064/2372 symbols completed. HTH took 32.3s. Estimated remaining: 2h 53m 28s. Rate: 7.5 symbols/min [2025-09-19T19:21:11.060478] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-19T19:21:11.170609] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:11.229594] [DEBUG] [LOCAL ] HUN: Loaded 53591 existing records from primary storage. [2025-09-19T19:21:11.229774] [INFO ] [MAIN ] HUN: Loaded 53591 existing records. [2025-09-19T19:21:11.418206] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:11.418755] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-19T19:21:11.418858] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-19T19:21:11.420132] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-19T19:21:11.420195] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-19T19:21:11.787888] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:11.840221] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-19T19:21:11.839326] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T19:21:11.856562] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-19T19:21:12.643265] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-19T19:21:12.903350] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T19:21:13.443319] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-19T19:21:14.016690] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T19:21:14.243278] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-19T19:21:15.043302] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-19T19:21:15.325870] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-19T19:21:15.843291] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-19T19:21:16.106291] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T19:21:16.643272] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-19T19:21:17.708141] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-09-19T19:21:17.722289] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-19T19:21:17.846797] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T19:21:18.039333] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (3.00 seconds). [2025-09-19T19:21:18.243261] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-19T19:21:19.043269] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-19T19:21:19.082767] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-19T19:21:19.088930] [INFO ] [REMOTE ] HUBS: Full fetch complete (55454 records). [2025-09-19T19:21:19.089078] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-19T19:21:19.499793] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-19T19:21:19.499993] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-19T19:21:19.501045] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-19T19:21:19.501136] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-19T19:21:19.502761] [DEBUG] [LOCAL ] HUBS: Trimmed 55454 records to 40384 (keeping 200 days of data) [2025-09-19T19:21:19.629399] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T19:21:19.802720] [DEBUG] [LOCAL ] HUBS: Primary data saved (40384 records). [2025-09-19T19:21:19.802889] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-19T19:21:19.803049] [INFO ] [MAIN ] Update Progress: 1065/2372 symbols completed. HUBS took 32.1s. Estimated remaining: 2h 53m 21s. Rate: 7.5 symbols/min [2025-09-19T19:21:19.867351] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-19T19:21:19.984272] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:20.002345] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T19:21:20.008735] [INFO ] [REMOTE ] HUBB: Full fetch complete (53386 records). [2025-09-19T19:21:20.008915] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-19T19:21:20.348884] [DEBUG] [LOCAL ] HUYA: Loaded 44714 existing records from primary storage. [2025-09-19T19:21:20.360107] [INFO ] [MAIN ] HUYA: Loaded 44714 existing records. [2025-09-19T19:21:20.608962] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-19T19:21:20.622964] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-19T19:21:20.635218] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-19T19:21:20.649313] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-19T19:21:20.649064] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:20.650551] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-19T19:21:20.650766] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-19T19:21:20.651704] [DEBUG] [LOCAL ] HUBB: Trimmed 53386 records to 38022 (keeping 200 days of data) [2025-09-19T19:21:20.652188] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-19T19:21:20.652358] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-19T19:21:21.100083] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-19T19:21:21.170190] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-19T19:21:21.213390] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:21.336901] [DEBUG] [LOCAL ] HUBB: Primary data saved (38022 records). [2025-09-19T19:21:21.337160] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-19T19:21:21.337379] [INFO ] [MAIN ] Update Progress: 1066/2372 symbols completed. HUBB took 38.4s. Estimated remaining: 2h 53m 6s. Rate: 7.5 symbols/min [2025-09-19T19:21:21.445295] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-19T19:21:21.513668] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:21.551077] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T19:21:21.575259] [DEBUG] [LOCAL ] HVT: Loaded 16375 existing records from primary storage. [2025-09-19T19:21:21.575388] [INFO ] [MAIN ] HVT: Loaded 16375 existing records. [2025-09-19T19:21:21.751433] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:21.751741] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-19T19:21:21.751799] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-19T19:21:21.752266] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-19T19:21:21.752327] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-19T19:21:22.120132] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:22.243279] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-19T19:21:23.043322] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-19T19:21:23.156666] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:21:23.677157] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T19:21:23.843287] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-19T19:21:24.214569] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:21:24.319176] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T19:21:24.643279] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-19T19:21:25.146197] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:21:25.443264] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-19T19:21:26.243253] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-19T19:21:26.820877] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T19:21:27.043265] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-19T19:21:27.843266] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-19T19:21:27.911567] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:21:28.426992] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-19T19:21:28.643233] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-19T19:21:29.449711] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-19T19:21:29.470871] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-19T19:21:29.575829] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T19:21:30.243278] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-19T19:21:30.419589] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:21:30.688034] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T19:21:31.043271] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-19T19:21:31.843271] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-19T19:21:32.207564] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T19:21:32.650963] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-19T19:21:32.684492] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:21:32.717234] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T19:21:33.443274] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-19T19:21:34.084763] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:21:34.243268] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-19T19:21:35.043223] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-19T19:21:35.463607] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T19:21:35.668041] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T19:21:35.843246] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-19T19:21:36.643310] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-19T19:21:36.881005] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T19:21:37.443235] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-19T19:21:37.593149] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:21:38.243282] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-19T19:21:38.686816] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:21:38.878151] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T19:21:39.043336] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-19T19:21:39.843280] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-19T19:21:40.498537] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T19:21:40.531673] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-19T19:21:40.643228] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-19T19:21:41.443263] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-19T19:21:42.061365] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T19:21:42.069206] [INFO ] [REMOTE ] HUM: Full fetch complete (70952 records). [2025-09-19T19:21:42.069413] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-19T19:21:42.253736] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-19T19:21:42.477383] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-19T19:21:42.477485] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-19T19:21:42.478436] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-19T19:21:42.478502] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-19T19:21:42.480005] [DEBUG] [LOCAL ] HUM: Trimmed 70952 records to 49586 (keeping 200 days of data) [2025-09-19T19:21:42.596559] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T19:21:42.749492] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T19:21:42.858671] [DEBUG] [LOCAL ] HUM: Primary data saved (49586 records). [2025-09-19T19:21:42.858833] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-19T19:21:42.858925] [INFO ] [MAIN ] Update Progress: 1067/2372 symbols completed. HUM took 34.9s. Estimated remaining: 2h 53m 14s. Rate: 7.5 symbols/min [2025-09-19T19:21:43.037028] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:43.043275] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-19T19:21:43.095603] [DEBUG] [LOCAL ] HWM: Loaded 53421 existing records from primary storage. [2025-09-19T19:21:43.095800] [INFO ] [MAIN ] HWM: Loaded 53421 existing records. [2025-09-19T19:21:43.297168] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:43.297465] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-19T19:21:43.297525] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-19T19:21:43.299609] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-19T19:21:43.299708] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-19T19:21:43.656193] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:43.843244] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-19T19:21:43.903398] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T19:21:43.911197] [INFO ] [REMOTE ] HUN: Full fetch complete (76536 records). [2025-09-19T19:21:43.911332] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-19T19:21:44.300256] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-19T19:21:44.300371] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-19T19:21:44.301704] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-19T19:21:44.301849] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-19T19:21:44.304508] [DEBUG] [LOCAL ] HUN: Trimmed 76536 records to 53978 (keeping 200 days of data) [2025-09-19T19:21:44.636403] [DEBUG] [LOCAL ] HUN: Primary data saved (53978 records). [2025-09-19T19:21:44.636542] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-19T19:21:44.637893] [INFO ] [MAIN ] Update Progress: 1068/2372 symbols completed. HUN took 33.6s. Estimated remaining: 2h 52m 59s. Rate: 7.5 symbols/min [2025-09-19T19:21:44.669714] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-19T19:21:44.811835] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:44.838566] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T19:21:44.889093] [DEBUG] [LOCAL ] HXL: Loaded 46545 existing records from primary storage. [2025-09-19T19:21:44.889291] [INFO ] [MAIN ] HXL: Loaded 46545 existing records. [2025-09-19T19:21:45.077915] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T19:21:45.077406] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:45.081752] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-19T19:21:45.081912] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-19T19:21:45.083278] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-19T19:21:45.083339] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-19T19:21:45.434944] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:45.443213] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-19T19:21:46.243245] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-19T19:21:46.803409] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T19:21:47.043308] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-19T19:21:47.153212] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:21:47.345862] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T19:21:47.843271] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-19T19:21:48.643274] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-19T19:21:48.872625] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T19:21:48.879932] [INFO ] [REMOTE ] HUYA: Full fetch complete (63785 records). [2025-09-19T19:21:48.880123] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-19T19:21:49.275593] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-19T19:21:49.275735] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-19T19:21:49.276779] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-19T19:21:49.276867] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-19T19:21:49.278422] [DEBUG] [LOCAL ] HUYA: Trimmed 63785 records to 45033 (keeping 200 days of data) [2025-09-19T19:21:49.451730] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-19T19:21:49.545329] [DEBUG] [LOCAL ] HUYA: Primary data saved (45033 records). [2025-09-19T19:21:49.545671] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-19T19:21:49.545889] [INFO ] [MAIN ] Update Progress: 1069/2372 symbols completed. HUYA took 29.7s. Estimated remaining: 2h 52m 47s. Rate: 7.5 symbols/min [2025-09-19T19:21:49.730507] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:49.740002] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T19:21:49.744087] [INFO ] [REMOTE ] HVT: Full fetch complete (23835 records). [2025-09-19T19:21:49.744235] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-19T19:21:49.878356] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T19:21:49.900257] [DEBUG] [LOCAL ] HY: Loaded 10522 existing records from primary storage. [2025-09-19T19:21:49.914186] [INFO ] [MAIN ] HY: Loaded 10522 existing records. [2025-09-19T19:21:50.250592] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-19T19:21:50.317862] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:50.330691] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-19T19:21:50.341614] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-19T19:21:50.387947] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-19T19:21:50.388711] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-19T19:21:50.490691] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-19T19:21:50.501979] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-19T19:21:50.514320] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-19T19:21:50.522743] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-19T19:21:50.570561] [DEBUG] [LOCAL ] HVT: Trimmed 23835 records to 16524 (keeping 200 days of data) [2025-09-19T19:21:50.875117] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:50.897256] [DEBUG] [LOCAL ] HVT: Primary data saved (16524 records). [2025-09-19T19:21:50.897370] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-19T19:21:50.897448] [INFO ] [MAIN ] Update Progress: 1070/2372 symbols completed. HVT took 29.6s. Estimated remaining: 2h 52m 31s. Rate: 7.5 symbols/min [2025-09-19T19:21:51.044169] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-19T19:21:51.068572] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:51.068778] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-19T19:21:51.068831] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-19T19:21:51.069017] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-19T19:21:51.069089] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-19T19:21:51.069136] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-19T19:21:51.069169] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-19T19:21:51.443851] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:51.635788] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T19:21:51.699333] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T19:21:51.843233] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-19T19:21:51.990560] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:21:52.347543] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T19:21:52.643296] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-19T19:21:53.443281] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-19T19:21:54.243252] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-19T19:21:54.357522] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T19:21:54.631227] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-19T19:21:54.784245] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T19:21:55.043280] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-19T19:21:55.843253] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-19T19:21:56.050844] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T19:21:56.643281] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-19T19:21:57.443307] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-19T19:21:57.821306] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T19:21:58.114251] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-19T19:21:58.243321] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-19T19:21:58.613057] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:21:59.043299] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-19T19:21:59.843300] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-19T19:22:00.130520] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-19T19:22:00.458556] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T19:22:00.643303] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-19T19:22:01.023477] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T19:22:01.443275] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-19T19:22:01.748550] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T19:22:01.923024] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-19T19:22:02.243269] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-19T19:22:03.043361] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-19T19:22:03.462878] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T19:22:03.843269] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-19T19:22:04.643270] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-19T19:22:04.688131] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T19:22:04.725785] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-19T19:22:05.443307] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-19T19:22:05.816817] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-19T19:22:06.243279] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-19T19:22:06.385762] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T19:22:06.755175] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T19:22:07.043255] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-19T19:22:07.299214] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-19T19:22:07.843296] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-19T19:22:08.186874] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-19T19:22:08.187819] [INFO ] [REMOTE ] HYAC: Full fetch complete (873 records). [2025-09-19T19:22:08.187992] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-19T19:22:08.188730] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T19:22:08.188840] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:22:08.188932] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:22:08.189051] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-19T19:22:08.189193] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-19T19:22:08.189308] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-19T19:22:08.189407] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-19T19:22:08.189583] [INFO ] [MAIN ] Update Progress: 1071/2372 symbols completed. HYAC took 17.3s. Estimated remaining: 2h 52m 34s. Rate: 7.5 symbols/min [2025-09-19T19:22:08.390956] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:08.391204] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-19T19:22:08.391272] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-19T19:22:08.391496] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-19T19:22:08.391575] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-19T19:22:08.391686] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-19T19:22:08.391740] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-19T19:22:08.648513] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-19T19:22:08.765087] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:09.443281] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-19T19:22:10.052995] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-19T19:22:10.243298] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-19T19:22:10.681765] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:22:11.043281] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-19T19:22:11.273507] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T19:22:11.453859] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-19T19:22:11.843263] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-19T19:22:12.643285] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-19T19:22:12.762063] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T19:22:13.443256] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-19T19:22:14.243276] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-19T19:22:14.369879] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T19:22:14.658352] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T19:22:15.043276] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-19T19:22:15.843351] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-19T19:22:16.025795] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T19:22:16.102738] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-19T19:22:16.338511] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T19:22:16.643307] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-19T19:22:17.443257] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-19T19:22:17.813595] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-19T19:22:18.007545] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T19:22:18.010980] [INFO ] [REMOTE ] HY: Full fetch complete (15194 records). [2025-09-19T19:22:18.011089] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-19T19:22:18.248364] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-19T19:22:18.388386] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-19T19:22:18.388478] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-19T19:22:18.388862] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-19T19:22:18.388938] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-19T19:22:18.389700] [DEBUG] [LOCAL ] HY: Trimmed 15194 records to 10589 (keeping 200 days of data) [2025-09-19T19:22:18.466830] [DEBUG] [LOCAL ] HY: Primary data saved (10589 records). [2025-09-19T19:22:18.467001] [INFO ] [MAIN ] HY: Full history saved. [2025-09-19T19:22:18.467170] [INFO ] [MAIN ] Update Progress: 1072/2372 symbols completed. HY took 28.9s. Estimated remaining: 2h 52m 29s. Rate: 7.5 symbols/min [2025-09-19T19:22:18.648899] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:18.665279] [DEBUG] [LOCAL ] HYI: Loaded 8946 existing records from primary storage. [2025-09-19T19:22:18.665424] [INFO ] [MAIN ] HYI: Loaded 8946 existing records. [2025-09-19T19:22:18.756569] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-19T19:22:18.880236] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:18.880517] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-19T19:22:18.880567] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-19T19:22:18.880981] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-19T19:22:18.881242] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-19T19:22:19.051133] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-19T19:22:19.288056] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:19.843265] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-19T19:22:20.643277] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-19T19:22:21.015215] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T19:22:21.431447] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T19:22:21.448572] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-19T19:22:21.832099] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T19:22:22.243272] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-19T19:22:22.407190] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T19:22:22.620164] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-19T19:22:23.043265] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-19T19:22:23.843268] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-19T19:22:23.951541] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T19:22:24.643266] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-19T19:22:25.443267] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-19T19:22:25.814037] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-19T19:22:25.976278] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T19:22:26.243279] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-19T19:22:26.623405] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T19:22:26.630178] [INFO ] [REMOTE ] HXL: Full fetch complete (66098 records). [2025-09-19T19:22:26.630347] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-19T19:22:26.721351] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T19:22:27.043890] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-19T19:22:27.087781] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-19T19:22:27.087925] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-19T19:22:27.089250] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-19T19:22:27.089321] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-19T19:22:27.091136] [DEBUG] [LOCAL ] HXL: Trimmed 66098 records to 46858 (keeping 200 days of data) [2025-09-19T19:22:27.409111] [DEBUG] [LOCAL ] HXL: Primary data saved (46858 records). [2025-09-19T19:22:27.409285] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-19T19:22:27.409428] [INFO ] [MAIN ] Update Progress: 1073/2372 symbols completed. HXL took 42.8s. Estimated remaining: 2h 52m 23s. Rate: 7.5 symbols/min [2025-09-19T19:22:27.604152] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:27.642164] [DEBUG] [LOCAL ] HYT: Loaded 33425 existing records from primary storage. [2025-09-19T19:22:27.642312] [INFO ] [MAIN ] HYT: Loaded 33425 existing records. [2025-09-19T19:22:27.834943] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:27.835295] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-19T19:22:27.835352] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-19T19:22:27.836241] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-19T19:22:27.836304] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-19T19:22:27.849349] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-19T19:22:28.112048] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T19:22:28.235957] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:28.643270] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-19T19:22:29.443278] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-19T19:22:29.521613] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T19:22:29.760212] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:22:29.768264] [INFO ] [REMOTE ] HWM: Full fetch complete (76658 records). [2025-09-19T19:22:29.768497] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-19T19:22:29.877903] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-19T19:22:29.890076] [INFO ] [REMOTE ] HYBX: Full fetch complete (820 records). [2025-09-19T19:22:29.905695] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-19T19:22:29.926176] [FATAL] [VALIDATOR ] HYBX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T19:22:29.964906] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:22:30.029175] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:22:30.084825] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-19T19:22:30.113224] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-19T19:22:30.138674] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-19T19:22:30.157693] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-19T19:22:30.176883] [INFO ] [MAIN ] Update Progress: 1074/2372 symbols completed. HYBX took 22.0s. Estimated remaining: 2h 52m 8s. Rate: 7.5 symbols/min [2025-09-19T19:22:30.199713] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-19T19:22:30.248349] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-19T19:22:30.262517] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-19T19:22:30.248465] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-19T19:22:30.283687] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-19T19:22:30.387068] [DEBUG] [LOCAL ] HWM: Trimmed 76658 records to 53803 (keeping 200 days of data) [2025-09-19T19:22:30.391007] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:30.403658] [DEBUG] [LOCAL ] HYTR: Loaded 3236 existing records from primary storage. [2025-09-19T19:22:30.403796] [INFO ] [MAIN ] HYTR: Loaded 3236 existing records. [2025-09-19T19:22:30.686507] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:30.688241] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-19T19:22:30.688576] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-19T19:22:30.690107] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-19T19:22:30.690424] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-19T19:22:31.043767] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-19T19:22:31.085534] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:31.327535] [DEBUG] [LOCAL ] HWM: Primary data saved (53803 records). [2025-09-19T19:22:31.327732] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-19T19:22:31.327861] [INFO ] [MAIN ] Update Progress: 1075/2372 symbols completed. HWM took 48.5s. Estimated remaining: 2h 51m 52s. Rate: 7.5 symbols/min [2025-09-19T19:22:31.510217] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:31.511789] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T19:22:31.546761] [DEBUG] [LOCAL ] HZO: Loaded 29607 existing records from primary storage. [2025-09-19T19:22:31.546908] [INFO ] [MAIN ] HZO: Loaded 29607 existing records. [2025-09-19T19:22:31.728328] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:31.728610] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-19T19:22:31.728695] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-19T19:22:31.729532] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-19T19:22:31.729603] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-19T19:22:31.850366] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-19T19:22:32.120327] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:32.596806] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T19:22:32.643246] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-19T19:22:32.649295] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T19:22:33.443272] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-19T19:22:34.210614] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T19:22:34.214988] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:22:34.243243] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-19T19:22:35.043422] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-19T19:22:35.678838] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:22:35.733608] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T19:22:35.843248] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-19T19:22:36.643274] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-19T19:22:37.302931] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T19:22:37.443268] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-19T19:22:37.474761] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:22:38.243268] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-19T19:22:38.299790] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-19T19:22:38.927768] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T19:22:39.043278] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-19T19:22:39.843274] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-19T19:22:40.643497] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-19T19:22:40.693287] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T19:22:41.175041] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:22:41.443279] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-19T19:22:41.531255] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:22:42.178842] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:22:42.243224] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-19T19:22:42.903899] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T19:22:43.043252] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-19T19:22:43.843264] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-19T19:22:44.578253] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T19:22:44.643301] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-19T19:22:44.756029] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T19:22:45.443266] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-19T19:22:45.858055] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:22:46.096659] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T19:22:46.243262] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-19T19:22:47.043271] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-19T19:22:47.634688] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T19:22:47.843252] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-19T19:22:48.651245] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-19T19:22:48.666691] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T19:22:48.678143] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T19:22:49.443307] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-19T19:22:49.935000] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T19:22:50.243293] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-19T19:22:50.365120] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T19:22:50.887164] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-19T19:22:50.888807] [INFO ] [REMOTE ] HYTR: Full fetch complete (4384 records). [2025-09-19T19:22:50.888944] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-19T19:22:51.054709] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-19T19:22:51.283921] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-19T19:22:51.284030] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-19T19:22:51.284223] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-19T19:22:51.284273] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-19T19:22:51.284746] [DEBUG] [LOCAL ] HYTR: Trimmed 4384 records to 3252 (keeping 200 days of data) [2025-09-19T19:22:51.307392] [DEBUG] [LOCAL ] HYTR: Primary data saved (3252 records). [2025-09-19T19:22:51.307504] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-19T19:22:51.307588] [INFO ] [MAIN ] Update Progress: 1076/2372 symbols completed. HYTR took 21.1s. Estimated remaining: 2h 51m 59s. Rate: 7.5 symbols/min [2025-09-19T19:22:51.480379] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:51.490094] [DEBUG] [LOCAL ] IAE: Loaded 5777 existing records from primary storage. [2025-09-19T19:22:51.490231] [INFO ] [MAIN ] IAE: Loaded 5777 existing records. [2025-09-19T19:22:51.667573] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:51.667858] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-19T19:22:51.667908] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-19T19:22:51.668201] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-19T19:22:51.668269] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-19T19:22:51.848870] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-19T19:22:52.029144] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:52.643756] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-19T19:22:52.645413] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T19:22:52.837508] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T19:22:52.838869] [INFO ] [REMOTE ] HYI: Full fetch complete (12876 records). [2025-09-19T19:22:52.838953] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-19T19:22:53.203543] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-19T19:22:53.203637] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-19T19:22:53.204052] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-19T19:22:53.204154] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-19T19:22:53.204729] [DEBUG] [LOCAL ] HYI: Trimmed 12876 records to 8995 (keeping 200 days of data) [2025-09-19T19:22:53.267469] [DEBUG] [LOCAL ] HYI: Primary data saved (8995 records). [2025-09-19T19:22:53.267694] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-19T19:22:53.267811] [INFO ] [MAIN ] Update Progress: 1077/2372 symbols completed. HYI took 34.8s. Estimated remaining: 2h 51m 44s. Rate: 7.5 symbols/min [2025-09-19T19:22:53.392393] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-19T19:22:53.443294] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-19T19:22:54.164664] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T19:22:54.243316] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-19T19:22:55.017489] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T19:22:55.043237] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-19T19:22:55.843251] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-19T19:22:56.115770] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T19:22:56.643284] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-19T19:22:57.443350] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-19T19:22:57.629302] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T19:22:58.243277] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-19T19:22:58.284619] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T19:22:58.324688] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:22:59.043282] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-19T19:22:59.805457] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T19:22:59.847176] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-19T19:22:59.849436] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T19:22:59.854746] [INFO ] [REMOTE ] HYT: Full fetch complete (46869 records). [2025-09-19T19:22:59.854843] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-19T19:23:00.261964] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-19T19:23:00.262052] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-19T19:23:00.262922] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-19T19:23:00.263001] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-19T19:23:00.264145] [DEBUG] [LOCAL ] HYT: Trimmed 46869 records to 33598 (keeping 200 days of data) [2025-09-19T19:23:00.466065] [DEBUG] [LOCAL ] HYT: Primary data saved (33598 records). [2025-09-19T19:23:00.466212] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-19T19:23:00.466298] [INFO ] [MAIN ] Update Progress: 1078/2372 symbols completed. HYT took 33.1s. Estimated remaining: 2h 51m 35s. Rate: 7.5 symbols/min [2025-09-19T19:23:00.643257] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-19T19:23:00.957312] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T19:23:01.443272] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-19T19:23:02.086849] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:23:02.243298] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-19T19:23:02.313067] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T19:23:03.043294] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-19T19:23:04.531363] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:23:04.533411] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-19T19:23:05.551606] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (3.31 seconds). [2025-09-19T19:23:05.557847] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-19T19:23:05.857962] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:23:05.860073] [INFO ] [REMOTE ] IAE: Full fetch complete (8401 records). [2025-09-19T19:23:05.860164] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-19T19:23:06.226057] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-19T19:23:06.226160] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-19T19:23:06.226411] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-19T19:23:06.226524] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-19T19:23:06.227099] [DEBUG] [LOCAL ] IAE: Trimmed 8401 records to 5839 (keeping 200 days of data) [2025-09-19T19:23:06.268919] [DEBUG] [LOCAL ] IAE: Primary data saved (5839 records). [2025-09-19T19:23:06.269096] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-19T19:23:06.269208] [INFO ] [MAIN ] Update Progress: 1079/2372 symbols completed. IAE took 15.0s. Estimated remaining: 2h 51m 24s. Rate: 7.5 symbols/min [2025-09-19T19:23:07.130563] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T19:23:07.137416] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-19T19:23:08.580075] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T19:23:08.589484] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-19T19:23:09.961737] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T19:23:09.966783] [INFO ] [REMOTE ] HZO: Full fetch complete (40438 records). [2025-09-19T19:23:09.966882] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-19T19:23:10.343935] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-19T19:23:10.344019] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-19T19:23:10.344731] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-19T19:23:10.344792] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-19T19:23:10.345717] [DEBUG] [LOCAL ] HZO: Trimmed 40438 records to 29856 (keeping 200 days of data) [2025-09-19T19:23:10.521953] [DEBUG] [LOCAL ] HZO: Primary data saved (29856 records). [2025-09-19T19:23:10.522179] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-19T19:23:10.522318] [INFO ] [MAIN ] Update Progress: 1080/2372 symbols completed. HZO took 39.2s. Estimated remaining: 2h 51m 12s. Rate: 7.5 symbols/min [2025-09-19T19:23:11.166483] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:11.172120] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:11.259371] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:11.263325] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:11.319580] [DEBUG] [LOCAL ] IBP: Loaded 29731 existing records from primary storage. [2025-09-19T19:23:11.319770] [INFO ] [MAIN ] IBP: Loaded 29731 existing records. [2025-09-19T19:23:11.486215] [DEBUG] [LOCAL ] IBM: Loaded 53999 existing records from primary storage. [2025-09-19T19:23:11.506339] [INFO ] [MAIN ] IBM: Loaded 53999 existing records. [2025-09-19T19:23:11.646079] [DEBUG] [LOCAL ] IAG: Loaded 53823 existing records from primary storage. [2025-09-19T19:23:11.674524] [INFO ] [MAIN ] IAG: Loaded 53823 existing records. [2025-09-19T19:23:11.674424] [DEBUG] [LOCAL ] IBN: Loaded 53316 existing records from primary storage. [2025-09-19T19:23:11.729706] [INFO ] [MAIN ] IBN: Loaded 53316 existing records. [2025-09-19T19:23:11.691677] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:11.758557] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-19T19:23:11.895067] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-19T19:23:12.001572] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-19T19:23:12.058614] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:12.058833] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-19T19:23:12.110191] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:12.099077] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-19T19:23:12.118058] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-19T19:23:12.147664] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-19T19:23:12.147483] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-19T19:23:12.168662] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-19T19:23:12.184635] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-19T19:23:12.184557] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-19T19:23:12.230397] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-19T19:23:12.439451] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:12.509378] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-19T19:23:12.553598] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-19T19:23:12.655796] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-19T19:23:12.656032] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-19T19:23:13.321081] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:13.396444] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-19T19:23:13.481034] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:13.481442] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-19T19:23:13.686596] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:13.688891] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-19T19:23:13.708551] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:13.708905] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-19T19:23:15.187243] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:23:15.192807] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-19T19:23:15.875059] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T19:23:15.886212] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-19T19:23:15.938746] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T19:23:15.949902] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-19T19:23:16.352770] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.96 seconds). [2025-09-19T19:23:16.363909] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-19T19:23:16.480288] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T19:23:16.485619] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-19T19:23:17.421795] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T19:23:17.432629] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-19T19:23:17.521188] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:23:17.532024] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-19T19:23:18.105832] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:23:18.111774] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-19T19:23:18.803213] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-19T19:23:18.813764] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-19T19:23:18.873452] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:23:18.883590] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-19T19:23:19.450841] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:23:19.461257] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-19T19:23:19.973018] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T19:23:19.979770] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-19T19:23:20.927701] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T19:23:20.938997] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-19T19:23:20.980436] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T19:23:20.990582] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-19T19:23:21.476310] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T19:23:21.487840] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-19T19:23:21.507704] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T19:23:22.243270] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-19T19:23:22.780539] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:23:23.043267] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-19T19:23:23.307848] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-19T19:23:23.363165] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T19:23:23.765798] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T19:23:23.843255] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-19T19:23:24.485500] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:23:24.647745] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-19T19:23:24.650898] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T19:23:25.443259] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-19T19:23:26.243265] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-19T19:23:27.043266] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-19T19:23:27.189913] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-19T19:23:27.381082] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T19:23:27.843281] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-19T19:23:28.264599] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T19:23:28.533254] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T19:23:28.643218] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-19T19:23:29.443270] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-19T19:23:29.776182] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T19:23:30.243250] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-19T19:23:30.314981] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T19:23:30.999290] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:23:31.043260] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-19T19:23:31.843259] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-19T19:23:32.643236] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-19T19:23:32.736979] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-19T19:23:32.849477] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:23:33.443267] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-19T19:23:33.964138] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:23:33.989032] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T19:23:33.993815] [INFO ] [REMOTE ] IBP: Full fetch complete (41042 records). [2025-09-19T19:23:33.993933] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-19T19:23:34.248397] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-19T19:23:34.379926] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-19T19:23:34.380053] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-19T19:23:34.380959] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-19T19:23:34.381036] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-19T19:23:34.382484] [DEBUG] [LOCAL ] IBP: Trimmed 41042 records to 29938 (keeping 200 days of data) [2025-09-19T19:23:34.579721] [DEBUG] [LOCAL ] IBP: Primary data saved (29938 records). [2025-09-19T19:23:34.579876] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-19T19:23:34.579968] [INFO ] [MAIN ] Update Progress: 1081/2372 symbols completed. IBP took 24.1s. Estimated remaining: 2h 51m 23s. Rate: 7.5 symbols/min [2025-09-19T19:23:34.757942] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:34.803167] [DEBUG] [LOCAL ] IBTA: Loaded 38598 existing records from primary storage. [2025-09-19T19:23:34.803314] [INFO ] [MAIN ] IBTA: Loaded 38598 existing records. [2025-09-19T19:23:34.981854] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:34.982120] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-19T19:23:34.982197] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-19T19:23:34.983194] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-19T19:23:34.983265] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-19T19:23:35.048321] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-19T19:23:35.343178] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:35.590573] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T19:23:35.598931] [INFO ] [REMOTE ] IAG: Full fetch complete (77195 records). [2025-09-19T19:23:35.599095] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-19T19:23:35.855410] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-19T19:23:36.010438] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-19T19:23:36.010592] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-19T19:23:36.011772] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-19T19:23:36.011984] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-19T19:23:36.013883] [DEBUG] [LOCAL ] IAG: Trimmed 77195 records to 54213 (keeping 200 days of data) [2025-09-19T19:23:36.331780] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T19:23:36.392907] [DEBUG] [LOCAL ] IAG: Primary data saved (54213 records). [2025-09-19T19:23:36.393138] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-19T19:23:36.393270] [INFO ] [MAIN ] Update Progress: 1082/2372 symbols completed. IAG took 25.9s. Estimated remaining: 2h 51m 8s. Rate: 7.5 symbols/min [2025-09-19T19:23:36.574505] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:36.635792] [DEBUG] [LOCAL ] ICE: Loaded 53416 existing records from primary storage. [2025-09-19T19:23:36.635978] [INFO ] [MAIN ] ICE: Loaded 53416 existing records. [2025-09-19T19:23:36.648903] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-19T19:23:36.844515] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:36.845045] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-19T19:23:36.845125] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-19T19:23:36.846594] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-19T19:23:36.846740] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-19T19:23:36.991177] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T19:23:37.263669] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:37.434440] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T19:23:37.443216] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-19T19:23:38.243238] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-19T19:23:38.742572] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:23:38.986199] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T19:23:39.043313] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-19T19:23:39.843270] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-19T19:23:40.674227] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-19T19:23:40.690283] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-19T19:23:40.698865] [INFO ] [REMOTE ] IBN: Full fetch complete (76289 records). [2025-09-19T19:23:40.699003] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-19T19:23:41.111171] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-19T19:23:41.111253] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-19T19:23:41.112305] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-19T19:23:41.112379] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-19T19:23:41.115750] [DEBUG] [LOCAL ] IBN: Trimmed 76289 records to 53699 (keeping 200 days of data) [2025-09-19T19:23:41.464291] [DEBUG] [LOCAL ] IBN: Primary data saved (53699 records). [2025-09-19T19:23:41.464475] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-19T19:23:41.464582] [INFO ] [MAIN ] Update Progress: 1083/2372 symbols completed. IBN took 30.9s. Estimated remaining: 2h 50m 56s. Rate: 7.5 symbols/min [2025-09-19T19:23:41.645509] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:41.681019] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-19T19:23:41.693330] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-19T19:23:41.725100] [DEBUG] [LOCAL ] ICL: Loaded 39304 existing records from primary storage. [2025-09-19T19:23:41.725268] [INFO ] [MAIN ] ICL: Loaded 39304 existing records. [2025-09-19T19:23:41.941210] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:41.941842] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-19T19:23:41.942019] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-19T19:23:41.943208] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-19T19:23:41.943395] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-19T19:23:42.117812] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:23:42.243380] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-19T19:23:42.318012] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T19:23:42.415397] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:43.043271] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-19T19:23:43.843306] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-19T19:23:44.220988] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T19:23:44.262007] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T19:23:44.270201] [INFO ] [REMOTE ] IBM: Full fetch complete (77612 records). [2025-09-19T19:23:44.270360] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-19T19:23:44.663480] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-19T19:23:44.691222] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-19T19:23:44.691380] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-19T19:23:44.692769] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-19T19:23:44.693275] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-19T19:23:44.727941] [DEBUG] [LOCAL ] IBM: Trimmed 77612 records to 54389 (keeping 200 days of data) [2025-09-19T19:23:44.731285] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:23:45.112882] [DEBUG] [LOCAL ] IBM: Primary data saved (54389 records). [2025-09-19T19:23:45.113046] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-19T19:23:45.113511] [INFO ] [MAIN ] Update Progress: 1084/2372 symbols completed. IBM took 34.6s. Estimated remaining: 2h 50m 43s. Rate: 7.5 symbols/min [2025-09-19T19:23:45.292931] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:45.334058] [DEBUG] [LOCAL ] IDA: Loaded 32258 existing records from primary storage. [2025-09-19T19:23:45.334234] [INFO ] [MAIN ] IDA: Loaded 32258 existing records. [2025-09-19T19:23:45.448393] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-19T19:23:45.530022] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:45.530496] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-19T19:23:45.530726] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-19T19:23:45.539253] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-19T19:23:45.552386] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-19T19:23:45.607200] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T19:23:45.957486] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:46.243297] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-19T19:23:46.730746] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T19:23:47.043329] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-19T19:23:47.216569] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:23:47.279066] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:23:47.843273] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-19T19:23:48.643250] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-19T19:23:48.733016] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:23:49.431627] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:23:49.443213] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-19T19:23:50.229404] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:23:50.243219] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-19T19:23:50.826257] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T19:23:51.043262] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-19T19:23:51.843272] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-19T19:23:51.884834] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T19:23:52.643317] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-19T19:23:53.077885] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T19:23:53.228083] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T19:23:53.443282] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-19T19:23:53.955975] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:23:54.243321] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-19T19:23:55.048370] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-19T19:23:55.060133] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:23:55.698258] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T19:23:55.843262] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-19T19:23:56.643333] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-19T19:23:57.093968] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T19:23:57.443268] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-19T19:23:57.637878] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T19:23:57.687297] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T19:23:58.243328] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-19T19:23:58.931619] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T19:23:59.043223] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-19T19:23:59.380952] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T19:23:59.387441] [INFO ] [REMOTE ] IBTA: Full fetch complete (50445 records). [2025-09-19T19:23:59.387573] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-19T19:23:59.773244] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-19T19:23:59.773344] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-19T19:23:59.774178] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-19T19:23:59.774242] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-19T19:23:59.775399] [DEBUG] [LOCAL ] IBTA: Trimmed 50445 records to 38885 (keeping 200 days of data) [2025-09-19T19:23:59.858749] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-19T19:24:00.002363] [DEBUG] [LOCAL ] IBTA: Primary data saved (38885 records). [2025-09-19T19:24:00.002510] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-19T19:24:00.002596] [INFO ] [MAIN ] Update Progress: 1085/2372 symbols completed. IBTA took 25.4s. Estimated remaining: 2h 50m 44s. Rate: 7.5 symbols/min [2025-09-19T19:24:00.190848] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:00.200818] [DEBUG] [LOCAL ] IDE: Loaded 8414 existing records from primary storage. [2025-09-19T19:24:00.200968] [INFO ] [MAIN ] IDE: Loaded 8414 existing records. [2025-09-19T19:24:00.380730] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:00.381018] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-19T19:24:00.381067] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-19T19:24:00.381460] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-19T19:24:00.381520] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-19T19:24:00.648404] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-19T19:24:00.768910] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:00.808414] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:24:01.443350] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-19T19:24:01.604386] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:24:02.243323] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-19T19:24:03.043285] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-19T19:24:03.503508] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-19T19:24:03.843341] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-19T19:24:04.931442] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T19:24:04.934431] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-19T19:24:05.162249] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (3.72 seconds). [2025-09-19T19:24:05.198222] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T19:24:05.339683] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-09-19T19:24:05.443984] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-19T19:24:05.446048] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T19:24:06.243269] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-19T19:24:07.043265] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-19T19:24:07.394588] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T19:24:07.402521] [INFO ] [REMOTE ] ICE: Full fetch complete (76758 records). [2025-09-19T19:24:07.402705] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-19T19:24:07.800855] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-19T19:24:07.800942] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-19T19:24:07.801915] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-19T19:24:07.801993] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-19T19:24:07.803536] [DEBUG] [LOCAL ] ICE: Trimmed 76758 records to 53803 (keeping 200 days of data) [2025-09-19T19:24:07.860757] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-19T19:24:07.933455] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:24:08.190910] [DEBUG] [LOCAL ] ICE: Primary data saved (53803 records). [2025-09-19T19:24:08.191074] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-19T19:24:08.194183] [INFO ] [MAIN ] Update Progress: 1086/2372 symbols completed. ICE took 31.8s. Estimated remaining: 2h 50m 36s. Rate: 7.5 symbols/min [2025-09-19T19:24:08.374548] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:08.400343] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T19:24:08.424388] [DEBUG] [LOCAL ] IDT: Loaded 17622 existing records from primary storage. [2025-09-19T19:24:08.424563] [INFO ] [MAIN ] IDT: Loaded 17622 existing records. [2025-09-19T19:24:08.602827] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:08.603092] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-19T19:24:08.603151] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-19T19:24:08.603701] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-19T19:24:08.603774] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-19T19:24:08.648483] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-19T19:24:08.905760] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T19:24:08.978048] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:09.443267] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-19T19:24:10.243315] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-19T19:24:10.312910] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T19:24:10.933562] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:24:11.043265] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-19T19:24:11.396477] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:24:11.843258] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-19T19:24:12.415991] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T19:24:12.420160] [INFO ] [REMOTE ] IDA: Full fetch complete (44646 records). [2025-09-19T19:24:12.420267] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-19T19:24:12.653246] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-19T19:24:12.808543] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-19T19:24:12.808632] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-19T19:24:12.809484] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-19T19:24:12.809547] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-19T19:24:12.810613] [DEBUG] [LOCAL ] IDA: Trimmed 44646 records to 32459 (keeping 200 days of data) [2025-09-19T19:24:13.023073] [DEBUG] [LOCAL ] IDA: Primary data saved (32459 records). [2025-09-19T19:24:13.023220] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-19T19:24:13.024476] [INFO ] [MAIN ] Update Progress: 1087/2372 symbols completed. IDA took 27.9s. Estimated remaining: 2h 50m 24s. Rate: 7.5 symbols/min [2025-09-19T19:24:13.199248] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:13.255404] [DEBUG] [LOCAL ] IEX: Loaded 38692 existing records from primary storage. [2025-09-19T19:24:13.255546] [INFO ] [MAIN ] IEX: Loaded 38692 existing records. [2025-09-19T19:24:13.431174] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:13.431481] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-19T19:24:13.431593] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-19T19:24:13.432482] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-19T19:24:13.432556] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-19T19:24:13.463446] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-19T19:24:13.801029] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:14.243278] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-19T19:24:14.673472] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T19:24:14.699353] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-19T19:24:15.043279] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-19T19:24:15.204346] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T19:24:15.843301] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-19T19:24:16.149965] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T19:24:16.623967] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T19:24:16.643218] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-19T19:24:16.776900] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:24:17.443289] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-19T19:24:18.236793] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:24:18.242735] [INFO ] [REMOTE ] ICL: Full fetch complete (56414 records). [2025-09-19T19:24:18.242897] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-19T19:24:18.243272] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-19T19:24:18.536203] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T19:24:18.656707] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-19T19:24:18.656796] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-19T19:24:18.657586] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-19T19:24:18.657626] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-19T19:24:18.658836] [DEBUG] [LOCAL ] ICL: Trimmed 56414 records to 39503 (keeping 200 days of data) [2025-09-19T19:24:18.900984] [DEBUG] [LOCAL ] ICL: Primary data saved (39503 records). [2025-09-19T19:24:18.901241] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-19T19:24:18.901374] [INFO ] [MAIN ] Update Progress: 1088/2372 symbols completed. ICL took 37.4s. Estimated remaining: 2h 50m 14s. Rate: 7.5 symbols/min [2025-09-19T19:24:19.048989] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-19T19:24:19.091868] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:19.166458] [DEBUG] [LOCAL ] IFF: Loaded 51320 existing records from primary storage. [2025-09-19T19:24:19.166676] [INFO ] [MAIN ] IFF: Loaded 51320 existing records. [2025-09-19T19:24:19.354033] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T19:24:19.433393] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:19.433790] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-19T19:24:19.433860] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-19T19:24:19.434971] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-19T19:24:19.435078] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-19T19:24:19.848556] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-19T19:24:19.997848] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:20.643303] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-19T19:24:20.714428] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:24:20.837402] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T19:24:21.443288] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-19T19:24:21.788689] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T19:24:22.243273] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-19T19:24:22.277601] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T19:24:23.043273] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-19T19:24:23.096806] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T19:24:23.843253] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-19T19:24:24.643256] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-19T19:24:25.436069] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T19:24:25.445044] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-19T19:24:25.546199] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T19:24:25.749221] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T19:24:25.925830] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-19T19:24:26.243229] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-19T19:24:27.043274] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-19T19:24:27.201848] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T19:24:27.843254] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-19T19:24:28.643275] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-19T19:24:28.707482] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:24:28.709237] [INFO ] [REMOTE ] IDE: Full fetch complete (12691 records). [2025-09-19T19:24:28.709318] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-19T19:24:29.081070] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-19T19:24:29.081405] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-19T19:24:29.082026] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-19T19:24:29.082130] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-19T19:24:29.083142] [DEBUG] [LOCAL ] IDE: Trimmed 12691 records to 8501 (keeping 200 days of data) [2025-09-19T19:24:29.155809] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T19:24:29.175892] [DEBUG] [LOCAL ] IDE: Primary data saved (8501 records). [2025-09-19T19:24:29.176010] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-19T19:24:29.176138] [INFO ] [MAIN ] Update Progress: 1089/2372 symbols completed. IDE took 29.2s. Estimated remaining: 2h 50m 9s. Rate: 7.5 symbols/min [2025-09-19T19:24:29.344817] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:29.375880] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T19:24:29.386251] [DEBUG] [LOCAL ] IFN: Loaded 18440 existing records from primary storage. [2025-09-19T19:24:29.386592] [INFO ] [MAIN ] IFN: Loaded 18440 existing records. [2025-09-19T19:24:29.448418] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-19T19:24:29.564847] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:29.565082] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-19T19:24:29.565136] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-19T19:24:29.565720] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-19T19:24:29.565792] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-19T19:24:29.919262] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:30.243256] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-19T19:24:31.043283] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-19T19:24:31.392342] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T19:24:31.501796] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T19:24:31.843243] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-19T19:24:32.643270] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-19T19:24:32.791284] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:24:33.443338] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-19T19:24:33.886284] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:24:33.921924] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:24:34.243319] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-19T19:24:35.043230] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-19T19:24:35.178948] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T19:24:35.629211] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T19:24:35.843280] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-19T19:24:36.642001] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T19:24:36.646005] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-19T19:24:37.443238] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-19T19:24:37.615287] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:24:37.870248] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T19:24:37.875307] [INFO ] [REMOTE ] IDT: Full fetch complete (22379 records). [2025-09-19T19:24:37.875478] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-19T19:24:38.247688] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-19T19:24:38.257024] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-19T19:24:38.257221] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-19T19:24:38.258612] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-19T19:24:38.258777] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-19T19:24:38.266064] [DEBUG] [LOCAL ] IDT: Trimmed 22379 records to 17777 (keeping 200 days of data) [2025-09-19T19:24:38.274081] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T19:24:38.392480] [DEBUG] [LOCAL ] IDT: Primary data saved (17777 records). [2025-09-19T19:24:38.392635] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-19T19:24:38.392875] [INFO ] [MAIN ] Update Progress: 1090/2372 symbols completed. IDT took 30.2s. Estimated remaining: 2h 50m 2s. Rate: 7.5 symbols/min [2025-09-19T19:24:38.616888] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:38.640883] [DEBUG] [LOCAL ] IFS: Loaded 23167 existing records from primary storage. [2025-09-19T19:24:38.641026] [INFO ] [MAIN ] IFS: Loaded 23167 existing records. [2025-09-19T19:24:38.821182] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:38.821628] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-19T19:24:38.821719] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-19T19:24:38.822398] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-19T19:24:38.822460] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-19T19:24:39.048468] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-19T19:24:39.231904] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:39.843258] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-19T19:24:39.920936] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T19:24:40.438599] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T19:24:40.490323] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T19:24:40.643289] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-19T19:24:41.443296] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-19T19:24:41.764114] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T19:24:42.243266] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-19T19:24:43.043274] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-19T19:24:43.199393] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T19:24:43.419092] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T19:24:43.843267] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-19T19:24:44.643235] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-19T19:24:44.739583] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T19:24:45.143626] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T19:24:45.443264] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-19T19:24:46.243244] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-19T19:24:46.595804] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T19:24:46.852726] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T19:24:47.043243] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-19T19:24:47.484056] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T19:24:47.843261] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-19T19:24:48.643280] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-19T19:24:48.928860] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:24:49.205064] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T19:24:49.344615] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T19:24:49.443299] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-19T19:24:50.243267] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-19T19:24:51.043282] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-19T19:24:51.212309] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T19:24:51.387093] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T19:24:51.395282] [INFO ] [REMOTE ] IFF: Full fetch complete (72728 records). [2025-09-19T19:24:51.395426] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-19T19:24:51.826865] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-19T19:24:51.827305] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-19T19:24:51.828252] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-19T19:24:51.828318] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-19T19:24:51.829839] [DEBUG] [LOCAL ] IFF: Trimmed 72728 records to 51702 (keeping 200 days of data) [2025-09-19T19:24:51.894597] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-19T19:24:52.172313] [DEBUG] [LOCAL ] IFF: Primary data saved (51702 records). [2025-09-19T19:24:52.172498] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-19T19:24:52.172629] [INFO ] [MAIN ] Update Progress: 1091/2372 symbols completed. IFF took 33.3s. Estimated remaining: 2h 50m 1s. Rate: 7.5 symbols/min [2025-09-19T19:24:52.357667] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:52.369409] [DEBUG] [LOCAL ] IGA: Loaded 9786 existing records from primary storage. [2025-09-19T19:24:52.369533] [INFO ] [MAIN ] IGA: Loaded 9786 existing records. [2025-09-19T19:24:52.573722] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:52.574030] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-19T19:24:52.574083] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-19T19:24:52.574528] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-19T19:24:52.574589] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-19T19:24:52.645843] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-19T19:24:53.012474] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:53.014909] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T19:24:53.252858] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T19:24:53.443278] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-19T19:24:53.908733] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T19:24:53.996450] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-19T19:24:54.243266] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-19T19:24:55.043283] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-19T19:24:55.152482] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T19:24:55.843296] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-19T19:24:55.989478] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T19:24:56.643231] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-19T19:24:57.295078] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:24:57.443256] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-19T19:24:58.243266] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-19T19:24:58.427942] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T19:24:58.441359] [INFO ] [REMOTE ] IEX: Full fetch complete (53225 records). [2025-09-19T19:24:58.442206] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T19:24:58.442292] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-19T19:24:58.488770] [INFO ] [REMOTE ] IFN: Full fetch complete (28964 records). [2025-09-19T19:24:58.525926] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-19T19:24:59.045733] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-19T19:24:59.236388] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T19:24:59.236667] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-19T19:24:59.236784] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-19T19:24:59.236903] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-19T19:24:59.236940] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-19T19:24:59.237328] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-19T19:24:59.238156] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-19T19:24:59.240860] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-19T19:24:59.241031] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-19T19:24:59.241973] [DEBUG] [LOCAL ] IFN: Trimmed 28964 records to 18547 (keeping 200 days of data) [2025-09-19T19:24:59.242557] [DEBUG] [LOCAL ] IEX: Trimmed 53225 records to 38987 (keeping 200 days of data) [2025-09-19T19:24:59.586282] [DEBUG] [LOCAL ] IFN: Primary data saved (18547 records). [2025-09-19T19:24:59.589178] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-19T19:24:59.590468] [INFO ] [MAIN ] Update Progress: 1092/2372 symbols completed. IFN took 30.4s. Estimated remaining: 2h 49m 52s. Rate: 7.5 symbols/min [2025-09-19T19:24:59.776762] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:59.782394] [DEBUG] [LOCAL ] IEX: Primary data saved (38987 records). [2025-09-19T19:24:59.782544] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-19T19:24:59.783022] [INFO ] [MAIN ] Update Progress: 1093/2372 symbols completed. IEX took 46.8s. Estimated remaining: 2h 49m 35s. Rate: 7.5 symbols/min [2025-09-19T19:24:59.850131] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-19T19:24:59.955720] [DEBUG] [LOCAL ] IGD: Loaded 19399 existing records from primary storage. [2025-09-19T19:24:59.980993] [INFO ] [MAIN ] IGD: Loaded 19399 existing records. [2025-09-19T19:24:59.980931] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:00.092424] [DEBUG] [LOCAL ] IGI: Loaded 3767 existing records from primary storage. [2025-09-19T19:25:00.095144] [INFO ] [MAIN ] IGI: Loaded 3767 existing records. [2025-09-19T19:25:00.321066] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:00.341191] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-19T19:25:00.349560] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-19T19:25:00.363011] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:00.363054] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-19T19:25:00.363226] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-19T19:25:00.363420] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-19T19:25:00.389133] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-19T19:25:00.437188] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-19T19:25:00.443680] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-19T19:25:00.722028] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T19:25:00.804774] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T19:25:00.810558] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-19T19:25:01.091594] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:01.144488] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:01.443268] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-19T19:25:02.138613] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T19:25:02.176092] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T19:25:02.243288] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-19T19:25:03.043283] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-19T19:25:03.370411] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T19:25:03.843255] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-19T19:25:04.251771] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:25:04.452622] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T19:25:04.643270] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-19T19:25:05.384135] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:25:05.443302] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-19T19:25:06.243272] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-19T19:25:06.341747] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T19:25:06.781638] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T19:25:07.043270] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-19T19:25:07.843267] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-19T19:25:08.126289] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T19:25:08.537937] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-19T19:25:08.643269] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-19T19:25:09.443278] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-19T19:25:10.061380] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T19:25:10.118302] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T19:25:10.243262] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-19T19:25:11.043283] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-19T19:25:11.492003] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T19:25:11.843365] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-19T19:25:11.982215] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T19:25:11.987749] [INFO ] [REMOTE ] IFS: Full fetch complete (31288 records). [2025-09-19T19:25:11.988069] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-19T19:25:12.598001] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-19T19:25:12.598173] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-19T19:25:12.600381] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-19T19:25:12.600572] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-19T19:25:12.603717] [DEBUG] [LOCAL ] IFS: Trimmed 31288 records to 23385 (keeping 200 days of data) [2025-09-19T19:25:12.691833] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-19T19:25:12.804515] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T19:25:12.839676] [DEBUG] [LOCAL ] IFS: Primary data saved (23385 records). [2025-09-19T19:25:12.839912] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-19T19:25:12.840069] [INFO ] [MAIN ] Update Progress: 1094/2372 symbols completed. IFS took 34.4s. Estimated remaining: 2h 49m 33s. Rate: 7.5 symbols/min [2025-09-19T19:25:13.048751] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:13.092998] [DEBUG] [LOCAL ] IGR: Loaded 30764 existing records from primary storage. [2025-09-19T19:25:13.093300] [INFO ] [MAIN ] IGR: Loaded 30764 existing records. [2025-09-19T19:25:13.289396] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T19:25:13.311605] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:13.311800] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-19T19:25:13.311861] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-19T19:25:13.312764] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-19T19:25:13.312824] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-19T19:25:13.449257] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-19T19:25:13.665784] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:14.243290] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-19T19:25:14.609318] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:25:14.611445] [INFO ] [REMOTE ] IGA: Full fetch complete (13525 records). [2025-09-19T19:25:14.611548] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-19T19:25:14.977150] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-19T19:25:14.977234] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-19T19:25:14.977567] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-19T19:25:14.977608] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-19T19:25:14.978322] [DEBUG] [LOCAL ] IGA: Trimmed 13525 records to 9829 (keeping 200 days of data) [2025-09-19T19:25:15.041415] [DEBUG] [LOCAL ] IGA: Primary data saved (9829 records). [2025-09-19T19:25:15.041560] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-19T19:25:15.041681] [INFO ] [MAIN ] Update Progress: 1095/2372 symbols completed. IGA took 22.9s. Estimated remaining: 2h 49m 19s. Rate: 7.5 symbols/min [2025-09-19T19:25:15.053261] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-19T19:25:15.218004] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:15.218250] [DEBUG] [LOCAL ] IH: No existing data file found in primary storage. [2025-09-19T19:25:15.218307] [WARN ] [MAIN ] IH: No existing data found, performing full refresh instead. [2025-09-19T19:25:15.218457] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-19T19:25:15.218499] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-19T19:25:15.218540] [DEBUG] [LOCAL ] IH: No primary data file found to delete. [2025-09-19T19:25:15.218572] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-19T19:25:15.607971] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:15.656023] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T19:25:15.843279] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-19T19:25:15.902919] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-19T19:25:16.643266] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-19T19:25:17.204970] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T19:25:17.443503] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-19T19:25:17.443387] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T19:25:18.145183] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T19:25:18.243240] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-19T19:25:19.019040] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T19:25:19.043220] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-19T19:25:19.795130] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T19:25:19.843233] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-19T19:25:20.475117] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T19:25:20.476328] [INFO ] [REMOTE ] IGI: Full fetch complete (5192 records). [2025-09-19T19:25:20.476418] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-19T19:25:20.655225] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-19T19:25:20.887107] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-19T19:25:20.887193] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-19T19:25:20.887360] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-19T19:25:20.887398] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-19T19:25:20.887821] [DEBUG] [LOCAL ] IGI: Trimmed 5192 records to 3784 (keeping 200 days of data) [2025-09-19T19:25:20.911054] [DEBUG] [LOCAL ] IGI: Primary data saved (3784 records). [2025-09-19T19:25:20.911185] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-19T19:25:20.911270] [INFO ] [MAIN ] Update Progress: 1096/2372 symbols completed. IGI took 21.1s. Estimated remaining: 2h 49m 8s. Rate: 7.5 symbols/min [2025-09-19T19:25:21.085955] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:21.095563] [DEBUG] [LOCAL ] IHD: Loaded 7264 existing records from primary storage. [2025-09-19T19:25:21.095714] [INFO ] [MAIN ] IHD: Loaded 7264 existing records. [2025-09-19T19:25:21.214982] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-19T19:25:21.278790] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:21.279076] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-19T19:25:21.279124] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-19T19:25:21.279547] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-19T19:25:21.279611] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-19T19:25:21.458512] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-19T19:25:21.674258] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:22.243266] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-19T19:25:22.271325] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T19:25:23.043273] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-19T19:25:23.683620] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:25:23.843276] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-19T19:25:23.985018] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T19:25:24.643339] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-19T19:25:25.315376] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T19:25:25.443243] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-19T19:25:26.071201] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:25:26.243253] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-19T19:25:26.985955] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T19:25:27.043265] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-19T19:25:27.456709] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:25:27.843245] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-19T19:25:28.050106] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T19:25:28.178109] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-19T19:25:28.643276] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-19T19:25:29.144766] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T19:25:29.443267] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-19T19:25:30.243286] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-19T19:25:30.898349] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T19:25:31.043263] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-19T19:25:31.179911] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T19:25:31.843250] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-19T19:25:31.973085] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T19:25:32.643260] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-19T19:25:32.791432] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T19:25:33.443261] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-19T19:25:34.243287] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-19T19:25:34.257725] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T19:25:34.285206] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:25:35.043268] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-19T19:25:35.168588] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T19:25:35.788704] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:25:35.843225] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-19T19:25:36.643255] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-19T19:25:37.053358] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:25:37.387274] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T19:25:37.443258] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-19T19:25:38.243264] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-19T19:25:38.393529] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:25:39.043277] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-19T19:25:39.471930] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T19:25:39.843259] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-19T19:25:39.874535] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T19:25:40.643310] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-19T19:25:41.000073] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T19:25:41.389545] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T19:25:41.443248] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-19T19:25:42.243245] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-19T19:25:42.606172] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:25:42.610037] [INFO ] [REMOTE ] IGD: Full fetch complete (29342 records). [2025-09-19T19:25:42.610139] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-19T19:25:42.720088] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T19:25:42.737138] [INFO ] [REMOTE ] IH: Full fetch complete (4914 records). [2025-09-19T19:25:42.760137] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-19T19:25:43.048364] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-19T19:25:43.313614] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-19T19:25:43.315967] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-19T19:25:43.322228] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-19T19:25:43.322307] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-19T19:25:43.368026] [DEBUG] [LOCAL ] IGD: Trimmed 29342 records to 19486 (keeping 200 days of data) [2025-09-19T19:25:43.442218] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-19T19:25:43.451572] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-19T19:25:43.451834] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-19T19:25:43.478286] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-19T19:25:43.481361] [DEBUG] [LOCAL ] IH: Trimmed 4914 records to 3638 (keeping 200 days of data) [2025-09-19T19:25:43.510885] [DEBUG] [LOCAL ] IH: Primary data saved (3638 records). [2025-09-19T19:25:43.511212] [INFO ] [MAIN ] IH: Full history saved. [2025-09-19T19:25:43.511605] [INFO ] [MAIN ] Update Progress: 1097/2372 symbols completed. IH took 28.5s. Estimated remaining: 2h 49m 17s. Rate: 7.5 symbols/min [2025-09-19T19:25:43.689558] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:43.711606] [DEBUG] [LOCAL ] IGD: Primary data saved (19486 records). [2025-09-19T19:25:43.719333] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-19T19:25:43.719482] [INFO ] [MAIN ] Update Progress: 1098/2372 symbols completed. IGD took 44.1s. Estimated remaining: 2h 49m 0s. Rate: 7.5 symbols/min [2025-09-19T19:25:43.719912] [DEBUG] [LOCAL ] IHG: Loaded 25038 existing records from primary storage. [2025-09-19T19:25:43.720024] [INFO ] [MAIN ] IHG: Loaded 25038 existing records. [2025-09-19T19:25:43.850969] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-19T19:25:44.076041] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:44.080057] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:44.080358] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-19T19:25:44.080479] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-19T19:25:44.081620] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-19T19:25:44.081773] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-19T19:25:44.353604] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T19:25:44.440381] [DEBUG] [LOCAL ] IHS: Loaded 39355 existing records from primary storage. [2025-09-19T19:25:44.446183] [INFO ] [MAIN ] IHS: Loaded 39355 existing records. [2025-09-19T19:25:44.633802] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:44.648453] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-19T19:25:44.718697] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:44.718940] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-19T19:25:44.718991] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-19T19:25:44.720153] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-19T19:25:44.720217] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-19T19:25:45.114155] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:45.429073] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T19:25:45.443210] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-19T19:25:45.681681] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T19:25:46.243290] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-19T19:25:46.890503] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T19:25:46.895548] [INFO ] [REMOTE ] IGR: Full fetch complete (45968 records). [2025-09-19T19:25:46.895676] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-19T19:25:47.050585] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-19T19:25:47.230138] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T19:25:47.236306] [INFO ] [REMOTE ] IHD: Full fetch complete (12014 records). [2025-09-19T19:25:47.241919] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-19T19:25:47.465469] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-19T19:25:47.470736] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-19T19:25:47.471700] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-19T19:25:47.476948] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-19T19:25:47.526833] [DEBUG] [LOCAL ] IGR: Trimmed 45968 records to 31042 (keeping 200 days of data) [2025-09-19T19:25:47.877056] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-19T19:25:47.888721] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-19T19:25:47.890056] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-19T19:25:47.890812] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-19T19:25:47.891429] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-19T19:25:47.898589] [DEBUG] [LOCAL ] IHD: Trimmed 12014 records to 7308 (keeping 200 days of data) [2025-09-19T19:25:47.962117] [DEBUG] [LOCAL ] IHD: Primary data saved (7308 records). [2025-09-19T19:25:47.965031] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-19T19:25:47.965997] [INFO ] [MAIN ] Update Progress: 1099/2372 symbols completed. IHD took 27.1s. Estimated remaining: 2h 48m 48s. Rate: 7.5 symbols/min [2025-09-19T19:25:48.205031] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:48.217824] [DEBUG] [LOCAL ] IIF: Loaded 5865 existing records from primary storage. [2025-09-19T19:25:48.221755] [INFO ] [MAIN ] IIF: Loaded 5865 existing records. [2025-09-19T19:25:48.352363] [DEBUG] [LOCAL ] IGR: Primary data saved (31042 records). [2025-09-19T19:25:48.357753] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-19T19:25:48.357941] [INFO ] [MAIN ] Update Progress: 1100/2372 symbols completed. IGR took 35.5s. Estimated remaining: 2h 48m 31s. Rate: 7.5 symbols/min [2025-09-19T19:25:48.481134] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:48.504602] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T19:25:48.521214] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-19T19:25:48.526433] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-19T19:25:48.548143] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-19T19:25:48.548290] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-19T19:25:48.645216] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-19T19:25:48.721785] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:48.939326] [DEBUG] [LOCAL ] IIIN: Loaded 17104 existing records from primary storage. [2025-09-19T19:25:48.966339] [INFO ] [MAIN ] IIIN: Loaded 17104 existing records. [2025-09-19T19:25:49.074735] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:49.240133] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:49.241614] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T19:25:49.241802] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-19T19:25:49.249524] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-19T19:25:49.250208] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-19T19:25:49.250268] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-19T19:25:49.452789] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-19T19:25:49.550078] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T19:25:49.638860] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:50.243277] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-19T19:25:50.925411] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T19:25:51.043322] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-19T19:25:51.200488] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T19:25:51.843260] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-19T19:25:52.644110] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-19T19:25:52.646202] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T19:25:53.167700] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T19:25:53.443257] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-19T19:25:53.544208] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T19:25:54.243275] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-19T19:25:55.043806] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T19:25:55.051931] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-19T19:25:55.129504] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T19:25:55.843280] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-19T19:25:56.505992] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T19:25:56.643223] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-19T19:25:57.443270] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-19T19:25:57.487766] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T19:25:58.231293] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:25:58.243214] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-19T19:25:58.288997] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T19:25:59.043309] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-19T19:25:59.784066] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:25:59.789280] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T19:25:59.843284] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-19T19:26:00.643272] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-19T19:26:01.077940] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T19:26:01.443308] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-19T19:26:01.533993] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:26:01.966592] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-19T19:26:02.243301] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-19T19:26:03.036666] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T19:26:03.043205] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-19T19:26:03.822812] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T19:26:03.843217] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-19T19:26:04.643270] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-19T19:26:04.695905] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-19T19:26:05.443354] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-19T19:26:06.243277] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-19T19:26:06.434262] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:26:06.514543] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T19:26:06.990755] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T19:26:07.043295] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-19T19:26:07.843284] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-19T19:26:08.581746] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T19:26:08.583263] [INFO ] [REMOTE ] IIF: Full fetch complete (9653 records). [2025-09-19T19:26:08.583351] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-19T19:26:08.648539] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-19T19:26:08.981145] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-19T19:26:08.981269] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-19T19:26:08.981941] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-19T19:26:08.982108] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-19T19:26:08.982801] [DEBUG] [LOCAL ] IIF: Trimmed 9653 records to 5891 (keeping 200 days of data) [2025-09-19T19:26:09.037163] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T19:26:09.059089] [DEBUG] [LOCAL ] IIF: Primary data saved (5891 records). [2025-09-19T19:26:09.059292] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-19T19:26:09.059438] [INFO ] [MAIN ] Update Progress: 1101/2372 symbols completed. IIF took 21.1s. Estimated remaining: 2h 48m 38s. Rate: 7.5 symbols/min [2025-09-19T19:26:09.248941] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:09.267008] [DEBUG] [LOCAL ] IIM: Loaded 16071 existing records from primary storage. [2025-09-19T19:26:09.267188] [INFO ] [MAIN ] IIM: Loaded 16071 existing records. [2025-09-19T19:26:09.452010] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-19T19:26:09.457781] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:09.458313] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-19T19:26:09.458401] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-19T19:26:09.460557] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-19T19:26:09.460633] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-19T19:26:09.862027] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:10.138891] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T19:26:10.243232] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-19T19:26:11.043301] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-19T19:26:11.203800] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:26:11.548824] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T19:26:11.843238] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-19T19:26:12.295244] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T19:26:12.643271] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-19T19:26:13.449908] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-19T19:26:13.454911] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T19:26:13.502521] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:26:13.506167] [INFO ] [REMOTE ] IHG: Full fetch complete (33478 records). [2025-09-19T19:26:13.506255] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-19T19:26:13.901621] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-19T19:26:13.901824] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-19T19:26:13.902548] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-19T19:26:13.902612] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-19T19:26:13.903565] [DEBUG] [LOCAL ] IHG: Trimmed 33478 records to 25214 (keeping 200 days of data) [2025-09-19T19:26:14.063398] [DEBUG] [LOCAL ] IHG: Primary data saved (25214 records). [2025-09-19T19:26:14.063532] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-19T19:26:14.063628] [INFO ] [MAIN ] Update Progress: 1102/2372 symbols completed. IHG took 30.6s. Estimated remaining: 2h 48m 27s. Rate: 7.5 symbols/min [2025-09-19T19:26:14.233438] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:14.243332] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-19T19:26:14.267281] [DEBUG] [LOCAL ] IIPR: Loaded 29843 existing records from primary storage. [2025-09-19T19:26:14.267427] [INFO ] [MAIN ] IIPR: Loaded 29843 existing records. [2025-09-19T19:26:14.445484] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:14.445944] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-19T19:26:14.445993] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-19T19:26:14.447071] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-19T19:26:14.447132] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-19T19:26:14.811956] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:14.851307] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T19:26:15.043280] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-19T19:26:15.433177] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T19:26:15.843275] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-19T19:26:16.643234] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-19T19:26:16.768995] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T19:26:17.092292] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T19:26:17.443261] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-19T19:26:17.821570] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T19:26:18.243278] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-19T19:26:18.960918] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T19:26:19.043274] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-19T19:26:19.568635] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:26:19.843237] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-19T19:26:20.252067] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T19:26:20.549898] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T19:26:20.643266] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-19T19:26:21.443293] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-19T19:26:21.790756] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T19:26:22.243290] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-19T19:26:22.893698] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T19:26:23.043278] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-19T19:26:23.515710] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T19:26:23.518071] [INFO ] [REMOTE ] IIIN: Full fetch complete (25264 records). [2025-09-19T19:26:23.518151] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-19T19:26:23.846790] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-19T19:26:23.890982] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-19T19:26:23.891072] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-19T19:26:23.891700] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-19T19:26:23.891778] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-19T19:26:23.896819] [DEBUG] [LOCAL ] IIIN: Trimmed 25264 records to 17183 (keeping 200 days of data) [2025-09-19T19:26:24.011336] [DEBUG] [LOCAL ] IIIN: Primary data saved (17183 records). [2025-09-19T19:26:24.011513] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-19T19:26:24.011715] [INFO ] [MAIN ] Update Progress: 1103/2372 symbols completed. IIIN took 35.6s. Estimated remaining: 2h 48m 21s. Rate: 7.5 symbols/min [2025-09-19T19:26:24.188221] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:24.203927] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:26:24.209272] [INFO ] [REMOTE ] IHS: Full fetch complete (52557 records). [2025-09-19T19:26:24.209381] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-19T19:26:24.531752] [DEBUG] [LOCAL ] IMAX: Loaded 43011 existing records from primary storage. [2025-09-19T19:26:24.537741] [INFO ] [MAIN ] IMAX: Loaded 43011 existing records. [2025-09-19T19:26:24.647046] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-19T19:26:24.722265] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-19T19:26:24.732881] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-19T19:26:24.744927] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-19T19:26:24.745050] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-19T19:26:24.810561] [DEBUG] [LOCAL ] IHS: Trimmed 52557 records to 39559 (keeping 200 days of data) [2025-09-19T19:26:24.836883] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:24.837171] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-19T19:26:24.837229] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-19T19:26:24.838554] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-19T19:26:24.838684] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-19T19:26:25.249312] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-19T19:26:25.346277] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:25.443233] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-19T19:26:25.479154] [DEBUG] [LOCAL ] IHS: Primary data saved (39559 records). [2025-09-19T19:26:25.479322] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-19T19:26:25.479460] [INFO ] [MAIN ] Update Progress: 1104/2372 symbols completed. IHS took 41.8s. Estimated remaining: 2h 48m 6s. Rate: 7.5 symbols/min [2025-09-19T19:26:25.654296] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:25.711118] [DEBUG] [LOCAL ] INFA: Loaded 50516 existing records from primary storage. [2025-09-19T19:26:25.711284] [INFO ] [MAIN ] INFA: Loaded 50516 existing records. [2025-09-19T19:26:25.888761] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:25.888995] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-19T19:26:25.889043] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-19T19:26:25.890435] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-19T19:26:25.890497] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-19T19:26:26.254920] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-19T19:26:26.260984] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:26.289583] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T19:26:26.954220] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T19:26:27.043225] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-19T19:26:27.418163] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T19:26:27.843251] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-19T19:26:28.406839] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-19T19:26:28.618238] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T19:26:28.643219] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-19T19:26:29.443301] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-19T19:26:30.247936] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-19T19:26:30.258622] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:26:31.043232] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-19T19:26:31.071335] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T19:26:31.154208] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T19:26:31.843273] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-19T19:26:32.560595] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T19:26:32.643269] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-19T19:26:32.972415] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:26:33.443277] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-19T19:26:34.243330] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-19T19:26:34.322542] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T19:26:34.921026] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T19:26:35.043285] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-19T19:26:35.383592] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T19:26:35.843282] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-19T19:26:36.643274] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-19T19:26:36.907983] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T19:26:37.014765] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T19:26:37.443263] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-19T19:26:37.822188] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T19:26:38.243308] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-19T19:26:38.710454] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:26:39.043267] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-19T19:26:39.441883] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T19:26:39.445355] [INFO ] [REMOTE ] IIM: Full fetch complete (25401 records). [2025-09-19T19:26:39.445503] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-19T19:26:39.830059] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-19T19:26:39.830148] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-19T19:26:39.830730] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-19T19:26:39.830818] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-19T19:26:39.831514] [DEBUG] [LOCAL ] IIM: Trimmed 25401 records to 16141 (keeping 200 days of data) [2025-09-19T19:26:39.882848] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-19T19:26:39.948367] [DEBUG] [LOCAL ] IIM: Primary data saved (16141 records). [2025-09-19T19:26:39.948579] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-19T19:26:39.948857] [INFO ] [MAIN ] Update Progress: 1105/2372 symbols completed. IIM took 30.9s. Estimated remaining: 2h 48m 5s. Rate: 7.5 symbols/min [2025-09-19T19:26:40.120336] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:40.193472] [DEBUG] [LOCAL ] INFY: Loaded 53988 existing records from primary storage. [2025-09-19T19:26:40.193733] [INFO ] [MAIN ] INFY: Loaded 53988 existing records. [2025-09-19T19:26:40.370138] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:40.370447] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-19T19:26:40.370514] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-19T19:26:40.372043] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-19T19:26:40.372127] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-19T19:26:40.654158] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-19T19:26:40.749870] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:40.869413] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T19:26:41.274941] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T19:26:41.443287] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-19T19:26:41.947714] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T19:26:42.243277] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-19T19:26:43.043264] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-19T19:26:43.313939] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:26:43.843288] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-19T19:26:44.351422] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T19:26:44.382973] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T19:26:44.643269] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-19T19:26:44.858685] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T19:26:45.443283] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-19T19:26:46.243278] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-19T19:26:46.647433] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T19:26:46.770075] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T19:26:47.043339] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-19T19:26:47.803462] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T19:26:47.808258] [INFO ] [REMOTE ] IIPR: Full fetch complete (44002 records). [2025-09-19T19:26:47.808362] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-19T19:26:47.851909] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-19T19:26:48.194546] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-19T19:26:48.194697] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-19T19:26:48.195406] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-19T19:26:48.195449] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-19T19:26:48.196474] [DEBUG] [LOCAL ] IIPR: Trimmed 44002 records to 30143 (keeping 200 days of data) [2025-09-19T19:26:48.414607] [DEBUG] [LOCAL ] IIPR: Primary data saved (30143 records). [2025-09-19T19:26:48.414794] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-19T19:26:48.414978] [INFO ] [MAIN ] Update Progress: 1106/2372 symbols completed. IIPR took 34.4s. Estimated remaining: 2h 47m 58s. Rate: 7.5 symbols/min [2025-09-19T19:26:48.594230] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:48.654801] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-19T19:26:48.658385] [DEBUG] [LOCAL ] ING: Loaded 51271 existing records from primary storage. [2025-09-19T19:26:48.658638] [INFO ] [MAIN ] ING: Loaded 51271 existing records. [2025-09-19T19:26:48.854217] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:48.854489] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-19T19:26:48.854538] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-19T19:26:48.856256] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-19T19:26:48.856318] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-19T19:26:49.283916] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:49.286598] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T19:26:49.443258] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-19T19:26:49.657245] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T19:26:50.243274] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-19T19:26:50.625994] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T19:26:50.802190] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T19:26:51.043279] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-19T19:26:51.372188] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T19:26:51.843261] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-19T19:26:52.643319] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-19T19:26:52.815318] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T19:26:53.443323] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-19T19:26:53.618924] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T19:26:53.625822] [INFO ] [REMOTE ] IMAX: Full fetch complete (59422 records). [2025-09-19T19:26:53.625967] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-19T19:26:54.029292] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-19T19:26:54.029394] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-19T19:26:54.030219] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-19T19:26:54.030283] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-19T19:26:54.031562] [DEBUG] [LOCAL ] IMAX: Trimmed 59422 records to 43331 (keeping 200 days of data) [2025-09-19T19:26:54.248873] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-19T19:26:54.342907] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T19:26:54.359151] [DEBUG] [LOCAL ] IMAX: Primary data saved (43331 records). [2025-09-19T19:26:54.359730] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-19T19:26:54.359874] [INFO ] [MAIN ] Update Progress: 1107/2372 symbols completed. IMAX took 30.3s. Estimated remaining: 2h 47m 48s. Rate: 7.5 symbols/min [2025-09-19T19:26:54.531342] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:54.567795] [DEBUG] [LOCAL ] INGM: Loaded 29495 existing records from primary storage. [2025-09-19T19:26:54.567942] [INFO ] [MAIN ] INGM: Loaded 29495 existing records. [2025-09-19T19:26:54.748272] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:54.748704] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-19T19:26:54.748784] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-19T19:26:54.749680] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-19T19:26:54.749741] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-19T19:26:55.046149] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-19T19:26:55.088328] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T19:26:55.220619] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:55.843254] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-19T19:26:56.055584] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:26:56.063267] [INFO ] [REMOTE ] INFA: Full fetch complete (71969 records). [2025-09-19T19:26:56.063436] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-19T19:26:56.484962] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-19T19:26:56.485297] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-19T19:26:56.486369] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-19T19:26:56.486435] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-19T19:26:56.488060] [DEBUG] [LOCAL ] INFA: Trimmed 71969 records to 50875 (keeping 200 days of data) [2025-09-19T19:26:56.665907] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-19T19:26:56.801346] [DEBUG] [LOCAL ] INFA: Primary data saved (50875 records). [2025-09-19T19:26:56.801506] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-19T19:26:56.801629] [INFO ] [MAIN ] Update Progress: 1108/2372 symbols completed. INFA took 31.3s. Estimated remaining: 2h 47m 33s. Rate: 7.5 symbols/min [2025-09-19T19:26:56.972760] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:57.015344] [DEBUG] [LOCAL ] INGR: Loaded 33638 existing records from primary storage. [2025-09-19T19:26:57.015511] [INFO ] [MAIN ] INGR: Loaded 33638 existing records. [2025-09-19T19:26:57.204347] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:57.204901] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-19T19:26:57.204970] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-19T19:26:57.206166] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-19T19:26:57.206226] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-19T19:26:57.415178] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T19:26:57.533330] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-19T19:26:57.617537] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:57.832141] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:26:58.243292] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-19T19:26:58.295621] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T19:26:59.043353] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-19T19:26:59.203542] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T19:26:59.439692] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T19:26:59.843320] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-19T19:27:00.643283] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-19T19:27:01.057199] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T19:27:01.443315] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-19T19:27:01.806420] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T19:27:02.243309] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-19T19:27:02.736421] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T19:27:03.043336] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-19T19:27:03.843384] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-19T19:27:04.621088] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (3.18 seconds). [2025-09-19T19:27:04.643269] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-19T19:27:04.847907] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:27:05.443282] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-19T19:27:05.767598] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (3.52 seconds). [2025-09-19T19:27:05.954596] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:27:05.987130] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:27:06.243264] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-19T19:27:07.043316] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-19T19:27:07.200167] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T19:27:07.843267] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-19T19:27:08.362909] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T19:27:08.604308] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:27:08.643264] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-19T19:27:09.443280] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-19T19:27:10.043369] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T19:27:10.215597] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T19:27:10.243234] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-19T19:27:11.043274] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-19T19:27:11.480207] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T19:27:11.843244] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-19T19:27:12.370970] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T19:27:12.379986] [INFO ] [REMOTE ] INFY: Full fetch complete (77535 records). [2025-09-19T19:27:12.380125] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-19T19:27:12.645722] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-19T19:27:12.818218] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:27:12.837753] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-19T19:27:12.837902] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-19T19:27:12.846101] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-19T19:27:12.846636] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-19T19:27:12.848892] [DEBUG] [LOCAL ] INFY: Trimmed 77535 records to 54378 (keeping 200 days of data) [2025-09-19T19:27:13.182171] [DEBUG] [LOCAL ] INFY: Primary data saved (54378 records). [2025-09-19T19:27:13.182341] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-19T19:27:13.183053] [INFO ] [MAIN ] Update Progress: 1109/2372 symbols completed. INFY took 33.2s. Estimated remaining: 2h 47m 35s. Rate: 7.5 symbols/min [2025-09-19T19:27:13.351626] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:13.393598] [DEBUG] [LOCAL ] INN: Loaded 42287 existing records from primary storage. [2025-09-19T19:27:13.393768] [INFO ] [MAIN ] INN: Loaded 42287 existing records. [2025-09-19T19:27:13.452707] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-19T19:27:13.581975] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:13.582287] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-19T19:27:13.582363] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-19T19:27:13.583450] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-19T19:27:13.583511] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-19T19:27:13.955748] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:14.243283] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-19T19:27:15.218851] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (3.38 seconds). [2025-09-19T19:27:15.229764] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-19T19:27:15.250470] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T19:27:15.368253] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T19:27:15.843248] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-19T19:27:16.070829] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T19:27:16.643229] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-19T19:27:16.969321] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:27:17.317452] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T19:27:17.443223] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-19T19:27:17.595772] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T19:27:18.243263] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-19T19:27:19.043263] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-19T19:27:19.333414] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:27:19.420692] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T19:27:19.843265] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-19T19:27:20.605536] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T19:27:20.643246] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-19T19:27:20.726550] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:27:20.730718] [INFO ] [REMOTE ] INGM: Full fetch complete (42097 records). [2025-09-19T19:27:20.730833] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-19T19:27:21.151621] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-19T19:27:21.151741] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-19T19:27:21.152446] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-19T19:27:21.152519] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-19T19:27:21.153609] [DEBUG] [LOCAL ] INGM: Trimmed 42097 records to 29659 (keeping 200 days of data) [2025-09-19T19:27:21.338552] [DEBUG] [LOCAL ] INGM: Primary data saved (29659 records). [2025-09-19T19:27:21.338730] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-19T19:27:21.338834] [INFO ] [MAIN ] Update Progress: 1110/2372 symbols completed. INGM took 27.0s. Estimated remaining: 2h 47m 27s. Rate: 7.5 symbols/min [2025-09-19T19:27:21.452685] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-19T19:27:21.537184] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:21.537367] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-19T19:27:21.537405] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-19T19:27:21.537550] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-19T19:27:21.537607] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-19T19:27:21.537703] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-19T19:27:21.537748] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-19T19:27:21.939323] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:21.941083] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:27:22.243354] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-19T19:27:23.043307] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-19T19:27:23.118398] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T19:27:23.843291] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-19T19:27:24.198802] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T19:27:24.207333] [INFO ] [REMOTE ] ING: Full fetch complete (73637 records). [2025-09-19T19:27:24.207543] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-19T19:27:24.619632] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-19T19:27:24.619943] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-19T19:27:24.622161] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-19T19:27:24.622386] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-19T19:27:24.625351] [DEBUG] [LOCAL ] ING: Trimmed 73637 records to 51617 (keeping 200 days of data) [2025-09-19T19:27:24.646409] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-19T19:27:24.650058] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T19:27:24.919923] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:27:24.921458] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-19T19:27:25.015041] [DEBUG] [LOCAL ] ING: Primary data saved (51617 records). [2025-09-19T19:27:25.015270] [INFO ] [MAIN ] ING: Full history saved. [2025-09-19T19:27:25.015384] [INFO ] [MAIN ] Update Progress: 1111/2372 symbols completed. ING took 36.6s. Estimated remaining: 2h 47m 14s. Rate: 7.5 symbols/min [2025-09-19T19:27:25.191386] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:25.232501] [DEBUG] [LOCAL ] INSP: Loaded 36882 existing records from primary storage. [2025-09-19T19:27:25.232741] [INFO ] [MAIN ] INSP: Loaded 36882 existing records. [2025-09-19T19:27:25.423864] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:25.424420] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-19T19:27:25.424504] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-19T19:27:25.445639] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-19T19:27:25.433332] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-19T19:27:25.446531] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-19T19:27:25.454499] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T19:27:25.860633] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:26.002006] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-19T19:27:26.243274] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-19T19:27:27.043269] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-19T19:27:27.843381] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-19T19:27:27.868405] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:27:27.974113] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:27:28.643280] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-19T19:27:29.443296] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-19T19:27:29.460551] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T19:27:29.470112] [INFO ] [REMOTE ] INGR: Full fetch complete (49654 records). [2025-09-19T19:27:29.470286] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-19T19:27:29.855403] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-19T19:27:29.855509] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-19T19:27:29.856486] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-19T19:27:29.856563] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-19T19:27:29.858036] [DEBUG] [LOCAL ] INGR: Trimmed 49654 records to 33927 (keeping 200 days of data) [2025-09-19T19:27:29.878463] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T19:27:30.099071] [DEBUG] [LOCAL ] INGR: Primary data saved (33927 records). [2025-09-19T19:27:30.099230] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-19T19:27:30.099320] [INFO ] [MAIN ] Update Progress: 1112/2372 symbols completed. INGR took 33.3s. Estimated remaining: 2h 47m 3s. Rate: 7.5 symbols/min [2025-09-19T19:27:30.254099] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-19T19:27:30.290672] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:30.338280] [DEBUG] [LOCAL ] INSW: Loaded 40985 existing records from primary storage. [2025-09-19T19:27:30.338424] [INFO ] [MAIN ] INSW: Loaded 40985 existing records. [2025-09-19T19:27:30.528402] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:30.528700] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-19T19:27:30.528805] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-19T19:27:30.530400] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-19T19:27:30.530462] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-19T19:27:30.896596] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:31.043272] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-19T19:27:31.151034] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T19:27:31.843295] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-19T19:27:31.880171] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T19:27:32.643308] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-19T19:27:32.847520] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T19:27:33.443365] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-19T19:27:33.632489] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:27:34.243300] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-19T19:27:34.320053] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T19:27:35.043281] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-19T19:27:35.227882] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:27:35.843310] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-19T19:27:36.643234] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-19T19:27:36.722933] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:27:37.443234] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-19T19:27:37.548260] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T19:27:37.652502] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T19:27:37.740321] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (3.50 seconds). [2025-09-19T19:27:38.243305] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-19T19:27:39.043265] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-19T19:27:39.334544] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T19:27:39.843249] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-19T19:27:40.024074] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T19:27:40.437454] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T19:27:40.643264] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-19T19:27:41.163306] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T19:27:41.443298] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-19T19:27:41.995189] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T19:27:42.243264] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-19T19:27:43.033398] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:27:43.043217] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-19T19:27:43.134262] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T19:27:43.843268] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-19T19:27:44.635835] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:27:44.643152] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-19T19:27:44.967577] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T19:27:45.443262] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-19T19:27:45.576461] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T19:27:46.243258] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-19T19:27:47.043274] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-19T19:27:47.083400] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T19:27:47.089086] [INFO ] [REMOTE ] INN: Full fetch complete (57866 records). [2025-09-19T19:27:47.089183] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-19T19:27:47.485582] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-19T19:27:47.485774] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-19T19:27:47.486593] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-19T19:27:47.486707] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-19T19:27:47.508117] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T19:27:47.516034] [DEBUG] [LOCAL ] INN: Trimmed 57866 records to 42564 (keeping 200 days of data) [2025-09-19T19:27:47.768194] [DEBUG] [LOCAL ] INN: Primary data saved (42564 records). [2025-09-19T19:27:47.768329] [INFO ] [MAIN ] INN: Full history saved. [2025-09-19T19:27:47.769015] [INFO ] [MAIN ] Update Progress: 1113/2372 symbols completed. INN took 34.6s. Estimated remaining: 2h 47m 6s. Rate: 7.5 symbols/min [2025-09-19T19:27:47.848351] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-19T19:27:47.942851] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:47.998570] [DEBUG] [LOCAL ] INVH: Loaded 53529 existing records from primary storage. [2025-09-19T19:27:47.998778] [INFO ] [MAIN ] INVH: Loaded 53529 existing records. [2025-09-19T19:27:48.194839] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:48.195147] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-19T19:27:48.195197] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-19T19:27:48.196261] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-19T19:27:48.196325] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-19T19:27:48.579728] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:48.597723] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T19:27:48.643223] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-19T19:27:49.298857] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T19:27:49.443321] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-19T19:27:50.243264] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-19T19:27:50.581523] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T19:27:50.912163] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T19:27:50.916444] [INFO ] [REMOTE ] INR: Full fetch complete (32460 records). [2025-09-19T19:27:50.916526] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-19T19:27:51.048507] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-19T19:27:51.115330] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 160 unique days, need 200 days [2025-09-19T19:27:51.115832] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:27:51.115906] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:27:51.115975] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-19T19:27:51.116043] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-19T19:27:51.116079] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-19T19:27:51.116133] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-19T19:27:51.116282] [INFO ] [MAIN ] Update Progress: 1114/2372 symbols completed. INR took 29.8s. Estimated remaining: 2h 46m 53s. Rate: 7.5 symbols/min [2025-09-19T19:27:51.286821] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:51.316489] [DEBUG] [LOCAL ] INVX: Loaded 29524 existing records from primary storage. [2025-09-19T19:27:51.316619] [INFO ] [MAIN ] INVX: Loaded 29524 existing records. [2025-09-19T19:27:51.492912] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:51.493169] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-19T19:27:51.493216] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-19T19:27:51.494000] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-19T19:27:51.494061] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-19T19:27:51.889863] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:51.884948] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-19T19:27:52.171698] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T19:27:52.643260] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-19T19:27:53.103282] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T19:27:53.443231] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-19T19:27:53.887239] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T19:27:54.243360] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-19T19:27:54.400472] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T19:27:54.718074] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:27:55.043341] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-19T19:27:55.843315] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-19T19:27:56.116600] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T19:27:56.123462] [INFO ] [REMOTE ] INSP: Full fetch complete (52155 records). [2025-09-19T19:27:56.123606] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-19T19:27:56.517624] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-19T19:27:56.517945] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-19T19:27:56.518974] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-19T19:27:56.519078] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-19T19:27:56.520933] [DEBUG] [LOCAL ] INSP: Trimmed 52155 records to 37158 (keeping 200 days of data) [2025-09-19T19:27:56.629109] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:27:56.643674] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-19T19:27:56.780171] [DEBUG] [LOCAL ] INSP: Primary data saved (37158 records). [2025-09-19T19:27:56.780315] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-19T19:27:56.780401] [INFO ] [MAIN ] Update Progress: 1115/2372 symbols completed. INSP took 31.8s. Estimated remaining: 2h 46m 42s. Rate: 7.5 symbols/min [2025-09-19T19:27:56.964681] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:57.017826] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-09-19T19:27:57.017999] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-09-19T19:27:57.209367] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:57.209622] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-19T19:27:57.209703] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-19T19:27:57.211054] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-19T19:27:57.211116] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-19T19:27:57.459383] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-19T19:27:57.594145] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:57.938725] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T19:27:58.252419] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-19T19:27:58.277589] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T19:27:58.931712] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T19:27:59.043291] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-19T19:27:59.843319] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-19T19:28:00.385524] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T19:28:00.643312] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-19T19:28:00.767491] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T19:28:01.443341] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-19T19:28:01.633757] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:28:02.243330] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-19T19:28:03.043331] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-19T19:28:03.095347] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T19:28:03.527299] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-09-19T19:28:03.849033] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-19T19:28:03.860921] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:28:04.643276] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-19T19:28:04.786303] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T19:28:05.443258] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-19T19:28:05.786886] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T19:28:05.878604] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:28:06.243265] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-19T19:28:07.043312] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-19T19:28:07.119243] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T19:28:07.125058] [INFO ] [REMOTE ] INSW: Full fetch complete (60934 records). [2025-09-19T19:28:07.125163] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-19T19:28:07.461622] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T19:28:07.546310] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-19T19:28:07.546391] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-19T19:28:07.547241] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-19T19:28:07.547306] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-19T19:28:07.548537] [DEBUG] [LOCAL ] INSW: Trimmed 60934 records to 41250 (keeping 200 days of data) [2025-09-19T19:28:07.797572] [DEBUG] [LOCAL ] INSW: Primary data saved (41250 records). [2025-09-19T19:28:07.797723] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-19T19:28:07.797815] [INFO ] [MAIN ] Update Progress: 1116/2372 symbols completed. INSW took 37.7s. Estimated remaining: 2h 46m 38s. Rate: 7.5 symbols/min [2025-09-19T19:28:07.852589] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-19T19:28:07.974042] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:08.025506] [DEBUG] [LOCAL ] IOT: Loaded 53863 existing records from primary storage. [2025-09-19T19:28:08.025718] [INFO ] [MAIN ] IOT: Loaded 53863 existing records. [2025-09-19T19:28:08.201600] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:08.201887] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-19T19:28:08.201943] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-19T19:28:08.203033] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-19T19:28:08.203094] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-19T19:28:08.549419] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:08.643223] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-19T19:28:09.443475] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-19T19:28:10.013466] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.97 seconds). [2025-09-19T19:28:10.033900] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T19:28:10.243278] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-19T19:28:10.874040] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T19:28:11.043229] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-19T19:28:11.083724] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:28:11.625816] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T19:28:11.843256] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-19T19:28:12.643334] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-19T19:28:13.042526] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T19:28:13.279620] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T19:28:13.443241] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-19T19:28:14.247812] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-19T19:28:14.254214] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T19:28:14.265120] [INFO ] [REMOTE ] INVH: Full fetch complete (76671 records). [2025-09-19T19:28:14.265286] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-19T19:28:14.655527] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-19T19:28:14.655615] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-19T19:28:14.656595] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-19T19:28:14.656683] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-19T19:28:14.658217] [DEBUG] [LOCAL ] INVH: Trimmed 76671 records to 53917 (keeping 200 days of data) [2025-09-19T19:28:14.977181] [DEBUG] [LOCAL ] INVH: Primary data saved (53917 records). [2025-09-19T19:28:14.977318] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-19T19:28:14.978680] [INFO ] [MAIN ] Update Progress: 1117/2372 symbols completed. INVH took 27.2s. Estimated remaining: 2h 46m 29s. Rate: 7.5 symbols/min [2025-09-19T19:28:15.043228] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-19T19:28:15.455036] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T19:28:15.770231] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T19:28:15.774579] [INFO ] [REMOTE ] INVX: Full fetch complete (44613 records). [2025-09-19T19:28:15.774751] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-19T19:28:15.848436] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-19T19:28:16.175563] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-19T19:28:16.175667] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-19T19:28:16.176378] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-19T19:28:16.176420] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-19T19:28:16.177359] [DEBUG] [LOCAL ] INVX: Trimmed 44613 records to 29676 (keeping 200 days of data) [2025-09-19T19:28:16.349344] [DEBUG] [LOCAL ] INVX: Primary data saved (29676 records). [2025-09-19T19:28:16.349484] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-19T19:28:16.349569] [INFO ] [MAIN ] Update Progress: 1118/2372 symbols completed. INVX took 25.2s. Estimated remaining: 2h 46m 14s. Rate: 7.5 symbols/min [2025-09-19T19:28:17.716070] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-19T19:28:17.726443] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-19T19:28:17.999058] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T19:28:18.010276] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-19T19:28:19.950490] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T19:28:19.964913] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-19T19:28:20.077059] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-19T19:28:20.088940] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-19T19:28:22.022117] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T19:28:22.033708] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-19T19:28:23.059868] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-19T19:28:23.071473] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-19T19:28:24.139668] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T19:28:24.151440] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-19T19:28:25.888102] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-19T19:28:25.899885] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-19T19:28:26.335246] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T19:28:26.347399] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-19T19:28:28.487297] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T19:28:28.499095] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-19T19:28:28.932318] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-09-19T19:28:28.943150] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-19T19:28:30.710234] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T19:28:30.720671] [INFO ] [REMOTE ] IOT: Full fetch complete (77376 records). [2025-09-19T19:28:30.720895] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-19T19:28:31.138227] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-19T19:28:31.138356] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-19T19:28:31.139778] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-19T19:28:31.139856] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-19T19:28:31.141608] [DEBUG] [LOCAL ] IOT: Trimmed 77376 records to 54252 (keeping 200 days of data) [2025-09-19T19:28:31.461127] [DEBUG] [LOCAL ] IOT: Primary data saved (54252 records). [2025-09-19T19:28:31.461265] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-19T19:28:31.461421] [INFO ] [MAIN ] Update Progress: 1119/2372 symbols completed. IOT took 23.7s. Estimated remaining: 2h 46m 14s. Rate: 7.5 symbols/min [2025-09-19T19:28:31.919382] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-19T19:28:31.931555] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-19T19:28:34.872296] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-09-19T19:28:34.884158] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-19T19:28:37.843411] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-19T19:28:37.851373] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-19T19:28:37.851522] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-19T19:28:38.269837] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-19T19:28:38.269942] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-19T19:28:38.270931] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-19T19:28:38.271002] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-19T19:28:38.272714] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-09-19T19:28:38.613454] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-09-19T19:28:38.613616] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-19T19:28:38.613748] [INFO ] [MAIN ] Update Progress: 1120/2372 symbols completed. IONQ took 41.8s. Estimated remaining: 2h 46m 5s. Rate: 7.5 symbols/min [2025-09-19T19:28:39.220252] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:39.176597] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:39.333634] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:39.354441] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:39.376810] [DEBUG] [LOCAL ] IQI: Loaded 18112 existing records from primary storage. [2025-09-19T19:28:39.377119] [INFO ] [MAIN ] IQI: Loaded 18112 existing records. [2025-09-19T19:28:39.521338] [DEBUG] [LOCAL ] IPI: Loaded 21585 existing records from primary storage. [2025-09-19T19:28:39.533431] [INFO ] [MAIN ] IPI: Loaded 21585 existing records. [2025-09-19T19:28:39.724551] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:39.750582] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-19T19:28:39.756559] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-19T19:28:39.768521] [DEBUG] [LOCAL ] IP: Loaded 53719 existing records from primary storage. [2025-09-19T19:28:39.773983] [INFO ] [MAIN ] IP: Loaded 53719 existing records. [2025-09-19T19:28:39.784516] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-19T19:28:39.810297] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-19T19:28:39.983251] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:39.996840] [DEBUG] [LOCAL ] IPG: Loaded 53723 existing records from primary storage. [2025-09-19T19:28:40.053177] [INFO ] [MAIN ] IPG: Loaded 53723 existing records. [2025-09-19T19:28:40.063614] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-19T19:28:40.069256] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-19T19:28:40.165552] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-19T19:28:40.202745] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-19T19:28:40.344759] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:40.477708] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-19T19:28:40.587162] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-19T19:28:40.650173] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-19T19:28:40.693379] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:40.733773] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-19T19:28:40.777183] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-19T19:28:40.811828] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-19T19:28:40.906953] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-19T19:28:41.052791] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:41.032557] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-19T19:28:41.058380] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-19T19:28:41.369058] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:41.396372] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-19T19:28:41.696715] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:41.719890] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-19T19:28:41.810218] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:41.810548] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-19T19:28:42.387014] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:28:42.392151] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-19T19:28:42.486470] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T19:28:42.491136] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-19T19:28:43.114468] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:28:43.126000] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-19T19:28:43.178239] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-19T19:28:43.182212] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-19T19:28:43.570755] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T19:28:43.575179] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-19T19:28:43.770461] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T19:28:43.782177] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-19T19:28:44.349534] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T19:28:44.354156] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-19T19:28:44.531156] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:28:44.541766] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-19T19:28:44.767981] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T19:28:44.773154] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-19T19:28:45.065378] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T19:28:45.070718] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-19T19:28:45.707321] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:28:45.717991] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-19T19:28:45.856880] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T19:28:45.860678] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-19T19:28:46.324773] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T19:28:46.330108] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-19T19:28:46.503595] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T19:28:46.513759] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-19T19:28:47.099585] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T19:28:47.104879] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-19T19:28:47.583583] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T19:28:47.595180] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-19T19:28:47.789462] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T19:28:47.795489] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-19T19:28:48.031075] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:28:48.034924] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-19T19:28:48.939030] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-19T19:28:48.950575] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-19T19:28:48.982127] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:28:48.989390] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-19T19:28:49.225308] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:28:49.229286] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-19T19:28:49.325204] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T19:28:49.337681] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-19T19:28:50.533775] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T19:28:50.540318] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-19T19:28:50.683863] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T19:28:50.689298] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-19T19:28:50.923971] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:28:50.935984] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-19T19:28:51.038818] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T19:28:51.052353] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-19T19:28:51.423242] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T19:28:51.429798] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-19T19:28:51.712949] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:28:51.843242] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-19T19:28:52.334303] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T19:28:52.339046] [INFO ] [REMOTE ] IQI: Full fetch complete (27297 records). [2025-09-19T19:28:52.339173] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-19T19:28:52.756829] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-19T19:28:52.757000] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-19T19:28:52.758026] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-19T19:28:52.758135] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-19T19:28:52.759742] [DEBUG] [LOCAL ] IQI: Trimmed 27297 records to 18200 (keeping 200 days of data) [2025-09-19T19:28:52.943992] [DEBUG] [LOCAL ] IQI: Primary data saved (18200 records). [2025-09-19T19:28:52.943816] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T19:28:52.944426] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-19T19:28:52.954929] [INFO ] [MAIN ] Update Progress: 1121/2372 symbols completed. IQI took 14.3s. Estimated remaining: 2h 46m 4s. Rate: 7.5 symbols/min [2025-09-19T19:28:52.957452] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T19:28:52.989797] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-19T19:28:53.139008] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:53.157978] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T19:28:53.161441] [INFO ] [REMOTE ] IPI: Full fetch complete (28923 records). [2025-09-19T19:28:53.161541] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-19T19:28:53.456508] [DEBUG] [LOCAL ] IQV: Loaded 50871 existing records from primary storage. [2025-09-19T19:28:53.456607] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-19T19:28:53.479454] [INFO ] [MAIN ] IQV: Loaded 50871 existing records. [2025-09-19T19:28:53.719528] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-19T19:28:53.719981] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-19T19:28:53.720605] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-19T19:28:53.720708] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-19T19:28:53.771972] [DEBUG] [LOCAL ] IPI: Trimmed 28923 records to 21673 (keeping 200 days of data) [2025-09-19T19:28:53.802128] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:53.802442] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-19T19:28:53.802494] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-19T19:28:53.804719] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-19T19:28:53.804791] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-19T19:28:54.303017] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:54.304861] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-19T19:28:54.342878] [DEBUG] [LOCAL ] IPI: Primary data saved (21673 records). [2025-09-19T19:28:54.343146] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-19T19:28:54.343261] [INFO ] [MAIN ] Update Progress: 1122/2372 symbols completed. IPI took 15.7s. Estimated remaining: 2h 45m 49s. Rate: 7.5 symbols/min [2025-09-19T19:28:54.529523] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:54.591062] [DEBUG] [LOCAL ] IR: Loaded 53086 existing records from primary storage. [2025-09-19T19:28:54.591209] [INFO ] [MAIN ] IR: Loaded 53086 existing records. [2025-09-19T19:28:54.778204] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:54.778544] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-19T19:28:54.778602] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-19T19:28:54.780262] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-19T19:28:54.780325] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-19T19:28:55.158839] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:55.159405] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-19T19:28:55.193399] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T19:28:55.234768] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T19:28:55.843274] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-19T19:28:55.962420] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T19:28:56.643314] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-19T19:28:57.170406] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:28:57.443255] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-19T19:28:57.665980] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:28:58.243272] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-19T19:28:58.555471] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:28:59.043308] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-19T19:28:59.339823] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T19:28:59.843306] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-19T19:29:00.179990] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T19:29:00.265455] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T19:29:00.643280] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-19T19:29:01.443326] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-19T19:29:01.917179] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T19:29:02.243365] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-19T19:29:02.617671] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:29:03.043289] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-19T19:29:03.295606] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T19:29:03.843298] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-19T19:29:04.370076] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T19:29:04.643245] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-19T19:29:05.420350] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T19:29:05.443233] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-19T19:29:05.833003] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:29:06.243370] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-19T19:29:06.661947] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T19:29:06.672398] [INFO ] [REMOTE ] IP: Full fetch complete (77036 records). [2025-09-19T19:29:06.672534] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-19T19:29:07.081686] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-19T19:29:07.077851] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-19T19:29:07.082731] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-19T19:29:07.083808] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-19T19:29:07.083967] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-19T19:29:07.085594] [DEBUG] [LOCAL ] IP: Trimmed 77036 records to 54109 (keeping 200 days of data) [2025-09-19T19:29:07.207223] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:29:07.464103] [DEBUG] [LOCAL ] IP: Primary data saved (54109 records). [2025-09-19T19:29:07.464525] [INFO ] [MAIN ] IP: Full history saved. [2025-09-19T19:29:07.464663] [INFO ] [MAIN ] Update Progress: 1123/2372 symbols completed. IP took 28.8s. Estimated remaining: 2h 45m 47s. Rate: 7.5 symbols/min [2025-09-19T19:29:07.640232] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:07.692539] [DEBUG] [LOCAL ] IRM: Loaded 49920 existing records from primary storage. [2025-09-19T19:29:07.692896] [INFO ] [MAIN ] IRM: Loaded 49920 existing records. [2025-09-19T19:29:07.850498] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-19T19:29:07.885229] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:07.885556] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-19T19:29:07.885607] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-19T19:29:07.887563] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-19T19:29:07.887665] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-19T19:29:08.292355] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:08.314262] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T19:29:08.323862] [INFO ] [REMOTE ] IPG: Full fetch complete (77247 records). [2025-09-19T19:29:08.324012] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-19T19:29:08.648449] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-19T19:29:08.737840] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-19T19:29:08.737932] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-19T19:29:08.738982] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-19T19:29:08.739050] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-19T19:29:08.740556] [DEBUG] [LOCAL ] IPG: Trimmed 77247 records to 54113 (keeping 200 days of data) [2025-09-19T19:29:09.098132] [DEBUG] [LOCAL ] IPG: Primary data saved (54113 records). [2025-09-19T19:29:09.098313] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-19T19:29:09.100534] [INFO ] [MAIN ] Update Progress: 1124/2372 symbols completed. IPG took 30.5s. Estimated remaining: 2h 45m 32s. Rate: 7.5 symbols/min [2025-09-19T19:29:09.307246] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:09.309732] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T19:29:09.345303] [DEBUG] [LOCAL ] IRS: Loaded 21446 existing records from primary storage. [2025-09-19T19:29:09.345429] [INFO ] [MAIN ] IRS: Loaded 21446 existing records. [2025-09-19T19:29:09.448387] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-19T19:29:09.546184] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:09.546481] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-19T19:29:09.546537] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-19T19:29:09.547213] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-19T19:29:09.547276] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-19T19:29:09.947769] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:09.977077] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T19:29:10.243249] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-19T19:29:10.856313] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T19:29:11.043237] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-19T19:29:11.149608] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T19:29:11.666735] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T19:29:11.843250] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-19T19:29:12.643267] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-19T19:29:13.032369] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:29:13.443270] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-19T19:29:13.779268] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T19:29:13.936403] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T19:29:14.243255] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-19T19:29:15.043318] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-19T19:29:15.359463] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T19:29:15.843250] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-19T19:29:16.247606] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T19:29:16.643237] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-19T19:29:17.091049] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T19:29:17.443233] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-19T19:29:18.037332] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T19:29:18.044193] [INFO ] [REMOTE ] IQV: Full fetch complete (72502 records). [2025-09-19T19:29:18.044315] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-19T19:29:18.244460] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-19T19:29:18.343349] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T19:29:18.479687] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-19T19:29:18.479798] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-19T19:29:18.480824] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-19T19:29:18.480902] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-19T19:29:18.482560] [DEBUG] [LOCAL ] IQV: Trimmed 72502 records to 51146 (keeping 200 days of data) [2025-09-19T19:29:18.794483] [DEBUG] [LOCAL ] IQV: Primary data saved (51146 records). [2025-09-19T19:29:18.794629] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-19T19:29:18.794753] [INFO ] [MAIN ] Update Progress: 1125/2372 symbols completed. IQV took 25.8s. Estimated remaining: 2h 45m 26s. Rate: 7.5 symbols/min [2025-09-19T19:29:18.965173] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:19.016588] [DEBUG] [LOCAL ] IRT: Loaded 50772 existing records from primary storage. [2025-09-19T19:29:19.016758] [INFO ] [MAIN ] IRT: Loaded 50772 existing records. [2025-09-19T19:29:19.048438] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-19T19:29:19.222598] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T19:29:19.244849] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:19.245416] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-19T19:29:19.245842] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-19T19:29:19.247157] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-19T19:29:19.247216] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-19T19:29:19.599094] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:19.843249] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-19T19:29:20.403265] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T19:29:20.425978] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T19:29:20.643274] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-19T19:29:21.443279] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-19T19:29:21.878597] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T19:29:21.921675] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:29:22.243278] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-19T19:29:23.043314] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-19T19:29:23.504085] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T19:29:23.542124] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T19:29:23.550063] [INFO ] [REMOTE ] IR: Full fetch complete (76050 records). [2025-09-19T19:29:23.550198] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-19T19:29:23.849729] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-19T19:29:23.953080] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-19T19:29:23.953162] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-19T19:29:23.954123] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-19T19:29:23.954185] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-19T19:29:23.955622] [DEBUG] [LOCAL ] IR: Trimmed 76050 records to 53476 (keeping 200 days of data) [2025-09-19T19:29:24.293137] [DEBUG] [LOCAL ] IR: Primary data saved (53476 records). [2025-09-19T19:29:24.293306] [INFO ] [MAIN ] IR: Full history saved. [2025-09-19T19:29:24.293402] [INFO ] [MAIN ] Update Progress: 1126/2372 symbols completed. IR took 29.9s. Estimated remaining: 2h 45m 15s. Rate: 7.5 symbols/min [2025-09-19T19:29:24.467854] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:24.485607] [DEBUG] [LOCAL ] ISD: Loaded 15949 existing records from primary storage. [2025-09-19T19:29:24.485762] [INFO ] [MAIN ] ISD: Loaded 15949 existing records. [2025-09-19T19:29:24.647438] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-19T19:29:24.669873] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:24.670045] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-19T19:29:24.670093] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-19T19:29:24.670639] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-19T19:29:24.670733] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-19T19:29:25.051549] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:25.086588] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T19:29:25.443273] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-19T19:29:25.706670] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:29:25.988750] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:29:26.243270] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-19T19:29:27.043330] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-19T19:29:27.320213] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:29:27.419431] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T19:29:27.843336] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-19T19:29:28.643265] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-19T19:29:28.841259] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T19:29:29.195158] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T19:29:29.443256] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-19T19:29:29.834825] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T19:29:30.243304] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-19T19:29:31.054554] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-19T19:29:31.057146] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T19:29:31.626122] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:29:31.843227] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-19T19:29:32.294974] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T19:29:32.643272] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-19T19:29:33.443309] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-19T19:29:33.888981] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T19:29:33.909695] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:29:34.243315] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-19T19:29:34.817974] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T19:29:34.823182] [INFO ] [REMOTE ] IRS: Full fetch complete (32135 records). [2025-09-19T19:29:34.823269] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-19T19:29:35.048602] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-19T19:29:35.203498] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-19T19:29:35.203582] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-19T19:29:35.204300] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-19T19:29:35.204364] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-19T19:29:35.205207] [DEBUG] [LOCAL ] IRS: Trimmed 32135 records to 21712 (keeping 200 days of data) [2025-09-19T19:29:35.334297] [DEBUG] [LOCAL ] IRS: Primary data saved (21712 records). [2025-09-19T19:29:35.334444] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-19T19:29:35.334532] [INFO ] [MAIN ] Update Progress: 1127/2372 symbols completed. IRS took 26.2s. Estimated remaining: 2h 45m 10s. Rate: 7.5 symbols/min [2025-09-19T19:29:35.526149] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:35.568582] [DEBUG] [LOCAL ] IT: Loaded 41428 existing records from primary storage. [2025-09-19T19:29:35.568768] [INFO ] [MAIN ] IT: Loaded 41428 existing records. [2025-09-19T19:29:35.746102] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:35.746423] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-19T19:29:35.746488] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-19T19:29:35.747571] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-19T19:29:35.747630] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-19T19:29:35.847913] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-19T19:29:36.109885] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:36.170389] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T19:29:36.444682] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T19:29:36.643234] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-19T19:29:37.056082] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T19:29:37.443299] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-19T19:29:38.243237] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-19T19:29:38.628560] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:29:38.636092] [INFO ] [REMOTE ] IRM: Full fetch complete (72286 records). [2025-09-19T19:29:38.636259] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-19T19:29:38.985969] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T19:29:39.047974] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-19T19:29:39.065603] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-19T19:29:39.066886] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-19T19:29:39.067905] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-19T19:29:39.068066] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-19T19:29:39.069616] [DEBUG] [LOCAL ] IRM: Trimmed 72286 records to 50281 (keeping 200 days of data) [2025-09-19T19:29:39.418632] [DEBUG] [LOCAL ] IRM: Primary data saved (50281 records). [2025-09-19T19:29:39.418806] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-19T19:29:39.419198] [INFO ] [MAIN ] Update Progress: 1128/2372 symbols completed. IRM took 32.0s. Estimated remaining: 2h 44m 58s. Rate: 7.5 symbols/min [2025-09-19T19:29:39.590535] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:39.629175] [DEBUG] [LOCAL ] ITGR: Loaded 31906 existing records from primary storage. [2025-09-19T19:29:39.629355] [INFO ] [MAIN ] ITGR: Loaded 31906 existing records. [2025-09-19T19:29:39.812260] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:39.812803] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-19T19:29:39.812877] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-19T19:29:39.814043] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-19T19:29:39.814120] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-19T19:29:39.846014] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-19T19:29:40.154199] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T19:29:40.226787] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:40.498422] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T19:29:40.643294] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-19T19:29:40.735864] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T19:29:41.443266] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-19T19:29:41.909082] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T19:29:42.243307] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-19T19:29:43.043270] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-19T19:29:43.073601] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T19:29:43.623631] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:29:43.843258] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-19T19:29:44.319543] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:29:44.643265] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-19T19:29:45.443300] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-19T19:29:45.686851] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T19:29:45.938056] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T19:29:46.243281] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-19T19:29:46.777795] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:29:47.043265] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-19T19:29:47.835430] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T19:29:47.843214] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-19T19:29:48.110597] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T19:29:48.643318] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-19T19:29:49.443256] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-19T19:29:49.694561] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T19:29:49.715276] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T19:29:49.717809] [INFO ] [REMOTE ] ISD: Full fetch complete (23886 records). [2025-09-19T19:29:49.717885] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-19T19:29:50.124974] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-19T19:29:50.125078] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-19T19:29:50.125750] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-19T19:29:50.125816] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-19T19:29:50.126515] [DEBUG] [LOCAL ] ISD: Trimmed 23886 records to 16019 (keeping 200 days of data) [2025-09-19T19:29:50.224047] [DEBUG] [LOCAL ] ISD: Primary data saved (16019 records). [2025-09-19T19:29:50.224191] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-19T19:29:50.224278] [INFO ] [MAIN ] Update Progress: 1129/2372 symbols completed. ISD took 25.9s. Estimated remaining: 2h 44m 53s. Rate: 7.5 symbols/min [2025-09-19T19:29:50.255437] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-19T19:29:50.410961] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:50.453140] [DEBUG] [LOCAL ] ITT: Loaded 33669 existing records from primary storage. [2025-09-19T19:29:50.453324] [INFO ] [MAIN ] ITT: Loaded 33669 existing records. [2025-09-19T19:29:50.636371] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:50.636676] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-19T19:29:50.636745] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-19T19:29:50.637735] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-19T19:29:50.637798] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-19T19:29:51.011430] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:51.043220] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-19T19:29:51.095329] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T19:29:51.843271] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-19T19:29:52.268310] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T19:29:52.407416] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T19:29:52.643269] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-19T19:29:53.435389] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T19:29:53.443214] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-19T19:29:54.190610] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T19:29:54.245796] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-19T19:29:55.043302] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-19T19:29:55.183951] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T19:29:55.843263] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-19T19:29:55.875071] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T19:29:56.643276] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-19T19:29:56.959013] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T19:29:57.443277] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-19T19:29:57.630525] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T19:29:57.744637] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T19:29:58.243275] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-19T19:29:59.043244] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-19T19:29:59.095078] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:29:59.663827] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T19:29:59.843274] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-19T19:30:00.643242] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-19T19:30:00.736993] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:30:01.443412] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-19T19:30:01.749711] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:30:01.757532] [INFO ] [REMOTE ] IRT: Full fetch complete (72294 records). [2025-09-19T19:30:01.757740] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-19T19:30:02.190857] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-19T19:30:02.190972] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-19T19:30:02.192019] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-19T19:30:02.192085] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-19T19:30:02.193718] [DEBUG] [LOCAL ] IRT: Trimmed 72294 records to 51127 (keeping 200 days of data) [2025-09-19T19:30:02.248325] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-19T19:30:02.517539] [DEBUG] [LOCAL ] IRT: Primary data saved (51127 records). [2025-09-19T19:30:02.517718] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-19T19:30:02.517829] [INFO ] [MAIN ] Update Progress: 1130/2372 symbols completed. IRT took 43.7s. Estimated remaining: 2h 44m 50s. Rate: 7.5 symbols/min [2025-09-19T19:30:02.685526] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:02.685749] [DEBUG] [LOCAL ] ITUB: No existing data file found in primary storage. [2025-09-19T19:30:02.685804] [WARN ] [MAIN ] ITUB: No existing data found, performing full refresh instead. [2025-09-19T19:30:02.685945] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-19T19:30:02.685988] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-19T19:30:02.686027] [DEBUG] [LOCAL ] ITUB: No primary data file found to delete. [2025-09-19T19:30:02.686058] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-19T19:30:03.050853] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:03.051288] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-19T19:30:03.082233] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T19:30:03.843358] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-19T19:30:04.387512] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-19T19:30:04.643472] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-19T19:30:05.833036] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (3.58 seconds). [2025-09-19T19:30:05.841950] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-19T19:30:06.469876] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:30:06.475587] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-19T19:30:06.569759] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (3.52 seconds). [2025-09-19T19:30:06.613845] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-19T19:30:07.043350] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-19T19:30:07.662126] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:30:07.843327] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-19T19:30:07.872198] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T19:30:07.877356] [INFO ] [REMOTE ] ITGR: Full fetch complete (41133 records). [2025-09-19T19:30:07.877467] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-19T19:30:08.283662] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-19T19:30:08.283757] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-19T19:30:08.284429] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-19T19:30:08.284469] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-19T19:30:08.285427] [DEBUG] [LOCAL ] ITGR: Trimmed 41133 records to 32189 (keeping 200 days of data) [2025-09-19T19:30:08.494627] [DEBUG] [LOCAL ] ITGR: Primary data saved (32189 records). [2025-09-19T19:30:08.494812] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-19T19:30:08.494933] [INFO ] [MAIN ] Update Progress: 1131/2372 symbols completed. ITGR took 29.1s. Estimated remaining: 2h 44m 40s. Rate: 7.5 symbols/min [2025-09-19T19:30:08.658249] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-19T19:30:08.693328] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:08.696770] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T19:30:08.752252] [DEBUG] [LOCAL ] ITW: Loaded 46843 existing records from primary storage. [2025-09-19T19:30:08.752437] [INFO ] [MAIN ] ITW: Loaded 46843 existing records. [2025-09-19T19:30:08.951824] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:08.952323] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-19T19:30:08.952387] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-19T19:30:08.953602] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-19T19:30:08.953693] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-19T19:30:09.344432] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:09.443279] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-19T19:30:09.922133] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T19:30:10.243345] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-19T19:30:10.737376] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T19:30:11.043283] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-19T19:30:11.304721] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:30:11.778029] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:30:11.785277] [INFO ] [REMOTE ] IT: Full fetch complete (54871 records). [2025-09-19T19:30:11.785530] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-19T19:30:11.850729] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-19T19:30:12.211446] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-19T19:30:12.211614] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-19T19:30:12.212894] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-19T19:30:12.212968] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-19T19:30:12.214301] [DEBUG] [LOCAL ] IT: Trimmed 54871 records to 41777 (keeping 200 days of data) [2025-09-19T19:30:12.475452] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T19:30:12.504092] [DEBUG] [LOCAL ] IT: Primary data saved (41777 records). [2025-09-19T19:30:12.504241] [INFO ] [MAIN ] IT: Full history saved. [2025-09-19T19:30:12.504330] [INFO ] [MAIN ] Update Progress: 1132/2372 symbols completed. IT took 37.2s. Estimated remaining: 2h 44m 28s. Rate: 7.5 symbols/min [2025-09-19T19:30:12.649760] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-19T19:30:12.686180] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:12.734070] [DEBUG] [LOCAL ] IVR: Loaded 48089 existing records from primary storage. [2025-09-19T19:30:12.734283] [INFO ] [MAIN ] IVR: Loaded 48089 existing records. [2025-09-19T19:30:12.922346] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:12.922591] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-19T19:30:12.922660] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-19T19:30:12.923945] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-19T19:30:12.924006] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-19T19:30:13.279675] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:13.353378] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T19:30:13.443227] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-19T19:30:14.243266] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-19T19:30:14.794800] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T19:30:15.043279] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-19T19:30:15.843304] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-19T19:30:16.326844] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-09-19T19:30:16.643257] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-19T19:30:17.300776] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-09-19T19:30:17.443292] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-19T19:30:17.587410] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T19:30:18.113469] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T19:30:18.243232] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-19T19:30:18.996796] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T19:30:19.043220] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-19T19:30:19.713591] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:30:19.843260] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-19T19:30:20.201673] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (5.16 seconds). [2025-09-19T19:30:20.205926] [INFO ] [REMOTE ] ITT: Full fetch complete (46494 records). [2025-09-19T19:30:20.206035] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-19T19:30:20.206605] [FATAL] [VALIDATOR ] ITT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T19:30:20.206715] [FATAL] [MAIN ] ITT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:30:20.206758] [WARN ] [MAIN ] ITT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:30:20.206824] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-19T19:30:20.206890] [DEBUG] [LOCAL ] ITT: No primary data file found to delete. [2025-09-19T19:30:20.206925] [INFO ] [LOCAL ] ITT: Starting deletion of derivative data. [2025-09-19T19:30:20.207405] [DEBUG] [LOCAL ] ITT: Deleted derivative data file. [2025-09-19T19:30:20.207502] [INFO ] [MAIN ] Update Progress: 1133/2372 symbols completed. ITT took 30.0s. Estimated remaining: 2h 44m 19s. Rate: 7.5 symbols/min [2025-09-19T19:30:20.379055] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:20.414289] [DEBUG] [LOCAL ] IVT: Loaded 31317 existing records from primary storage. [2025-09-19T19:30:20.414433] [INFO ] [MAIN ] IVT: Loaded 31317 existing records. [2025-09-19T19:30:20.626903] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:20.627160] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-19T19:30:20.627207] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-19T19:30:20.628115] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-19T19:30:20.628175] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-19T19:30:20.659687] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-19T19:30:20.985399] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:21.038050] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:30:21.443266] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-19T19:30:22.126586] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T19:30:22.243231] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-19T19:30:22.759912] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T19:30:23.043263] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-19T19:30:23.089516] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T19:30:23.843276] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-19T19:30:24.359728] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T19:30:24.643273] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-19T19:30:25.361403] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T19:30:25.453300] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-19T19:30:25.458839] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-19T19:30:26.139879] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T19:30:26.243231] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-19T19:30:27.043271] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-19T19:30:27.370246] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:30:27.843314] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-19T19:30:28.181716] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T19:30:28.562497] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T19:30:28.643216] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-19T19:30:29.320484] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T19:30:29.443228] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-19T19:30:30.243347] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-19T19:30:30.306830] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T19:30:30.315224] [INFO ] [REMOTE ] ITUB: Full fetch complete (77166 records). [2025-09-19T19:30:30.315451] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-19T19:30:30.718696] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-19T19:30:30.718797] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-19T19:30:30.719864] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-19T19:30:30.719945] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-19T19:30:30.722068] [DEBUG] [LOCAL ] ITUB: Trimmed 77166 records to 54074 (keeping 200 days of data) [2025-09-19T19:30:30.952569] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T19:30:31.049683] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-19T19:30:31.078391] [DEBUG] [LOCAL ] ITUB: Primary data saved (54074 records). [2025-09-19T19:30:31.078539] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-19T19:30:31.078720] [INFO ] [MAIN ] Update Progress: 1134/2372 symbols completed. ITUB took 28.6s. Estimated remaining: 2h 44m 15s. Rate: 7.5 symbols/min [2025-09-19T19:30:31.247975] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:31.306745] [DEBUG] [LOCAL ] IVZ: Loaded 53534 existing records from primary storage. [2025-09-19T19:30:31.306890] [INFO ] [MAIN ] IVZ: Loaded 53534 existing records. [2025-09-19T19:30:31.482782] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:31.483036] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-19T19:30:31.483090] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-19T19:30:31.485199] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-19T19:30:31.485268] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-19T19:30:31.840778] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:31.843230] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-19T19:30:32.064340] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T19:30:32.174599] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T19:30:32.643255] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-19T19:30:33.443255] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-19T19:30:33.885445] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T19:30:34.243250] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-19T19:30:34.775633] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T19:30:35.043264] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-19T19:30:35.397850] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T19:30:35.843231] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-19T19:30:35.975769] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:30:36.477855] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T19:30:36.643252] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-19T19:30:37.443295] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-19T19:30:37.709167] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T19:30:38.243272] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-19T19:30:38.507261] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:30:38.851639] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T19:30:39.043279] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-19T19:30:39.843273] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-19T19:30:40.075724] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T19:30:40.083462] [INFO ] [REMOTE ] ITW: Full fetch complete (66628 records). [2025-09-19T19:30:40.083663] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-19T19:30:40.507820] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-19T19:30:40.508555] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-19T19:30:40.510543] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-19T19:30:40.510686] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-19T19:30:40.509481] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T19:30:40.519324] [DEBUG] [LOCAL ] ITW: Trimmed 66628 records to 47147 (keeping 200 days of data) [2025-09-19T19:30:40.644030] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-19T19:30:40.837539] [DEBUG] [LOCAL ] ITW: Primary data saved (47147 records). [2025-09-19T19:30:40.837722] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-19T19:30:40.839255] [INFO ] [MAIN ] Update Progress: 1135/2372 symbols completed. ITW took 32.3s. Estimated remaining: 2h 44m 9s. Rate: 7.5 symbols/min [2025-09-19T19:30:41.015214] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:41.046613] [DEBUG] [LOCAL ] IX: Loaded 23003 existing records from primary storage. [2025-09-19T19:30:41.046784] [INFO ] [MAIN ] IX: Loaded 23003 existing records. [2025-09-19T19:30:41.229211] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:41.229488] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-19T19:30:41.229537] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-19T19:30:41.230192] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-19T19:30:41.230271] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-19T19:30:41.448781] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-19T19:30:41.600349] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:41.723089] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:30:42.243269] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-19T19:30:42.731385] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T19:30:43.044863] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-19T19:30:43.054787] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T19:30:43.067843] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T19:30:43.843271] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-19T19:30:44.643249] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-19T19:30:45.212448] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T19:30:45.443265] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-19T19:30:45.521965] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T19:30:45.876345] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:30:45.932357] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T19:30:46.243293] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-19T19:30:47.043273] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-19T19:30:47.843293] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-19T19:30:48.196412] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:30:48.309466] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:30:48.643345] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-19T19:30:49.376686] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:30:49.381894] [INFO ] [REMOTE ] IVT: Full fetch complete (45589 records). [2025-09-19T19:30:49.382001] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-19T19:30:49.450445] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-19T19:30:49.774319] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-19T19:30:49.774397] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-19T19:30:49.775114] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-19T19:30:49.775175] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-19T19:30:49.776501] [DEBUG] [LOCAL ] IVT: Trimmed 45589 records to 31539 (keeping 200 days of data) [2025-09-19T19:30:49.974824] [DEBUG] [LOCAL ] IVT: Primary data saved (31539 records). [2025-09-19T19:30:49.974959] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-19T19:30:49.975041] [INFO ] [MAIN ] Update Progress: 1136/2372 symbols completed. IVT took 29.8s. Estimated remaining: 2h 44m 2s. Rate: 7.5 symbols/min [2025-09-19T19:30:50.144129] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:50.194435] [DEBUG] [LOCAL ] J: Loaded 40914 existing records from primary storage. [2025-09-19T19:30:50.194597] [INFO ] [MAIN ] J: Loaded 40914 existing records. [2025-09-19T19:30:50.258448] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-19T19:30:50.374619] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:50.374893] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-19T19:30:50.374940] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-19T19:30:50.375918] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-19T19:30:50.375977] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-19T19:30:50.726093] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:50.873899] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T19:30:50.880922] [INFO ] [REMOTE ] IVR: Full fetch complete (68908 records). [2025-09-19T19:30:50.881036] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-19T19:30:51.053350] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-19T19:30:51.273297] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-19T19:30:51.273383] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-19T19:30:51.274287] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-19T19:30:51.274350] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-19T19:30:51.276692] [DEBUG] [LOCAL ] IVR: Trimmed 68908 records to 48461 (keeping 200 days of data) [2025-09-19T19:30:51.568283] [DEBUG] [LOCAL ] IVR: Primary data saved (48461 records). [2025-09-19T19:30:51.568572] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-19T19:30:51.568707] [INFO ] [MAIN ] Update Progress: 1137/2372 symbols completed. IVR took 39.1s. Estimated remaining: 2h 43m 47s. Rate: 7.5 symbols/min [2025-09-19T19:30:51.745106] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:51.760709] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T19:30:51.804417] [DEBUG] [LOCAL ] JBGS: Loaded 42727 existing records from primary storage. [2025-09-19T19:30:51.804690] [INFO ] [MAIN ] JBGS: Loaded 42727 existing records. [2025-09-19T19:30:51.847677] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-19T19:30:52.023572] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:52.025583] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-19T19:30:52.036533] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-19T19:30:52.036874] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-19T19:30:52.037947] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-19T19:30:52.038010] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-19T19:30:52.399117] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:52.643301] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-19T19:30:52.908165] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T19:30:53.443324] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-19T19:30:53.474221] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T19:30:54.243288] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-19T19:30:54.311026] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T19:30:55.043235] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-19T19:30:55.357421] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T19:30:55.428776] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:30:55.843270] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-19T19:30:56.643298] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-19T19:30:56.708925] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:30:57.443232] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-19T19:30:57.615299] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:30:57.969984] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:30:58.243285] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-19T19:30:59.038572] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T19:30:59.046009] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-19T19:30:59.843220] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-19T19:30:59.989197] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:31:00.372677] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:31:00.643304] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-19T19:31:01.443366] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-19T19:31:01.731744] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T19:31:02.241143] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T19:31:02.251485] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-19T19:31:02.748828] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T19:31:03.043315] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-19T19:31:03.414247] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T19:31:03.843324] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-19T19:31:04.643343] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-19T19:31:04.914731] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:31:05.443291] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-19T19:31:05.887716] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T19:31:05.900034] [INFO ] [REMOTE ] IVZ: Full fetch complete (76716 records). [2025-09-19T19:31:05.900284] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-19T19:31:06.248415] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-19T19:31:06.337115] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-19T19:31:06.337229] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-19T19:31:06.338271] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-19T19:31:06.338347] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-19T19:31:06.340014] [DEBUG] [LOCAL ] IVZ: Trimmed 76716 records to 53923 (keeping 200 days of data) [2025-09-19T19:31:06.631097] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:31:06.763054] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T19:31:06.791070] [DEBUG] [LOCAL ] IVZ: Primary data saved (53923 records). [2025-09-19T19:31:06.791278] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-19T19:31:06.791382] [INFO ] [MAIN ] Update Progress: 1138/2372 symbols completed. IVZ took 35.7s. Estimated remaining: 2h 43m 47s. Rate: 7.5 symbols/min [2025-09-19T19:31:06.972463] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:07.019744] [DEBUG] [LOCAL ] JBI: Loaded 44548 existing records from primary storage. [2025-09-19T19:31:07.019922] [INFO ] [MAIN ] JBI: Loaded 44548 existing records. [2025-09-19T19:31:07.053421] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-19T19:31:07.224135] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:07.224445] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-19T19:31:07.224496] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-19T19:31:07.225755] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-19T19:31:07.225817] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-19T19:31:07.643721] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:07.843270] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-19T19:31:08.266263] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T19:31:08.269991] [INFO ] [REMOTE ] IX: Full fetch complete (26640 records). [2025-09-19T19:31:08.270116] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-19T19:31:08.647859] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-19T19:31:08.648453] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-19T19:31:08.649290] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-19T19:31:08.649900] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-19T19:31:08.649964] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-19T19:31:08.650786] [DEBUG] [LOCAL ] IX: Trimmed 26640 records to 23105 (keeping 200 days of data) [2025-09-19T19:31:08.791247] [DEBUG] [LOCAL ] IX: Primary data saved (23105 records). [2025-09-19T19:31:08.791440] [INFO ] [MAIN ] IX: Full history saved. [2025-09-19T19:31:08.791677] [INFO ] [MAIN ] Update Progress: 1139/2372 symbols completed. IX took 28.0s. Estimated remaining: 2h 43m 33s. Rate: 7.5 symbols/min [2025-09-19T19:31:08.971102] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:09.003878] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:31:09.050120] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:31:09.094018] [DEBUG] [LOCAL ] JBL: Loaded 48738 existing records from primary storage. [2025-09-19T19:31:09.094192] [INFO ] [MAIN ] JBL: Loaded 48738 existing records. [2025-09-19T19:31:09.279174] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:09.279458] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-19T19:31:09.279508] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-19T19:31:09.280783] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-19T19:31:09.280846] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-19T19:31:09.456593] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-19T19:31:09.645225] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:10.243274] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-19T19:31:10.634310] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T19:31:11.043262] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-19T19:31:11.315627] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:31:11.843285] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-19T19:31:12.117004] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T19:31:12.643265] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-19T19:31:12.821483] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T19:31:13.443276] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-19T19:31:13.714066] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T19:31:14.243267] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-19T19:31:14.300194] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:31:15.043280] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-19T19:31:15.136066] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:31:15.843306] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-19T19:31:16.563087] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T19:31:16.643259] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-19T19:31:17.040662] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T19:31:17.443263] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-19T19:31:17.598205] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:31:18.102615] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T19:31:18.243250] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-19T19:31:19.043263] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-19T19:31:19.411690] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:31:19.843262] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-19T19:31:20.321611] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:31:20.401578] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T19:31:20.408203] [INFO ] [REMOTE ] JBGS: Full fetch complete (58894 records). [2025-09-19T19:31:20.408366] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-19T19:31:20.650190] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-19T19:31:20.813481] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-19T19:31:20.813584] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-19T19:31:20.814421] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-19T19:31:20.814500] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-19T19:31:20.815971] [DEBUG] [LOCAL ] JBGS: Trimmed 58894 records to 43083 (keeping 200 days of data) [2025-09-19T19:31:21.103520] [DEBUG] [LOCAL ] JBGS: Primary data saved (43083 records). [2025-09-19T19:31:21.103724] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-19T19:31:21.103831] [INFO ] [MAIN ] Update Progress: 1140/2372 symbols completed. JBGS took 29.5s. Estimated remaining: 2h 43m 29s. Rate: 7.5 symbols/min [2025-09-19T19:31:21.285036] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:21.310565] [DEBUG] [LOCAL ] JBND: Loaded 25327 existing records from primary storage. [2025-09-19T19:31:21.310732] [INFO ] [MAIN ] JBND: Loaded 25327 existing records. [2025-09-19T19:31:21.452217] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-19T19:31:21.498521] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:21.498869] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-19T19:31:21.498955] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-19T19:31:21.499620] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-19T19:31:21.499709] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-19T19:31:21.882768] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:21.906859] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T19:31:22.148046] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T19:31:22.243266] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-19T19:31:23.043287] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-19T19:31:23.170415] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T19:31:23.843284] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-19T19:31:24.028997] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T19:31:24.345411] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T19:31:24.643248] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-19T19:31:25.075739] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T19:31:25.443273] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-19T19:31:26.207862] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:31:26.243219] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-19T19:31:27.043272] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-19T19:31:27.187680] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:31:27.194022] [INFO ] [REMOTE ] J: Full fetch complete (59233 records). [2025-09-19T19:31:27.194160] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-19T19:31:27.633037] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-19T19:31:27.641590] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-19T19:31:27.648031] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-19T19:31:27.648115] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-19T19:31:27.659547] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T19:31:27.668500] [DEBUG] [LOCAL ] J: Trimmed 59233 records to 41236 (keeping 200 days of data) [2025-09-19T19:31:27.855204] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-19T19:31:27.937098] [DEBUG] [LOCAL ] J: Primary data saved (41236 records). [2025-09-19T19:31:27.937227] [INFO ] [MAIN ] J: Full history saved. [2025-09-19T19:31:27.937307] [INFO ] [MAIN ] Update Progress: 1141/2372 symbols completed. J took 38.0s. Estimated remaining: 2h 43m 20s. Rate: 7.5 symbols/min [2025-09-19T19:31:28.103904] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:28.104087] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-19T19:31:28.104125] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-19T19:31:28.104266] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-19T19:31:28.104321] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-19T19:31:28.104387] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-19T19:31:28.104421] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-19T19:31:28.456992] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:28.643270] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-19T19:31:28.871984] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T19:31:28.882451] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:28.883541] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-19T19:31:29.443314] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-19T19:31:29.498913] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T19:31:29.504765] [INFO ] [REMOTE ] JBI: Full fetch complete (64719 records). [2025-09-19T19:31:29.504912] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-19T19:31:29.896832] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-19T19:31:29.896940] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-19T19:31:29.897803] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-19T19:31:29.897866] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-19T19:31:29.899279] [DEBUG] [LOCAL ] JBI: Trimmed 64719 records to 44819 (keeping 200 days of data) [2025-09-19T19:31:30.152047] [DEBUG] [LOCAL ] JBI: Primary data saved (44819 records). [2025-09-19T19:31:30.152186] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-19T19:31:30.152286] [INFO ] [MAIN ] Update Progress: 1142/2372 symbols completed. JBI took 23.4s. Estimated remaining: 2h 43m 6s. Rate: 7.5 symbols/min [2025-09-19T19:31:30.249954] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-19T19:31:30.328272] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:30.328451] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-19T19:31:30.328489] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-19T19:31:30.328682] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-19T19:31:30.328736] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-19T19:31:30.328778] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-19T19:31:30.328811] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-19T19:31:30.596824] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:30.608919] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-19T19:31:30.689764] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:30.700060] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T19:31:31.043280] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-19T19:31:31.290492] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:31.290981] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-19T19:31:31.843263] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-19T19:31:32.086936] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:32.087289] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-19T19:31:32.643262] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-19T19:31:32.872081] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:32.872498] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-19T19:31:33.443283] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-19T19:31:34.243277] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-19T19:31:34.481570] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:34.481936] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-19T19:31:34.925223] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T19:31:35.043273] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-19T19:31:35.843268] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-19T19:31:36.074593] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:36.074989] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-19T19:31:36.643275] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-19T19:31:36.663058] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:31:37.443315] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-19T19:31:38.243294] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-19T19:31:38.676143] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:31:38.754457] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:31:39.043274] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-19T19:31:39.348517] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T19:31:39.843297] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-19T19:31:40.643324] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-19T19:31:41.087436] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:31:41.443301] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-19T19:31:41.870436] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:31:41.956515] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T19:31:42.243313] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-19T19:31:43.043303] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-19T19:31:43.359997] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T19:31:43.558027] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T19:31:43.843293] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-19T19:31:44.643306] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-19T19:31:45.036589] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T19:31:45.118974] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T19:31:45.443311] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-19T19:31:46.248383] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-19T19:31:46.260156] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T19:31:46.268042] [INFO ] [REMOTE ] JBL: Full fetch complete (69818 records). [2025-09-19T19:31:46.268213] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-19T19:31:46.672709] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-19T19:31:46.672804] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-19T19:31:46.673835] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-19T19:31:46.673903] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-19T19:31:46.675406] [DEBUG] [LOCAL ] JBL: Trimmed 69818 records to 49097 (keeping 200 days of data) [2025-09-19T19:31:46.796885] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T19:31:47.019152] [DEBUG] [LOCAL ] JBL: Primary data saved (49097 records). [2025-09-19T19:31:47.019315] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-19T19:31:47.019909] [INFO ] [MAIN ] Update Progress: 1143/2372 symbols completed. JBL took 38.2s. Estimated remaining: 2h 43m 8s. Rate: 7.5 symbols/min [2025-09-19T19:31:47.051005] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-19T19:31:47.203104] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:47.212925] [DEBUG] [LOCAL ] JCE: Loaded 6445 existing records from primary storage. [2025-09-19T19:31:47.213048] [INFO ] [MAIN ] JCE: Loaded 6445 existing records. [2025-09-19T19:31:47.398919] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:47.399180] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-19T19:31:47.399242] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-19T19:31:47.399777] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-19T19:31:47.399845] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-19T19:31:47.781493] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:47.843218] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-19T19:31:48.374257] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T19:31:48.381797] [INFO ] [REMOTE ] JBS: Full fetch complete (25599 records). [2025-09-19T19:31:48.381883] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-19T19:31:48.582408] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-19T19:31:48.583022] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:31:48.596950] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:31:48.597444] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T19:31:48.603090] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-19T19:31:48.603536] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-19T19:31:48.603598] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-19T19:31:48.603730] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-19T19:31:48.603803] [INFO ] [MAIN ] Update Progress: 1144/2372 symbols completed. JBS took 20.7s. Estimated remaining: 2h 42m 53s. Rate: 7.5 symbols/min [2025-09-19T19:31:48.648527] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-19T19:31:48.732476] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T19:31:48.799213] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:48.853486] [DEBUG] [LOCAL ] JCI: Loaded 53940 existing records from primary storage. [2025-09-19T19:31:48.853677] [INFO ] [MAIN ] JCI: Loaded 53940 existing records. [2025-09-19T19:31:49.035871] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:49.036157] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-19T19:31:49.036240] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-19T19:31:49.037816] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-19T19:31:49.037876] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-19T19:31:49.395699] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:49.443212] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-19T19:31:49.990345] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:31:50.243301] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-19T19:31:51.043331] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-19T19:31:51.585367] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T19:31:51.657463] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T19:31:51.843281] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-19T19:31:52.643291] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-19T19:31:52.665593] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T19:31:53.443298] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-19T19:31:53.481528] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T19:31:53.862823] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T19:31:54.243269] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-19T19:31:55.043269] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-19T19:31:55.151771] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:31:55.671903] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T19:31:55.843370] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-19T19:31:56.643337] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-19T19:31:56.881115] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T19:31:56.945146] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T19:31:56.950558] [INFO ] [REMOTE ] JBND: Full fetch complete (33007 records). [2025-09-19T19:31:56.950716] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-19T19:31:57.426808] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-19T19:31:57.426892] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-19T19:31:57.427568] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-19T19:31:57.427610] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-19T19:31:57.428520] [DEBUG] [LOCAL ] JBND: Trimmed 33007 records to 25580 (keeping 200 days of data) [2025-09-19T19:31:57.481185] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-19T19:31:57.593409] [DEBUG] [LOCAL ] JBND: Primary data saved (25580 records). [2025-09-19T19:31:57.593573] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-19T19:31:57.593716] [INFO ] [MAIN ] Update Progress: 1145/2372 symbols completed. JBND took 36.5s. Estimated remaining: 2h 42m 46s. Rate: 7.5 symbols/min [2025-09-19T19:31:57.779303] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:57.827682] [DEBUG] [LOCAL ] JEF: Loaded 50392 existing records from primary storage. [2025-09-19T19:31:57.827864] [INFO ] [MAIN ] JEF: Loaded 50392 existing records. [2025-09-19T19:31:58.020336] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:58.020610] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-19T19:31:58.020693] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-19T19:31:58.022408] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-19T19:31:58.022472] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-19T19:31:58.274204] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-19T19:31:58.243760] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-19T19:31:58.427797] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:58.450401] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T19:31:59.043300] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-19T19:31:59.843304] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-19T19:32:00.321009] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:32:00.621738] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T19:32:00.643261] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-19T19:32:00.947846] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:32:01.443282] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-19T19:32:01.593357] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T19:32:02.243262] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-19T19:32:03.043303] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-19T19:32:03.585953] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T19:32:03.732065] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:32:03.843263] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-19T19:32:04.643297] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-19T19:32:04.989596] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T19:32:05.306763] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T19:32:05.312448] [INFO ] [REMOTE ] JBTM: Full fetch complete (41333 records). [2025-09-19T19:32:05.312567] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-19T19:32:05.428932] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T19:32:05.446351] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-19T19:32:05.538600] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T19:32:05.539269] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:32:05.539371] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:32:05.539474] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-19T19:32:05.539665] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-19T19:32:05.539745] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-19T19:32:05.539863] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-19T19:32:05.540001] [INFO ] [MAIN ] Update Progress: 1146/2372 symbols completed. JBTM took 35.4s. Estimated remaining: 2h 42m 38s. Rate: 7.5 symbols/min [2025-09-19T19:32:05.715503] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:05.758797] [DEBUG] [LOCAL ] JELD: Loaded 46566 existing records from primary storage. [2025-09-19T19:32:05.758939] [INFO ] [MAIN ] JELD: Loaded 46566 existing records. [2025-09-19T19:32:05.936279] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:05.936612] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-19T19:32:05.936717] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-19T19:32:05.937750] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-19T19:32:05.937815] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-19T19:32:06.256704] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-19T19:32:06.299054] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:07.043321] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-19T19:32:07.143489] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:32:07.245186] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:32:07.843261] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-19T19:32:08.648336] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-19T19:32:08.662025] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:32:09.443261] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-19T19:32:09.808925] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:32:10.243266] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-19T19:32:10.354947] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T19:32:10.712476] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T19:32:11.043269] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-19T19:32:11.297692] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T19:32:11.774888] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T19:32:11.843245] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-19T19:32:12.643293] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-19T19:32:13.443264] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-19T19:32:13.675527] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T19:32:13.678318] [INFO ] [REMOTE ] JCE: Full fetch complete (9022 records). [2025-09-19T19:32:13.678432] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-19T19:32:14.155494] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T19:32:14.156035] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-19T19:32:14.167579] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-19T19:32:14.167944] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-19T19:32:14.168031] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-19T19:32:14.169552] [DEBUG] [LOCAL ] JCE: Trimmed 9022 records to 6521 (keeping 200 days of data) [2025-09-19T19:32:14.210220] [DEBUG] [LOCAL ] JCE: Primary data saved (6521 records). [2025-09-19T19:32:14.210359] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-19T19:32:14.210471] [INFO ] [MAIN ] Update Progress: 1147/2372 symbols completed. JCE took 27.2s. Estimated remaining: 2h 42m 31s. Rate: 7.5 symbols/min [2025-09-19T19:32:14.253132] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-19T19:32:14.385829] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:14.396321] [DEBUG] [LOCAL ] JEQ: Loaded 9046 existing records from primary storage. [2025-09-19T19:32:14.396427] [INFO ] [MAIN ] JEQ: Loaded 9046 existing records. [2025-09-19T19:32:14.575092] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:14.575410] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-19T19:32:14.575465] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-19T19:32:14.575886] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-19T19:32:14.575946] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-19T19:32:14.929782] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:15.043257] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-19T19:32:15.088190] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T19:32:15.743558] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T19:32:15.813516] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T19:32:15.843230] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-19T19:32:16.643279] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-19T19:32:16.762476] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T19:32:17.443262] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-19T19:32:18.243265] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-19T19:32:18.930604] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-19T19:32:18.948721] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T19:32:19.043199] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-19T19:32:19.353476] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T19:32:19.843283] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-19T19:32:20.643266] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-19T19:32:20.876223] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T19:32:21.000761] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T19:32:21.443280] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-19T19:32:22.243272] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-19T19:32:22.404752] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T19:32:22.593273] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T19:32:23.043268] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-19T19:32:23.843276] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-19T19:32:23.881906] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T19:32:23.939860] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T19:32:24.643275] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-19T19:32:25.372500] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T19:32:25.443226] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-19T19:32:25.647381] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T19:32:26.243408] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-19T19:32:26.245013] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T19:32:27.043317] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-19T19:32:27.843265] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-19T19:32:28.033112] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T19:32:28.084057] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:32:28.643307] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-19T19:32:29.443292] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-19T19:32:29.558873] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T19:32:29.560718] [INFO ] [REMOTE ] JEQ: Full fetch complete (11374 records). [2025-09-19T19:32:29.560803] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-19T19:32:29.946821] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-19T19:32:29.946996] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-19T19:32:29.947277] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-19T19:32:29.947319] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-19T19:32:29.947913] [DEBUG] [LOCAL ] JEQ: Trimmed 11374 records to 9163 (keeping 200 days of data) [2025-09-19T19:32:30.018004] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T19:32:30.029265] [INFO ] [REMOTE ] JEF: Full fetch complete (72782 records). [2025-09-19T19:32:30.030065] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-19T19:32:30.193941] [DEBUG] [LOCAL ] JEQ: Primary data saved (9163 records). [2025-09-19T19:32:30.206302] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-19T19:32:30.210775] [INFO ] [MAIN ] Update Progress: 1148/2372 symbols completed. JEQ took 16.0s. Estimated remaining: 2h 42m 31s. Rate: 7.5 symbols/min [2025-09-19T19:32:30.250558] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-19T19:32:30.647980] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:30.648226] [DEBUG] [LOCAL ] JFR: No existing data file found in primary storage. [2025-09-19T19:32:30.648331] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-19T19:32:30.648405] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-19T19:32:30.648466] [WARN ] [MAIN ] JFR: No existing data found, performing full refresh instead. [2025-09-19T19:32:30.649745] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-19T19:32:30.648720] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-19T19:32:30.649858] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-19T19:32:30.649901] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-19T19:32:30.650112] [DEBUG] [LOCAL ] JFR: No primary data file found to delete. [2025-09-19T19:32:30.650174] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-19T19:32:30.756733] [DEBUG] [LOCAL ] JEF: Trimmed 72782 records to 50767 (keeping 200 days of data) [2025-09-19T19:32:31.151661] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:31.152867] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-19T19:32:31.381723] [DEBUG] [LOCAL ] JEF: Primary data saved (50767 records). [2025-09-19T19:32:31.381865] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-19T19:32:31.381954] [INFO ] [MAIN ] Update Progress: 1149/2372 symbols completed. JEF took 33.8s. Estimated remaining: 2h 42m 16s. Rate: 7.5 symbols/min [2025-09-19T19:32:31.608094] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:31.610537] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T19:32:31.639157] [DEBUG] [LOCAL ] JGH: Loaded 11091 existing records from primary storage. [2025-09-19T19:32:31.639296] [INFO ] [MAIN ] JGH: Loaded 11091 existing records. [2025-09-19T19:32:31.838603] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:31.838891] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-19T19:32:31.838948] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-19T19:32:31.839387] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-19T19:32:31.839448] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-19T19:32:31.874723] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-19T19:32:32.211428] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:32.558532] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T19:32:32.643257] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-19T19:32:32.866554] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:32:33.443252] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-19T19:32:33.529862] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T19:32:33.538088] [INFO ] [REMOTE ] JCI: Full fetch complete (77405 records). [2025-09-19T19:32:33.538249] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-19T19:32:33.942001] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-19T19:32:33.942112] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-19T19:32:33.943148] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-19T19:32:33.943235] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-19T19:32:33.944954] [DEBUG] [LOCAL ] JCI: Trimmed 77405 records to 54330 (keeping 200 days of data) [2025-09-19T19:32:34.244810] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-19T19:32:34.292330] [DEBUG] [LOCAL ] JCI: Primary data saved (54330 records). [2025-09-19T19:32:34.297565] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-19T19:32:34.298015] [INFO ] [MAIN ] Update Progress: 1150/2372 symbols completed. JCI took 45.7s. Estimated remaining: 2h 42m 3s. Rate: 7.5 symbols/min [2025-09-19T19:32:34.504315] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T19:32:34.525002] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T19:32:34.529326] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:34.601910] [DEBUG] [LOCAL ] JHG: Loaded 48523 existing records from primary storage. [2025-09-19T19:32:34.602099] [INFO ] [MAIN ] JHG: Loaded 48523 existing records. [2025-09-19T19:32:34.796457] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:34.796757] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-19T19:32:34.796816] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-19T19:32:34.798290] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-19T19:32:34.798365] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-19T19:32:35.048485] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-19T19:32:35.186209] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:35.843290] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-19T19:32:35.869181] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T19:32:35.968776] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T19:32:36.643272] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-19T19:32:37.443313] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-19T19:32:37.655819] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T19:32:38.223087] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T19:32:38.243279] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-19T19:32:38.384158] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:32:39.043265] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-19T19:32:39.106040] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T19:32:39.843299] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-19T19:32:40.643273] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-19T19:32:40.724416] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T19:32:40.786076] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T19:32:41.443281] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-19T19:32:42.243267] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-19T19:32:42.417393] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:32:42.619325] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T19:32:43.043287] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-19T19:32:43.843317] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-19T19:32:43.915002] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T19:32:43.982171] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T19:32:44.643275] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-19T19:32:45.443349] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-19T19:32:45.974377] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T19:32:46.243267] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-19T19:32:46.472800] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:32:46.572744] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T19:32:47.043285] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-19T19:32:47.843338] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-19T19:32:48.211918] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:32:48.508440] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:32:48.643318] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-19T19:32:49.443289] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-19T19:32:49.857927] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T19:32:49.867630] [INFO ] [REMOTE ] JELD: Full fetch complete (63316 records). [2025-09-19T19:32:49.867858] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-19T19:32:50.247521] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-19T19:32:50.272253] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-19T19:32:50.272344] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-19T19:32:50.273538] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-19T19:32:50.273658] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-19T19:32:50.276323] [DEBUG] [LOCAL ] JELD: Trimmed 63316 records to 46906 (keeping 200 days of data) [2025-09-19T19:32:50.580631] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T19:32:50.601569] [DEBUG] [LOCAL ] JELD: Primary data saved (46906 records). [2025-09-19T19:32:50.601713] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-19T19:32:50.601913] [INFO ] [MAIN ] Update Progress: 1151/2372 symbols completed. JELD took 45.1s. Estimated remaining: 2h 42m 4s. Rate: 7.5 symbols/min [2025-09-19T19:32:50.777240] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:50.785097] [DEBUG] [LOCAL ] JHI: Loaded 3809 existing records from primary storage. [2025-09-19T19:32:50.785205] [INFO ] [MAIN ] JHI: Loaded 3809 existing records. [2025-09-19T19:32:50.968881] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:50.969411] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-19T19:32:50.969563] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-19T19:32:50.975594] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-19T19:32:50.987420] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-19T19:32:50.988300] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T19:32:51.052753] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-19T19:32:51.388845] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T19:32:51.400505] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:51.843335] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-19T19:32:52.523567] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-19T19:32:52.643333] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-19T19:32:53.058684] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T19:32:53.443280] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-19T19:32:54.108749] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:32:54.175538] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T19:32:54.243226] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-19T19:32:55.043295] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-19T19:32:55.730115] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:32:55.843288] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-19T19:32:56.643239] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-19T19:32:56.747277] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T19:32:56.782993] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T19:32:57.443287] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-19T19:32:58.110714] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T19:32:58.123251] [INFO ] [REMOTE ] JFR: Full fetch complete (47936 records). [2025-09-19T19:32:58.123684] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-19T19:32:58.248354] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-19T19:32:58.549260] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-19T19:32:58.549357] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-19T19:32:58.550132] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-19T19:32:58.550196] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-19T19:32:58.551358] [DEBUG] [LOCAL ] JFR: Trimmed 47936 records to 31079 (keeping 200 days of data) [2025-09-19T19:32:58.760834] [DEBUG] [LOCAL ] JFR: Primary data saved (31079 records). [2025-09-19T19:32:58.760984] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-19T19:32:58.761069] [INFO ] [MAIN ] Update Progress: 1152/2372 symbols completed. JFR took 28.5s. Estimated remaining: 2h 41m 56s. Rate: 7.5 symbols/min [2025-09-19T19:32:58.941839] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:58.947673] [DEBUG] [LOCAL ] JHS: Loaded 2939 existing records from primary storage. [2025-09-19T19:32:58.947833] [INFO ] [MAIN ] JHS: Loaded 2939 existing records. [2025-09-19T19:32:59.048772] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-19T19:32:59.104046] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T19:32:59.143945] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:59.146273] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-19T19:32:59.146360] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-19T19:32:59.146794] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-19T19:32:59.146879] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-19T19:32:59.623753] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:59.670447] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T19:32:59.843304] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-19T19:33:00.111409] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T19:33:00.619499] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T19:33:00.643221] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-19T19:33:01.320244] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T19:33:01.443294] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-19T19:33:02.243274] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-19T19:33:02.978962] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:33:02.981494] [INFO ] [REMOTE ] JGH: Full fetch complete (14738 records). [2025-09-19T19:33:02.981566] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-19T19:33:03.048418] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-19T19:33:03.359081] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-19T19:33:03.359407] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-19T19:33:03.359831] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-19T19:33:03.359893] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-19T19:33:03.361130] [DEBUG] [LOCAL ] JGH: Trimmed 14738 records to 11148 (keeping 200 days of data) [2025-09-19T19:33:03.441256] [DEBUG] [LOCAL ] JGH: Primary data saved (11148 records). [2025-09-19T19:33:03.441401] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-19T19:33:03.441503] [INFO ] [MAIN ] Update Progress: 1153/2372 symbols completed. JGH took 32.1s. Estimated remaining: 2h 41m 45s. Rate: 7.5 symbols/min [2025-09-19T19:33:03.618243] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:03.675131] [DEBUG] [LOCAL ] JHX: Loaded 49336 existing records from primary storage. [2025-09-19T19:33:03.675277] [INFO ] [MAIN ] JHX: Loaded 49336 existing records. [2025-09-19T19:33:03.782695] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T19:33:03.857979] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-19T19:33:03.864511] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:03.864833] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-19T19:33:03.864884] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-19T19:33:03.867105] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-19T19:33:03.867176] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-19T19:33:04.223270] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:04.643271] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-19T19:33:04.787197] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T19:33:05.443241] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-19T19:33:05.677073] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T19:33:05.981018] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-09-19T19:33:06.126845] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T19:33:06.243277] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-19T19:33:06.968727] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T19:33:07.043264] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-19T19:33:07.813282] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-19T19:33:07.814759] [INFO ] [REMOTE ] JHI: Full fetch complete (5302 records). [2025-09-19T19:33:07.814829] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-19T19:33:07.848434] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-19T19:33:08.197748] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-19T19:33:08.197868] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-19T19:33:08.198055] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-19T19:33:08.198098] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-19T19:33:08.198474] [DEBUG] [LOCAL ] JHI: Trimmed 5302 records to 3819 (keeping 200 days of data) [2025-09-19T19:33:08.223127] [DEBUG] [LOCAL ] JHI: Primary data saved (3819 records). [2025-09-19T19:33:08.223265] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-19T19:33:08.223370] [INFO ] [MAIN ] Update Progress: 1154/2372 symbols completed. JHI took 17.6s. Estimated remaining: 2h 41m 33s. Rate: 7.5 symbols/min [2025-09-19T19:33:08.407327] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:08.426912] [DEBUG] [LOCAL ] JILL: Loaded 16786 existing records from primary storage. [2025-09-19T19:33:08.427029] [INFO ] [MAIN ] JILL: Loaded 16786 existing records. [2025-09-19T19:33:08.610972] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:08.611504] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-19T19:33:08.611610] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-19T19:33:08.615637] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-19T19:33:08.615826] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-19T19:33:08.648952] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T19:33:08.648489] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-19T19:33:08.994998] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:09.443267] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-19T19:33:10.243255] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-19T19:33:10.596689] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:33:10.643071] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:33:10.651547] [INFO ] [REMOTE ] JHG: Full fetch complete (68584 records). [2025-09-19T19:33:10.651707] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-19T19:33:10.861021] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T19:33:11.048384] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-19T19:33:11.095198] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-19T19:33:11.095282] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-19T19:33:11.096208] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-19T19:33:11.096281] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-19T19:33:11.097711] [DEBUG] [LOCAL ] JHG: Trimmed 68584 records to 48849 (keeping 200 days of data) [2025-09-19T19:33:11.411543] [DEBUG] [LOCAL ] JHG: Primary data saved (48849 records). [2025-09-19T19:33:11.411716] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-19T19:33:11.411837] [INFO ] [MAIN ] Update Progress: 1155/2372 symbols completed. JHG took 37.1s. Estimated remaining: 2h 41m 20s. Rate: 7.5 symbols/min [2025-09-19T19:33:11.579255] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:11.624862] [DEBUG] [LOCAL ] JKS: Loaded 40528 existing records from primary storage. [2025-09-19T19:33:11.625028] [INFO ] [MAIN ] JKS: Loaded 40528 existing records. [2025-09-19T19:33:11.810086] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:11.810400] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-19T19:33:11.810482] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-19T19:33:11.811745] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-19T19:33:11.811803] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-19T19:33:11.848395] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-19T19:33:12.178621] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:12.187100] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T19:33:12.643235] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-19T19:33:12.922410] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T19:33:13.443270] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-19T19:33:13.672441] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T19:33:14.134809] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T19:33:14.243250] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-19T19:33:15.043268] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-19T19:33:15.843265] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-19T19:33:16.430585] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T19:33:16.452485] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T19:33:16.643261] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-19T19:33:17.335784] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:33:17.336544] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T19:33:17.443277] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-19T19:33:18.243303] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-19T19:33:19.043325] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-19T19:33:19.439305] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T19:33:19.482053] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T19:33:19.698321] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T19:33:19.843289] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-19T19:33:20.643330] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-19T19:33:21.336578] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T19:33:21.443263] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-19T19:33:21.515461] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T19:33:21.983557] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-19T19:33:22.243268] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-19T19:33:23.043257] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-19T19:33:23.078122] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T19:33:23.079534] [INFO ] [REMOTE ] JHS: Full fetch complete (4469 records). [2025-09-19T19:33:23.079612] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-19T19:33:23.438708] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-19T19:33:23.438799] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-19T19:33:23.438952] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-19T19:33:23.438989] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-19T19:33:23.439365] [DEBUG] [LOCAL ] JHS: Trimmed 4469 records to 2951 (keeping 200 days of data) [2025-09-19T19:33:23.457863] [DEBUG] [LOCAL ] JHS: Primary data saved (2951 records). [2025-09-19T19:33:23.457969] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-19T19:33:23.458051] [INFO ] [MAIN ] Update Progress: 1156/2372 symbols completed. JHS took 24.7s. Estimated remaining: 2h 41m 17s. Rate: 7.5 symbols/min [2025-09-19T19:33:23.633099] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:23.670223] [DEBUG] [LOCAL ] JLL: Loaded 32581 existing records from primary storage. [2025-09-19T19:33:23.670363] [INFO ] [MAIN ] JLL: Loaded 32581 existing records. [2025-09-19T19:33:23.847215] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-19T19:33:23.847380] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:23.847715] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-19T19:33:23.848677] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-19T19:33:23.849408] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-19T19:33:23.849508] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-19T19:33:24.203095] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:24.643265] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-19T19:33:25.105902] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T19:33:25.443274] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-19T19:33:26.089639] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T19:33:26.243287] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-19T19:33:26.333847] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-19T19:33:26.885865] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T19:33:27.043237] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-19T19:33:27.843275] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-19T19:33:28.475305] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T19:33:28.503113] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T19:33:28.643270] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-19T19:33:29.443304] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-19T19:33:29.579545] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:33:29.950860] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:33:30.243263] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-19T19:33:31.048987] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-19T19:33:31.061802] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:33:31.085561] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T19:33:31.843280] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-19T19:33:32.643293] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-19T19:33:33.105715] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T19:33:33.325570] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T19:33:33.342371] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:33:33.443251] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-19T19:33:34.243324] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-19T19:33:35.043238] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-19T19:33:35.150347] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T19:33:35.843271] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-19T19:33:36.197060] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:33:36.643319] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-19T19:33:37.058691] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T19:33:37.443362] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-19T19:33:37.764584] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:33:38.243285] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-19T19:33:38.723805] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:33:38.731675] [INFO ] [REMOTE ] JHX: Full fetch complete (56062 records). [2025-09-19T19:33:38.731802] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-19T19:33:39.048339] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-19T19:33:39.118195] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-19T19:33:39.118435] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-19T19:33:39.119271] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-19T19:33:39.119334] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-19T19:33:39.120629] [DEBUG] [LOCAL ] JHX: Trimmed 56062 records to 49724 (keeping 200 days of data) [2025-09-19T19:33:39.373024] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T19:33:39.465993] [DEBUG] [LOCAL ] JHX: Primary data saved (49724 records). [2025-09-19T19:33:39.466159] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-19T19:33:39.466253] [INFO ] [MAIN ] Update Progress: 1157/2372 symbols completed. JHX took 36.0s. Estimated remaining: 2h 41m 17s. Rate: 7.5 symbols/min [2025-09-19T19:33:39.788465] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T19:33:39.843265] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-19T19:33:40.217339] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:33:40.643272] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-19T19:33:41.450149] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-19T19:33:41.452880] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T19:33:41.755480] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T19:33:41.758728] [INFO ] [REMOTE ] JILL: Full fetch complete (23118 records). [2025-09-19T19:33:41.758820] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-19T19:33:42.146945] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-19T19:33:42.147080] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-19T19:33:42.147596] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-19T19:33:42.147638] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-19T19:33:42.148418] [DEBUG] [LOCAL ] JILL: Trimmed 23118 records to 16934 (keeping 200 days of data) [2025-09-19T19:33:42.244153] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-19T19:33:42.254806] [DEBUG] [LOCAL ] JILL: Primary data saved (16934 records). [2025-09-19T19:33:42.254905] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-19T19:33:42.254989] [INFO ] [MAIN ] Update Progress: 1158/2372 symbols completed. JILL took 34.0s. Estimated remaining: 2h 41m 4s. Rate: 7.5 symbols/min [2025-09-19T19:33:43.143221] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:33:43.154518] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-19T19:33:43.943545] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:33:43.951415] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-19T19:33:44.904158] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T19:33:44.915775] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-19T19:33:45.495288] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:33:45.501051] [INFO ] [REMOTE ] JLL: Full fetch complete (44857 records). [2025-09-19T19:33:45.501164] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-19T19:33:45.897521] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-19T19:33:45.897624] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-19T19:33:45.898401] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-19T19:33:45.898459] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-19T19:33:45.899712] [DEBUG] [LOCAL ] JLL: Trimmed 44857 records to 32790 (keeping 200 days of data) [2025-09-19T19:33:46.109365] [DEBUG] [LOCAL ] JLL: Primary data saved (32790 records). [2025-09-19T19:33:46.109553] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-19T19:33:46.109681] [INFO ] [MAIN ] Update Progress: 1159/2372 symbols completed. JLL took 22.7s. Estimated remaining: 2h 40m 52s. Rate: 7.5 symbols/min [2025-09-19T19:33:47.211977] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T19:33:47.221203] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-19T19:33:48.921333] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:33:48.929617] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-19T19:33:50.776609] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T19:33:50.782855] [INFO ] [REMOTE ] JKS: Full fetch complete (59701 records). [2025-09-19T19:33:50.782963] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-19T19:33:51.169608] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-19T19:33:51.169725] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-19T19:33:51.170550] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-19T19:33:51.170593] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-19T19:33:51.172015] [DEBUG] [LOCAL ] JKS: Trimmed 59701 records to 40779 (keeping 200 days of data) [2025-09-19T19:33:51.421352] [DEBUG] [LOCAL ] JKS: Primary data saved (40779 records). [2025-09-19T19:33:51.421553] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-19T19:33:51.421719] [INFO ] [MAIN ] Update Progress: 1160/2372 symbols completed. JKS took 40.0s. Estimated remaining: 2h 40m 41s. Rate: 7.5 symbols/min [2025-09-19T19:33:51.972529] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:52.060867] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-19T19:33:52.038861] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:52.071326] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-19T19:33:52.143561] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-19T19:33:52.147913] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:52.143476] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:52.148558] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-19T19:33:52.148930] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-19T19:33:52.149124] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-19T19:33:52.226693] [DEBUG] [LOCAL ] JLS: Loaded 4135 existing records from primary storage. [2025-09-19T19:33:52.248638] [INFO ] [MAIN ] JLS: Loaded 4135 existing records. [2025-09-19T19:33:52.454408] [DEBUG] [LOCAL ] JMIA: Loaded 50812 existing records from primary storage. [2025-09-19T19:33:52.498435] [INFO ] [MAIN ] JMIA: Loaded 50812 existing records. [2025-09-19T19:33:52.827241] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-09-19T19:33:52.890112] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-09-19T19:33:52.858768] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:52.926216] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-19T19:33:52.982023] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-19T19:33:53.044466] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:53.084894] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-19T19:33:53.077073] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-19T19:33:53.105461] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-19T19:33:53.101729] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:53.111619] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-19T19:33:53.154965] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-19T19:33:53.247158] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-19T19:33:53.283740] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-19T19:33:53.283627] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:53.338735] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-19T19:33:53.359939] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-19T19:33:53.425710] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-19T19:33:53.463921] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-19T19:33:54.180113] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T19:33:54.188736] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:54.222350] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-19T19:33:54.242605] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-19T19:33:54.283589] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:54.302776] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-19T19:33:54.420339] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:54.420671] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-19T19:33:54.723286] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T19:33:54.724267] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-19T19:33:55.211942] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:33:55.218193] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-19T19:33:55.218441] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-19T19:33:55.221106] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-19T19:33:55.619597] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T19:33:55.620665] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-19T19:33:55.919458] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T19:33:55.921059] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-19T19:33:56.140270] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-19T19:33:56.141452] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-19T19:33:56.717099] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T19:33:56.719441] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-19T19:33:56.755981] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T19:33:56.759267] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-19T19:33:56.761158] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-19T19:33:57.175755] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-19T19:33:57.443277] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-19T19:33:57.473539] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T19:33:57.557132] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T19:33:58.243272] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-19T19:33:58.850538] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T19:33:59.043266] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-19T19:33:59.625051] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T19:33:59.813525] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-19T19:33:59.843277] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-19T19:34:00.397530] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-19T19:34:00.398409] [INFO ] [REMOTE ] JMM: Full fetch complete (2299 records). [2025-09-19T19:34:00.398479] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-19T19:34:00.587601] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-19T19:34:00.587852] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:34:00.587922] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:34:00.588036] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-19T19:34:00.588115] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-19T19:34:00.588153] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-19T19:34:00.588193] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-19T19:34:00.588263] [INFO ] [MAIN ] Update Progress: 1161/2372 symbols completed. JMM took 9.2s. Estimated remaining: 2h 40m 34s. Rate: 7.5 symbols/min [2025-09-19T19:34:00.650580] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-19T19:34:00.766799] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:00.820924] [DEBUG] [LOCAL ] JOBY: Loaded 54188 existing records from primary storage. [2025-09-19T19:34:00.821099] [INFO ] [MAIN ] JOBY: Loaded 54188 existing records. [2025-09-19T19:34:01.001561] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:01.001874] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-19T19:34:01.001958] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-19T19:34:01.003601] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-19T19:34:01.003686] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-19T19:34:01.414857] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:01.443256] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-19T19:34:02.243322] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-19T19:34:03.043296] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-19T19:34:03.168435] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-19T19:34:03.230157] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T19:34:03.437209] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:34:03.843280] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-19T19:34:04.643269] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-19T19:34:05.380403] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:34:05.443264] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-19T19:34:05.911393] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T19:34:06.208849] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-09-19T19:34:06.243258] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-19T19:34:07.043284] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-19T19:34:07.720208] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T19:34:07.843283] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-19T19:34:08.081282] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-19T19:34:08.643275] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-19T19:34:08.977425] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-19T19:34:09.443272] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-19T19:34:10.103424] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T19:34:10.243297] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-19T19:34:10.859862] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-19T19:34:11.043268] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-19T19:34:11.166816] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-19T19:34:11.734324] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T19:34:11.843268] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-19T19:34:12.332449] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-09-19T19:34:12.643284] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-19T19:34:13.443276] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-19T19:34:14.171843] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T19:34:14.173428] [INFO ] [REMOTE ] JLS: Full fetch complete (5753 records). [2025-09-19T19:34:14.173506] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-19T19:34:14.248824] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-19T19:34:14.606516] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-19T19:34:14.620759] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-19T19:34:14.621128] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-19T19:34:14.622296] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-19T19:34:14.623815] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-19T19:34:14.625584] [DEBUG] [LOCAL ] JLS: Trimmed 5753 records to 4152 (keeping 200 days of data) [2025-09-19T19:34:14.708617] [DEBUG] [LOCAL ] JLS: Primary data saved (4152 records). [2025-09-19T19:34:14.709615] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-19T19:34:14.711323] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T19:34:14.711625] [INFO ] [MAIN ] Update Progress: 1162/2372 symbols completed. JLS took 23.3s. Estimated remaining: 2h 40m 33s. Rate: 7.5 symbols/min [2025-09-19T19:34:14.914985] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:14.945435] [DEBUG] [LOCAL ] JOE: Loaded 25031 existing records from primary storage. [2025-09-19T19:34:14.945712] [INFO ] [MAIN ] JOE: Loaded 25031 existing records. [2025-09-19T19:34:15.050353] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-19T19:34:15.148417] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:15.148779] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-19T19:34:15.148841] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-19T19:34:15.149763] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-19T19:34:15.149831] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-19T19:34:15.543747] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:15.843315] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-19T19:34:16.643274] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-19T19:34:17.118362] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-19T19:34:17.394613] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-19T19:34:17.443237] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-19T19:34:17.741853] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:34:18.243307] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-19T19:34:18.645514] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T19:34:19.043318] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-19T19:34:19.843298] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-19T19:34:20.190828] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-19T19:34:20.643333] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-19T19:34:20.869098] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-19T19:34:20.919836] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:34:20.988860] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T19:34:21.443273] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-19T19:34:22.243296] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-19T19:34:23.043280] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-19T19:34:23.457339] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-19T19:34:23.504618] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T19:34:23.556145] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T19:34:23.843307] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-19T19:34:24.643301] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-19T19:34:25.270130] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T19:34:25.306306] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T19:34:25.443310] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-19T19:34:26.243309] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-19T19:34:26.823104] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T19:34:27.043319] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-19T19:34:27.849145] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-19T19:34:27.851859] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T19:34:27.903497] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T19:34:27.911748] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-19T19:34:27.911909] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-19T19:34:28.322017] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-19T19:34:28.322118] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-19T19:34:28.323242] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-19T19:34:28.323323] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-19T19:34:28.325060] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54533 (keeping 200 days of data) [2025-09-19T19:34:28.649053] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-19T19:34:28.677786] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-09-19T19:34:28.677910] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-19T19:34:28.677990] [INFO ] [MAIN ] Update Progress: 1163/2372 symbols completed. JNJ took 37.3s. Estimated remaining: 2h 40m 31s. Rate: 7.5 symbols/min [2025-09-19T19:34:28.846068] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:28.854817] [DEBUG] [LOCAL ] JOF: Loaded 7219 existing records from primary storage. [2025-09-19T19:34:28.854920] [INFO ] [MAIN ] JOF: Loaded 7219 existing records. [2025-09-19T19:34:29.040444] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:29.040978] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-19T19:34:29.041037] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-19T19:34:29.041676] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-19T19:34:29.041777] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-19T19:34:29.434260] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:29.448359] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-19T19:34:29.461146] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-19T19:34:29.474563] [INFO ] [REMOTE ] JMIA: Full fetch complete (73210 records). [2025-09-19T19:34:29.474754] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-19T19:34:29.868760] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-19T19:34:29.868890] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-19T19:34:29.869938] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-19T19:34:29.870048] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-19T19:34:29.885765] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:34:29.885895] [DEBUG] [LOCAL ] JMIA: Trimmed 73210 records to 51198 (keeping 200 days of data) [2025-09-19T19:34:30.197764] [DEBUG] [LOCAL ] JMIA: Primary data saved (51198 records). [2025-09-19T19:34:30.197901] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-19T19:34:30.197989] [INFO ] [MAIN ] Update Progress: 1164/2372 symbols completed. JMIA took 38.8s. Estimated remaining: 2h 40m 16s. Rate: 7.5 symbols/min [2025-09-19T19:34:30.263578] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-19T19:34:30.377189] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:30.419054] [DEBUG] [LOCAL ] JPC: Loaded 37578 existing records from primary storage. [2025-09-19T19:34:30.419219] [INFO ] [MAIN ] JPC: Loaded 37578 existing records. [2025-09-19T19:34:30.577920] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T19:34:30.617871] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:30.618154] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-19T19:34:30.618303] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-19T19:34:30.629416] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-19T19:34:30.634683] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-19T19:34:30.717600] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-09-19T19:34:31.039504] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:31.043219] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-19T19:34:31.597618] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:34:31.843285] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-19T19:34:32.517139] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:34:32.643264] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-19T19:34:33.242082] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T19:34:33.412603] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T19:34:33.443218] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-19T19:34:34.243308] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-19T19:34:34.309184] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T19:34:35.043269] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-19T19:34:35.331426] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T19:34:35.843277] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-19T19:34:36.014764] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T19:34:36.643267] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-19T19:34:37.443315] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-19T19:34:38.165418] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T19:34:38.179930] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:34:38.243272] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-19T19:34:39.043228] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-19T19:34:39.216198] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-09-19T19:34:39.570929] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:34:39.574914] [INFO ] [REMOTE ] JOE: Full fetch complete (36431 records). [2025-09-19T19:34:39.575028] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-19T19:34:39.852845] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-19T19:34:39.980712] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-19T19:34:39.980848] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-19T19:34:39.981832] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-19T19:34:39.981929] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-19T19:34:39.983489] [DEBUG] [LOCAL ] JOE: Trimmed 36431 records to 25189 (keeping 200 days of data) [2025-09-19T19:34:40.140872] [DEBUG] [LOCAL ] JOE: Primary data saved (25189 records). [2025-09-19T19:34:40.141001] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-19T19:34:40.141084] [INFO ] [MAIN ] Update Progress: 1165/2372 symbols completed. JOE took 25.4s. Estimated remaining: 2h 40m 10s. Rate: 7.5 symbols/min [2025-09-19T19:34:40.311314] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:40.319026] [DEBUG] [LOCAL ] JPI: Loaded 5496 existing records from primary storage. [2025-09-19T19:34:40.319148] [INFO ] [MAIN ] JPI: Loaded 5496 existing records. [2025-09-19T19:34:40.517772] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:40.518020] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-19T19:34:40.518068] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-19T19:34:40.518418] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-19T19:34:40.518478] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-19T19:34:40.646830] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-19T19:34:40.901002] [INFO ] [REMOTE ] JPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:40.917499] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T19:34:41.443299] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-19T19:34:41.454200] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T19:34:42.243333] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-19T19:34:42.828755] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-19T19:34:42.997570] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:34:43.043227] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-19T19:34:43.166577] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T19:34:43.843300] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-19T19:34:43.919369] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T19:34:44.643298] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-12. [2025-09-19T19:34:45.443271] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-19T19:34:45.496954] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:34:45.566579] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T19:34:46.243278] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-19T19:34:47.043314] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-01. [2025-09-19T19:34:47.298005] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T19:34:47.299942] [INFO ] [REMOTE ] JOF: Full fetch complete (9465 records). [2025-09-19T19:34:47.300022] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-19T19:34:47.696608] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-19T19:34:47.696741] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-19T19:34:47.697002] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-19T19:34:47.697077] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-19T19:34:47.697898] [DEBUG] [LOCAL ] JOF: Trimmed 9465 records to 7259 (keeping 200 days of data) [2025-09-19T19:34:47.743625] [DEBUG] [LOCAL ] JOF: Primary data saved (7259 records). [2025-09-19T19:34:47.743812] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-19T19:34:47.743925] [INFO ] [MAIN ] Update Progress: 1166/2372 symbols completed. JOF took 19.1s. Estimated remaining: 2h 40m 2s. Rate: 7.5 symbols/min [2025-09-19T19:34:47.843751] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-19T19:34:47.899724] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T19:34:47.933979] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:47.991009] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-09-19T19:34:47.991160] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-09-19T19:34:48.167476] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:48.167783] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-19T19:34:48.167840] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-19T19:34:48.169716] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-19T19:34:48.169777] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-19T19:34:48.533477] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:48.557548] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (3.11 seconds). [2025-09-19T19:34:48.566984] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-19T19:34:48.567180] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-19T19:34:48.648372] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-19T19:34:48.976061] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-19T19:34:48.976154] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-19T19:34:48.977171] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-19T19:34:48.977238] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-19T19:34:48.978782] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54578 (keeping 200 days of data) [2025-09-19T19:34:49.308889] [DEBUG] [LOCAL ] JOBY: Primary data saved (54578 records). [2025-09-19T19:34:49.309046] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-19T19:34:49.310129] [INFO ] [MAIN ] Update Progress: 1167/2372 symbols completed. JOBY took 48.7s. Estimated remaining: 2h 39m 47s. Rate: 7.5 symbols/min [2025-09-19T19:34:49.443398] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-19T19:34:49.446315] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T19:34:49.504572] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:49.547579] [DEBUG] [LOCAL ] JQC: Loaded 34199 existing records from primary storage. [2025-09-19T19:34:49.547774] [INFO ] [MAIN ] JQC: Loaded 34199 existing records. [2025-09-19T19:34:49.750134] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:49.750563] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-19T19:34:49.750788] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-19T19:34:49.752024] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-19T19:34:49.752093] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-19T19:34:49.895696] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T19:34:50.160826] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:50.243219] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-19T19:34:51.043265] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-19T19:34:51.768635] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T19:34:51.843315] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-19T19:34:51.944858] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T19:34:52.410781] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.97 seconds). [2025-09-19T19:34:52.643263] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-19T19:34:53.448950] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-19T19:34:53.460836] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T19:34:54.243283] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-19T19:34:55.043291] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-19T19:34:55.091358] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T19:34:55.133797] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-19T19:34:55.843235] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-19T19:34:56.118863] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:34:56.162406] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T19:34:56.643261] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-19T19:34:57.443333] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-19T19:34:57.496397] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T19:34:58.243256] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-19T19:34:58.361755] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-19T19:34:58.895388] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T19:34:59.043271] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-19T19:34:59.843272] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-19T19:34:59.876693] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:35:00.643268] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-19T19:35:00.775145] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T19:35:01.343130] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T19:35:01.443281] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-19T19:35:02.164107] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T19:35:02.243309] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-19T19:35:02.610896] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-19T19:35:03.043301] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-19T19:35:03.843319] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-19T19:35:03.927710] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T19:35:03.953292] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T19:35:04.643275] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-19T19:35:05.443272] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-19T19:35:05.500176] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:35:05.502349] [INFO ] [REMOTE ] JPI: Full fetch complete (7875 records). [2025-09-19T19:35:05.502486] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-19T19:35:05.890878] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-19T19:35:05.891000] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-19T19:35:05.891299] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-19T19:35:05.891379] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-19T19:35:05.892035] [DEBUG] [LOCAL ] JPI: Trimmed 7875 records to 5528 (keeping 200 days of data) [2025-09-19T19:35:05.930558] [DEBUG] [LOCAL ] JPI: Primary data saved (5528 records). [2025-09-19T19:35:05.930709] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-19T19:35:05.930878] [INFO ] [MAIN ] Update Progress: 1168/2372 symbols completed. JPI took 25.8s. Estimated remaining: 2h 39m 48s. Rate: 7.5 symbols/min [2025-09-19T19:35:06.108993] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:06.130045] [DEBUG] [LOCAL ] JRI: Loaded 15258 existing records from primary storage. [2025-09-19T19:35:06.130207] [INFO ] [MAIN ] JRI: Loaded 15258 existing records. [2025-09-19T19:35:06.248419] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-19T19:35:06.315121] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:06.315415] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-19T19:35:06.315468] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-19T19:35:06.316147] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-19T19:35:06.316223] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-19T19:35:06.712491] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:06.821630] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-19T19:35:06.859423] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T19:35:07.043288] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-19T19:35:07.843262] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-19T19:35:08.000350] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T19:35:08.008985] [INFO ] [REMOTE ] JPC: Full fetch complete (55813 records). [2025-09-19T19:35:08.009228] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-19T19:35:08.493614] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-19T19:35:08.493761] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-19T19:35:08.494803] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-19T19:35:08.494877] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-19T19:35:08.499167] [DEBUG] [LOCAL ] JPC: Trimmed 55813 records to 37802 (keeping 200 days of data) [2025-09-19T19:35:08.648674] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-19T19:35:08.663874] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T19:35:08.800939] [DEBUG] [LOCAL ] JPC: Primary data saved (37802 records). [2025-09-19T19:35:08.801089] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-19T19:35:08.801192] [INFO ] [MAIN ] Update Progress: 1169/2372 symbols completed. JPC took 38.6s. Estimated remaining: 2h 39m 35s. Rate: 7.5 symbols/min [2025-09-19T19:35:08.976356] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:08.993665] [DEBUG] [LOCAL ] JRS: Loaded 11157 existing records from primary storage. [2025-09-19T19:35:08.994012] [INFO ] [MAIN ] JRS: Loaded 11157 existing records. [2025-09-19T19:35:09.183787] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:09.184216] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-19T19:35:09.184273] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-19T19:35:09.184920] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-19T19:35:09.184980] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-19T19:35:09.448357] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-19T19:35:09.538275] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:10.019940] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T19:35:10.243238] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-19T19:35:10.344680] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-19T19:35:10.372032] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T19:35:11.043288] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-19T19:35:11.092624] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T19:35:11.843272] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-19T19:35:12.643270] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-19T19:35:12.685324] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:35:13.036870] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T19:35:13.150105] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T19:35:13.443282] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-19T19:35:14.243275] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-19T19:35:14.620614] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T19:35:15.043288] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-19T19:35:15.843284] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-19T19:35:16.611616] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T19:35:16.643230] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-19T19:35:16.798305] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-19T19:35:16.816782] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T19:35:17.443296] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-19T19:35:17.763876] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T19:35:18.165898] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T19:35:18.243245] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-19T19:35:19.043295] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-19T19:35:19.190254] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:35:19.843300] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-19T19:35:20.643329] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-19T19:35:21.236882] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T19:35:21.242203] [INFO ] [REMOTE ] JQC: Full fetch complete (48658 records). [2025-09-19T19:35:21.242306] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-19T19:35:21.451416] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-19T19:35:21.667795] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-19T19:35:21.667961] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-19T19:35:21.669186] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-19T19:35:21.669355] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-19T19:35:21.679354] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T19:35:21.683533] [DEBUG] [LOCAL ] JQC: Trimmed 48658 records to 34392 (keeping 200 days of data) [2025-09-19T19:35:21.825614] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-19T19:35:21.961898] [DEBUG] [LOCAL ] JQC: Primary data saved (34392 records). [2025-09-19T19:35:21.962055] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-19T19:35:21.962208] [INFO ] [MAIN ] Update Progress: 1170/2372 symbols completed. JQC took 32.7s. Estimated remaining: 2h 39m 33s. Rate: 7.5 symbols/min [2025-09-19T19:35:22.132243] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:22.186804] [DEBUG] [LOCAL ] JXN: Loaded 46440 existing records from primary storage. [2025-09-19T19:35:22.186954] [INFO ] [MAIN ] JXN: Loaded 46440 existing records. [2025-09-19T19:35:22.249568] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-19T19:35:22.368033] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:22.368316] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-19T19:35:22.368365] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-19T19:35:22.369720] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-19T19:35:22.369780] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-19T19:35:22.732209] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:22.743591] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:35:23.043305] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-19T19:35:23.348373] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T19:35:23.843283] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-19T19:35:24.643306] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-19T19:35:25.423691] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T19:35:25.443215] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-19T19:35:25.521287] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T19:35:25.594418] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T19:35:26.243273] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-19T19:35:27.043374] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-19T19:35:27.386630] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T19:35:27.717118] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T19:35:27.727348] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-19T19:35:27.727534] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-19T19:35:27.843366] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-19T19:35:27.877934] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T19:35:27.904835] [INFO ] [REMOTE ] JRS: Full fetch complete (15992 records). [2025-09-19T19:35:27.930883] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-19T19:35:28.386978] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-19T19:35:28.421521] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-19T19:35:28.434856] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-19T19:35:28.453098] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-19T19:35:28.521441] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54574 (keeping 200 days of data) [2025-09-19T19:35:28.557058] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-19T19:35:28.557215] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-19T19:35:28.560404] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-19T19:35:28.560473] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-19T19:35:28.561350] [DEBUG] [LOCAL ] JRS: Trimmed 15992 records to 11214 (keeping 200 days of data) [2025-09-19T19:35:28.648720] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-19T19:35:28.729178] [DEBUG] [LOCAL ] JRS: Primary data saved (11214 records). [2025-09-19T19:35:28.731539] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-19T19:35:28.731705] [INFO ] [MAIN ] Update Progress: 1171/2372 symbols completed. JRS took 19.9s. Estimated remaining: 2h 39m 23s. Rate: 7.5 symbols/min [2025-09-19T19:35:28.918625] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:29.056131] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:35:29.101401] [DEBUG] [LOCAL ] K: Loaded 50133 existing records from primary storage. [2025-09-19T19:35:29.102546] [INFO ] [MAIN ] K: Loaded 50133 existing records. [2025-09-19T19:35:29.323251] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:29.325730] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-19T19:35:29.327190] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-19T19:35:29.329409] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-19T19:35:29.329505] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-19T19:35:29.450191] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-19T19:35:29.818481] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:29.826685] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-09-19T19:35:29.826794] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-19T19:35:29.826895] [INFO ] [MAIN ] Update Progress: 1172/2372 symbols completed. JPM took 42.1s. Estimated remaining: 2h 39m 8s. Rate: 7.5 symbols/min [2025-09-19T19:35:29.993630] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:30.011284] [DEBUG] [LOCAL ] KAI: Loaded 13769 existing records from primary storage. [2025-09-19T19:35:30.011422] [INFO ] [MAIN ] KAI: Loaded 13769 existing records. [2025-09-19T19:35:30.196476] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:30.197120] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-19T19:35:30.197399] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-19T19:35:30.198187] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-19T19:35:30.198332] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-19T19:35:30.250721] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-19T19:35:30.319383] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:35:30.601271] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:30.610521] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T19:35:31.043306] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-19T19:35:31.843267] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-19T19:35:32.356585] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T19:35:32.594285] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T19:35:32.643228] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-19T19:35:33.443245] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-19T19:35:33.526442] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:35:34.125188] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T19:35:34.243253] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-19T19:35:34.353946] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T19:35:35.043265] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-19T19:35:35.843304] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-19T19:35:36.044137] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:35:36.643294] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-19T19:35:37.042099] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T19:35:37.224337] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T19:35:37.443274] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-19T19:35:38.243231] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-19T19:35:38.356185] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T19:35:39.043273] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-19T19:35:39.389283] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:35:39.449219] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T19:35:39.843266] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-19T19:35:40.643271] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-19T19:35:40.775903] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T19:35:41.149988] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T19:35:41.443284] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-19T19:35:41.884234] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:35:42.243286] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-19T19:35:43.043272] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-19T19:35:43.391677] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T19:35:43.843261] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-19T19:35:44.077409] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T19:35:44.322867] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T19:35:44.563372] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T19:35:44.567009] [INFO ] [REMOTE ] JRI: Full fetch complete (23146 records). [2025-09-19T19:35:44.567098] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-19T19:35:44.648360] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-19T19:35:44.944549] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-19T19:35:44.944685] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-19T19:35:44.945216] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-19T19:35:44.945269] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-19T19:35:44.946057] [DEBUG] [LOCAL ] JRI: Trimmed 23146 records to 15354 (keeping 200 days of data) [2025-09-19T19:35:45.046696] [DEBUG] [LOCAL ] JRI: Primary data saved (15354 records). [2025-09-19T19:35:45.046838] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-19T19:35:45.046929] [INFO ] [MAIN ] Update Progress: 1173/2372 symbols completed. JRI took 39.1s. Estimated remaining: 2h 39m 8s. Rate: 7.5 symbols/min [2025-09-19T19:35:45.213547] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:45.262739] [DEBUG] [LOCAL ] KAR: Loaded 40396 existing records from primary storage. [2025-09-19T19:35:45.262961] [INFO ] [MAIN ] KAR: Loaded 40396 existing records. [2025-09-19T19:35:45.449627] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:45.445947] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-19T19:35:45.450699] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-19T19:35:45.450770] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-19T19:35:45.451826] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-19T19:35:45.451886] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-19T19:35:45.811209] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:46.243267] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-19T19:35:46.577944] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T19:35:46.812938] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:35:47.043314] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-19T19:35:47.843282] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-19T19:35:47.988387] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:35:48.175080] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:35:48.643298] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-19T19:35:49.235372] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:35:49.443278] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-19T19:35:50.229788] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T19:35:50.244351] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-19T19:35:50.361796] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T19:35:51.043287] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-19T19:35:51.843296] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-19T19:35:52.178252] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T19:35:52.643245] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-19T19:35:52.882198] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:35:52.930411] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T19:35:53.443299] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-19T19:35:54.146428] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T19:35:54.153743] [INFO ] [REMOTE ] JXN: Full fetch complete (65303 records). [2025-09-19T19:35:54.153922] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-19T19:35:54.249981] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-19T19:35:54.540320] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-19T19:35:54.540426] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-19T19:35:54.541291] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-19T19:35:54.541353] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-19T19:35:54.542683] [DEBUG] [LOCAL ] JXN: Trimmed 65303 records to 46816 (keeping 200 days of data) [2025-09-19T19:35:54.765621] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T19:35:54.843978] [DEBUG] [LOCAL ] JXN: Primary data saved (46816 records). [2025-09-19T19:35:54.844123] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-19T19:35:54.844604] [INFO ] [MAIN ] Update Progress: 1174/2372 symbols completed. JXN took 32.9s. Estimated remaining: 2h 39m 2s. Rate: 7.5 symbols/min [2025-09-19T19:35:55.010622] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:55.034993] [DEBUG] [LOCAL ] KB: Loaded 24589 existing records from primary storage. [2025-09-19T19:35:55.035123] [INFO ] [MAIN ] KB: Loaded 24589 existing records. [2025-09-19T19:35:55.048388] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-19T19:35:55.214823] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:55.215076] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-19T19:35:55.215132] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-19T19:35:55.215819] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-19T19:35:55.215879] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-19T19:35:55.570581] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:55.843302] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-19T19:35:55.971863] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T19:35:56.110847] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T19:35:56.643279] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-19T19:35:57.443288] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-19T19:35:57.636171] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T19:35:57.643793] [INFO ] [REMOTE ] K: Full fetch complete (71809 records). [2025-09-19T19:35:57.643918] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-19T19:35:58.061610] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-19T19:35:58.061875] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-19T19:35:58.062961] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-19T19:35:58.063136] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-19T19:35:58.087992] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T19:35:58.096435] [DEBUG] [LOCAL ] K: Trimmed 71809 records to 50518 (keeping 200 days of data) [2025-09-19T19:35:58.278593] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-19T19:35:58.416338] [DEBUG] [LOCAL ] K: Primary data saved (50518 records). [2025-09-19T19:35:58.416497] [INFO ] [MAIN ] K: Full history saved. [2025-09-19T19:35:58.416588] [INFO ] [MAIN ] Update Progress: 1175/2372 symbols completed. K took 29.7s. Estimated remaining: 2h 38m 49s. Rate: 7.5 symbols/min [2025-09-19T19:35:58.586954] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:58.610306] [DEBUG] [LOCAL ] KBDC: Loaded 20772 existing records from primary storage. [2025-09-19T19:35:58.610474] [INFO ] [MAIN ] KBDC: Loaded 20772 existing records. [2025-09-19T19:35:58.799580] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:58.799955] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-19T19:35:58.800023] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-19T19:35:58.800709] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-19T19:35:58.800772] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-19T19:35:59.058954] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-19T19:35:59.164526] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:59.181060] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T19:35:59.843251] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-19T19:35:59.946128] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T19:36:00.238416] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T19:36:00.240732] [INFO ] [REMOTE ] KAI: Full fetch complete (18745 records). [2025-09-19T19:36:00.240805] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-19T19:36:00.603721] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-19T19:36:00.603806] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-19T19:36:00.604191] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-19T19:36:00.604234] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-19T19:36:00.604816] [DEBUG] [LOCAL ] KAI: Trimmed 18745 records to 13884 (keeping 200 days of data) [2025-09-19T19:36:00.648300] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-19T19:36:00.694165] [DEBUG] [LOCAL ] KAI: Primary data saved (13884 records). [2025-09-19T19:36:00.694272] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-19T19:36:00.694351] [INFO ] [MAIN ] Update Progress: 1176/2372 symbols completed. KAI took 30.9s. Estimated remaining: 2h 38m 36s. Rate: 7.5 symbols/min [2025-09-19T19:36:00.875638] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:00.931578] [DEBUG] [LOCAL ] KBH: Loaded 49212 existing records from primary storage. [2025-09-19T19:36:00.931813] [INFO ] [MAIN ] KBH: Loaded 49212 existing records. [2025-09-19T19:36:01.090522] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:36:01.140147] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:01.140450] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-19T19:36:01.140500] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-19T19:36:01.141858] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-19T19:36:01.141920] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-19T19:36:01.448453] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-19T19:36:01.511739] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:02.039202] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T19:36:02.243280] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-19T19:36:03.043294] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-19T19:36:03.843279] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-19T19:36:04.066635] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-19T19:36:04.643251] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-19T19:36:05.045428] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T19:36:05.181179] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:36:05.443283] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-19T19:36:05.711568] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (3.47 seconds). [2025-09-19T19:36:05.990400] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T19:36:06.243278] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-19T19:36:07.043229] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-19T19:36:07.137187] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:36:07.593854] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:36:07.845379] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-19T19:36:07.849776] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T19:36:08.643262] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-19T19:36:09.443281] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-19T19:36:09.667684] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:36:10.045568] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T19:36:10.243257] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-19T19:36:11.043297] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-19T19:36:11.294318] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T19:36:11.843280] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-19T19:36:11.889997] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T19:36:12.643268] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-19T19:36:12.791543] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:36:12.880427] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T19:36:13.443268] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-19T19:36:14.243296] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-19T19:36:14.355900] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:36:15.043308] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-19T19:36:15.364101] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:36:15.843284] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-19T19:36:16.643322] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-19T19:36:17.469433] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (3.23 seconds). [2025-09-19T19:36:17.477086] [INFO ] [REMOTE ] KAR: Full fetch complete (56605 records). [2025-09-19T19:36:17.487022] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-19T19:36:17.487963] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:36:17.524546] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-19T19:36:17.889697] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-19T19:36:17.889815] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-19T19:36:17.890754] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-19T19:36:17.890876] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-19T19:36:17.892530] [DEBUG] [LOCAL ] KAR: Trimmed 56605 records to 40650 (keeping 200 days of data) [2025-09-19T19:36:18.002377] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (2.96 seconds). [2025-09-19T19:36:18.168271] [DEBUG] [LOCAL ] KAR: Primary data saved (40650 records). [2025-09-19T19:36:18.168406] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-19T19:36:18.168490] [INFO ] [MAIN ] Update Progress: 1177/2372 symbols completed. KAR took 33.1s. Estimated remaining: 2h 38m 37s. Rate: 7.5 symbols/min [2025-09-19T19:36:18.247229] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-19T19:36:18.325400] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T19:36:18.379456] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:18.396405] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T19:36:18.448388] [DEBUG] [LOCAL ] KBR: Loaded 48678 existing records from primary storage. [2025-09-19T19:36:18.448565] [INFO ] [MAIN ] KBR: Loaded 48678 existing records. [2025-09-19T19:36:18.634379] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:18.634703] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-19T19:36:18.634761] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-19T19:36:18.636238] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-19T19:36:18.636300] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-19T19:36:19.001414] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:19.043222] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-19T19:36:19.843263] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-19T19:36:20.307519] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T19:36:20.497948] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T19:36:20.643229] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-19T19:36:21.120354] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T19:36:21.443260] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-19T19:36:22.243263] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-19T19:36:22.559200] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T19:36:23.052137] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-19T19:36:23.053288] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T19:36:23.059285] [INFO ] [REMOTE ] KBDC: Full fetch complete (27587 records). [2025-09-19T19:36:23.059378] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-19T19:36:23.433840] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-19T19:36:23.433918] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-19T19:36:23.434413] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-19T19:36:23.434452] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-19T19:36:23.435190] [DEBUG] [LOCAL ] KBDC: Trimmed 27587 records to 20999 (keeping 200 days of data) [2025-09-19T19:36:23.558911] [DEBUG] [LOCAL ] KBDC: Primary data saved (20999 records). [2025-09-19T19:36:23.559048] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-19T19:36:23.559188] [INFO ] [MAIN ] Update Progress: 1178/2372 symbols completed. KBDC took 25.1s. Estimated remaining: 2h 38m 27s. Rate: 7.5 symbols/min [2025-09-19T19:36:23.733950] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:23.785321] [DEBUG] [LOCAL ] KD: Loaded 52684 existing records from primary storage. [2025-09-19T19:36:23.785474] [INFO ] [MAIN ] KD: Loaded 52684 existing records. [2025-09-19T19:36:23.853070] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-19T19:36:23.972308] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:23.972836] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-19T19:36:23.972894] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-19T19:36:23.974500] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-19T19:36:23.974578] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-19T19:36:24.169604] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:36:24.435984] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:24.643219] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-19T19:36:24.988973] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T19:36:25.187557] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T19:36:25.443278] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-19T19:36:26.243262] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-19T19:36:27.043300] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-19T19:36:27.115818] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T19:36:27.119110] [INFO ] [REMOTE ] KB: Full fetch complete (34880 records). [2025-09-19T19:36:27.119231] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-19T19:36:27.525503] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-19T19:36:27.525670] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-19T19:36:27.526541] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-19T19:36:27.526707] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-19T19:36:27.527910] [DEBUG] [LOCAL ] KB: Trimmed 34880 records to 24706 (keeping 200 days of data) [2025-09-19T19:36:27.650796] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-09-19T19:36:27.729815] [DEBUG] [LOCAL ] KB: Primary data saved (24706 records). [2025-09-19T19:36:27.729981] [INFO ] [MAIN ] KB: Full history saved. [2025-09-19T19:36:27.730085] [INFO ] [MAIN ] Update Progress: 1179/2372 symbols completed. KB took 32.9s. Estimated remaining: 2h 38m 15s. Rate: 7.5 symbols/min [2025-09-19T19:36:27.848347] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-19T19:36:27.907588] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:27.914612] [DEBUG] [LOCAL ] KEN: Loaded 4756 existing records from primary storage. [2025-09-19T19:36:27.914781] [INFO ] [MAIN ] KEN: Loaded 4756 existing records. [2025-09-19T19:36:28.105513] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:28.105803] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-19T19:36:28.105891] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-19T19:36:28.106214] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-19T19:36:28.106274] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-19T19:36:28.485710] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:28.522957] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T19:36:28.643224] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-19T19:36:28.975262] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T19:36:29.443290] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-19T19:36:29.676064] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T19:36:29.874185] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T19:36:30.243306] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-19T19:36:31.043264] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-19T19:36:31.394217] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T19:36:31.695430] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T19:36:31.843270] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-19T19:36:32.423019] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T19:36:32.643266] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-19T19:36:32.985716] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-19T19:36:33.443287] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-19T19:36:34.011263] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T19:36:34.243230] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-19T19:36:34.267940] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T19:36:35.043280] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-19T19:36:35.843233] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-19T19:36:36.277072] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T19:36:36.310136] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T19:36:36.643276] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-19T19:36:37.099475] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T19:36:37.443269] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-19T19:36:37.892017] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:36:38.153262] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T19:36:38.243302] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-19T19:36:39.043279] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-19T19:36:39.843276] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-19T19:36:40.275741] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T19:36:40.643321] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-19T19:36:40.987349] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:36:41.016404] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T19:36:41.443326] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-19T19:36:42.244332] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-19T19:36:42.248947] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T19:36:42.661128] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T19:36:43.043281] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-19T19:36:43.843278] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-19T19:36:44.089270] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:36:44.096816] [INFO ] [REMOTE ] KBH: Full fetch complete (70406 records). [2025-09-19T19:36:44.096959] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-19T19:36:44.488492] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-19T19:36:44.488658] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-19T19:36:44.489584] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-19T19:36:44.489629] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-19T19:36:44.491145] [DEBUG] [LOCAL ] KBH: Trimmed 70406 records to 49581 (keeping 200 days of data) [2025-09-19T19:36:44.671044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-19T19:36:44.807903] [DEBUG] [LOCAL ] KBH: Primary data saved (49581 records). [2025-09-19T19:36:44.808044] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-19T19:36:44.808128] [INFO ] [MAIN ] Update Progress: 1180/2372 symbols completed. KBH took 44.1s. Estimated remaining: 2h 38m 16s. Rate: 7.5 symbols/min [2025-09-19T19:36:44.982605] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:45.023801] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T19:36:45.061504] [DEBUG] [LOCAL ] KEP: Loaded 30415 existing records from primary storage. [2025-09-19T19:36:45.061702] [INFO ] [MAIN ] KEP: Loaded 30415 existing records. [2025-09-19T19:36:45.247301] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:45.247615] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-19T19:36:45.247701] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-19T19:36:45.248796] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-19T19:36:45.248859] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-19T19:36:45.451225] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-19T19:36:45.518007] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T19:36:45.626318] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:45.670367] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T19:36:46.243277] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-19T19:36:47.043286] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-19T19:36:47.675685] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T19:36:47.774069] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T19:36:47.775216] [INFO ] [REMOTE ] KEN: Full fetch complete (5959 records). [2025-09-19T19:36:47.775285] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-19T19:36:47.849627] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-19T19:36:48.141964] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-19T19:36:48.142092] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-19T19:36:48.142268] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-19T19:36:48.147911] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-19T19:36:48.159234] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T19:36:48.159332] [DEBUG] [LOCAL ] KEN: Trimmed 5959 records to 4795 (keeping 200 days of data) [2025-09-19T19:36:48.195441] [DEBUG] [LOCAL ] KEN: Primary data saved (4795 records). [2025-09-19T19:36:48.195587] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-19T19:36:48.195702] [INFO ] [MAIN ] Update Progress: 1181/2372 symbols completed. KEN took 20.5s. Estimated remaining: 2h 38m 4s. Rate: 7.5 symbols/min [2025-09-19T19:36:48.373451] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:48.414413] [DEBUG] [LOCAL ] KEX: Loaded 38096 existing records from primary storage. [2025-09-19T19:36:48.414550] [INFO ] [MAIN ] KEX: Loaded 38096 existing records. [2025-09-19T19:36:48.590822] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:48.591128] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-19T19:36:48.591186] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-19T19:36:48.592303] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-19T19:36:48.592371] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-19T19:36:48.650550] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-19T19:36:48.957390] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:49.443303] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-19T19:36:50.248522] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-19T19:36:50.262672] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T19:36:50.719237] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T19:36:51.043282] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-19T19:36:51.442450] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T19:36:51.565676] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T19:36:51.843268] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-19T19:36:52.541125] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T19:36:52.643231] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-19T19:36:53.044576] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T19:36:53.443282] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-19T19:36:54.243291] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-19T19:36:54.497139] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T19:36:54.504163] [INFO ] [REMOTE ] KBR: Full fetch complete (69843 records). [2025-09-19T19:36:54.504285] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-19T19:36:54.829835] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T19:36:54.921172] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-19T19:36:54.921259] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-19T19:36:54.922168] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-19T19:36:54.922241] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-19T19:36:54.923792] [DEBUG] [LOCAL ] KBR: Trimmed 69843 records to 48981 (keeping 200 days of data) [2025-09-19T19:36:55.043330] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-19T19:36:55.225303] [DEBUG] [LOCAL ] KBR: Primary data saved (48981 records). [2025-09-19T19:36:55.225450] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-19T19:36:55.225537] [INFO ] [MAIN ] Update Progress: 1182/2372 symbols completed. KBR took 37.1s. Estimated remaining: 2h 37m 55s. Rate: 7.5 symbols/min [2025-09-19T19:36:55.394778] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:55.394968] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-19T19:36:55.395006] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-19T19:36:55.395146] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-19T19:36:55.395189] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-19T19:36:55.395245] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-19T19:36:55.395306] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-19T19:36:55.755213] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:55.817548] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T19:36:55.843225] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-19T19:36:56.643280] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-19T19:36:57.180882] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T19:36:57.188762] [INFO ] [REMOTE ] KD: Full fetch complete (75573 records). [2025-09-19T19:36:57.188911] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-19T19:36:57.449741] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-19T19:36:57.444507] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T19:36:57.620512] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-19T19:36:57.620594] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-19T19:36:57.621554] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-19T19:36:57.621618] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-19T19:36:57.623123] [DEBUG] [LOCAL ] KD: Trimmed 75573 records to 53065 (keeping 200 days of data) [2025-09-19T19:36:57.932137] [DEBUG] [LOCAL ] KD: Primary data saved (53065 records). [2025-09-19T19:36:57.932270] [INFO ] [MAIN ] KD: Full history saved. [2025-09-19T19:36:57.932353] [INFO ] [MAIN ] Update Progress: 1183/2372 symbols completed. KD took 34.4s. Estimated remaining: 2h 37m 41s. Rate: 7.5 symbols/min [2025-09-19T19:36:58.099229] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:58.142535] [DEBUG] [LOCAL ] KEYS: Loaded 43754 existing records from primary storage. [2025-09-19T19:36:58.142733] [INFO ] [MAIN ] KEYS: Loaded 43754 existing records. [2025-09-19T19:36:58.248336] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-19T19:36:58.321115] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:58.321331] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-19T19:36:58.321378] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-19T19:36:58.322694] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-19T19:36:58.322755] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-19T19:36:58.671764] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:58.768067] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T19:36:58.823595] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T19:36:59.043262] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-19T19:36:59.843276] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-19T19:37:00.014612] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T19:37:00.643276] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-19T19:37:00.826831] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T19:37:01.368256] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T19:37:01.443235] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-19T19:37:02.243266] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-19T19:37:02.436152] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:37:03.043263] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-19T19:37:03.125762] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T19:37:03.843275] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-19T19:37:04.260261] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T19:37:04.648433] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-19T19:37:04.650515] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T19:37:05.316768] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T19:37:05.443232] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-19T19:37:05.848326] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T19:37:06.243266] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-19T19:37:07.043252] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-19T19:37:07.239488] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:37:07.843257] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-19T19:37:08.146826] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T19:37:08.643268] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-19T19:37:08.735633] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T19:37:09.443271] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-19T19:37:09.758358] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:37:10.086420] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T19:37:10.243228] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-19T19:37:10.968815] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T19:37:11.043232] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-19T19:37:11.638447] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T19:37:11.843247] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-19T19:37:12.424547] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T19:37:12.428790] [INFO ] [REMOTE ] KEP: Full fetch complete (41568 records). [2025-09-19T19:37:12.428881] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-19T19:37:12.648458] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-19T19:37:12.806217] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-19T19:37:12.806296] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-19T19:37:12.806990] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-19T19:37:12.807051] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-19T19:37:12.807973] [DEBUG] [LOCAL ] KEP: Trimmed 41568 records to 30662 (keeping 200 days of data) [2025-09-19T19:37:12.980670] [DEBUG] [LOCAL ] KEP: Primary data saved (30662 records). [2025-09-19T19:37:12.980807] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-19T19:37:12.980893] [INFO ] [MAIN ] Update Progress: 1184/2372 symbols completed. KEP took 28.2s. Estimated remaining: 2h 37m 41s. Rate: 7.5 symbols/min [2025-09-19T19:37:13.155252] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:13.159520] [DEBUG] [LOCAL ] KF: Loaded 2515 existing records from primary storage. [2025-09-19T19:37:13.159609] [INFO ] [MAIN ] KF: Loaded 2515 existing records. [2025-09-19T19:37:13.337440] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:13.337794] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-19T19:37:13.337874] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-19T19:37:13.338166] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-19T19:37:13.338260] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-19T19:37:13.451627] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-19T19:37:13.709165] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:13.732016] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:37:14.243235] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-19T19:37:14.717922] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T19:37:15.043251] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-19T19:37:15.370728] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:37:15.493114] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:37:15.843281] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-19T19:37:16.643271] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-19T19:37:17.058028] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T19:37:17.065028] [INFO ] [REMOTE ] KEX: Full fetch complete (55278 records). [2025-09-19T19:37:17.065154] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-19T19:37:17.450236] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-19T19:37:17.449524] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-19T19:37:17.451586] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-19T19:37:17.452906] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-19T19:37:17.453308] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-19T19:37:17.455219] [DEBUG] [LOCAL ] KEX: Trimmed 55278 records to 38420 (keeping 200 days of data) [2025-09-19T19:37:17.640880] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:37:17.757442] [DEBUG] [LOCAL ] KEX: Primary data saved (38420 records). [2025-09-19T19:37:17.757595] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-19T19:37:17.758901] [INFO ] [MAIN ] Update Progress: 1185/2372 symbols completed. KEX took 29.6s. Estimated remaining: 2h 37m 29s. Rate: 7.5 symbols/min [2025-09-19T19:37:17.928024] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:17.948580] [DEBUG] [LOCAL ] KFRC: Loaded 19331 existing records from primary storage. [2025-09-19T19:37:17.948737] [INFO ] [MAIN ] KFRC: Loaded 19331 existing records. [2025-09-19T19:37:18.116613] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:37:18.139376] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:18.139732] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-19T19:37:18.141231] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-19T19:37:18.141888] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-19T19:37:18.141961] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-19T19:37:18.248080] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-19T19:37:18.511181] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:18.800087] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T19:37:19.043294] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-19T19:37:19.843341] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-19T19:37:19.948043] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T19:37:20.385988] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T19:37:20.643275] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-19T19:37:21.201968] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T19:37:21.443331] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-19T19:37:21.857448] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-19T19:37:21.889196] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:37:22.243309] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-19T19:37:23.043301] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-19T19:37:23.843300] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-19T19:37:24.191038] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T19:37:24.523511] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T19:37:24.643262] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-19T19:37:24.953342] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:37:24.960280] [INFO ] [REMOTE ] KEYS: Full fetch complete (63003 records). [2025-09-19T19:37:24.960455] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-19T19:37:25.348962] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-19T19:37:25.349121] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-19T19:37:25.350024] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-19T19:37:25.350091] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-19T19:37:25.351445] [DEBUG] [LOCAL ] KEYS: Trimmed 63003 records to 44107 (keeping 200 days of data) [2025-09-19T19:37:25.443284] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-19T19:37:25.633934] [DEBUG] [LOCAL ] KEYS: Primary data saved (44107 records). [2025-09-19T19:37:25.634131] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-19T19:37:25.634285] [INFO ] [MAIN ] Update Progress: 1186/2372 symbols completed. KEYS took 27.7s. Estimated remaining: 2h 37m 21s. Rate: 7.5 symbols/min [2025-09-19T19:37:25.807977] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:25.817827] [DEBUG] [LOCAL ] KFS: Loaded 8191 existing records from primary storage. [2025-09-19T19:37:25.817930] [INFO ] [MAIN ] KFS: Loaded 8191 existing records. [2025-09-19T19:37:26.001485] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:26.001791] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-19T19:37:26.001845] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-19T19:37:26.002213] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-19T19:37:26.002284] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-19T19:37:26.197198] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T19:37:26.243233] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-19T19:37:26.401451] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:27.013548] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T19:37:27.043281] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-19T19:37:27.551951] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T19:37:27.559068] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:37:27.843286] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-19T19:37:28.643268] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-19T19:37:28.806997] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T19:37:29.254537] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T19:37:29.443303] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-19T19:37:29.967624] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T19:37:30.243273] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-19T19:37:31.043309] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-19T19:37:31.843251] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-19T19:37:32.236001] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T19:37:32.335040] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:37:32.498001] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T19:37:32.643265] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-19T19:37:33.443275] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-19T19:37:33.744173] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T19:37:34.169501] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T19:37:34.243247] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-19T19:37:35.043298] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-19T19:37:35.843357] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-19T19:37:36.189830] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T19:37:36.197150] [INFO ] [REMOTE ] KEY: Full fetch complete (77253 records). [2025-09-19T19:37:36.197319] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-19T19:37:36.399376] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T19:37:36.400262] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:37:36.411800] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:37:36.412893] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:37:36.412497] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-19T19:37:36.413052] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-19T19:37:36.417157] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-19T19:37:36.417931] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-19T19:37:36.418062] [INFO ] [MAIN ] Update Progress: 1187/2372 symbols completed. KEY took 41.2s. Estimated remaining: 2h 37m 16s. Rate: 7.5 symbols/min [2025-09-19T19:37:36.584628] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:36.589095] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T19:37:36.625626] [DEBUG] [LOCAL ] KFY: Loaded 31051 existing records from primary storage. [2025-09-19T19:37:36.625815] [INFO ] [MAIN ] KFY: Loaded 31051 existing records. [2025-09-19T19:37:36.648434] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-19T19:37:36.806798] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:36.807015] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-19T19:37:36.807071] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-19T19:37:36.808043] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-19T19:37:36.808106] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-19T19:37:37.167795] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:37.162581] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-19T19:37:37.169080] [INFO ] [REMOTE ] KF: Full fetch complete (3911 records). [2025-09-19T19:37:37.169152] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-19T19:37:37.444535] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-19T19:37:37.523341] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-19T19:37:37.523439] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-19T19:37:37.523595] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-19T19:37:37.523636] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-19T19:37:37.524125] [DEBUG] [LOCAL ] KF: Trimmed 3911 records to 2520 (keeping 200 days of data) [2025-09-19T19:37:37.541842] [DEBUG] [LOCAL ] KF: Primary data saved (2520 records). [2025-09-19T19:37:37.541907] [INFO ] [MAIN ] KF: Full history saved. [2025-09-19T19:37:37.542002] [INFO ] [MAIN ] Update Progress: 1188/2372 symbols completed. KF took 24.6s. Estimated remaining: 2h 37m 1s. Rate: 7.5 symbols/min [2025-09-19T19:37:37.707409] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:37.786396] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-09-19T19:37:37.786576] [INFO ] [MAIN ] KGC: Loaded 54089 existing records. [2025-09-19T19:37:37.961303] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:37.961588] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-19T19:37:37.961638] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-19T19:37:37.963337] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-19T19:37:37.963400] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-19T19:37:38.248397] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-19T19:37:38.323950] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:38.657827] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:37:39.043267] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-19T19:37:39.488136] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:37:39.779740] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T19:37:39.843258] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-19T19:37:40.413882] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T19:37:40.643249] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-19T19:37:41.443276] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-19T19:37:41.564531] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T19:37:42.243234] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-19T19:37:42.795123] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T19:37:43.043254] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-19T19:37:43.332680] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T19:37:43.843283] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-19T19:37:44.002957] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T19:37:44.643246] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-19T19:37:44.754048] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T19:37:45.443266] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-19T19:37:46.243269] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-19T19:37:46.732833] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T19:37:46.980887] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T19:37:47.043253] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-19T19:37:47.609422] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T19:37:47.843265] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-19T19:37:48.643295] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-19T19:37:49.010312] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T19:37:49.028326] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T19:37:49.443286] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-19T19:37:50.196894] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T19:37:50.243225] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-19T19:37:51.043290] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-19T19:37:51.112081] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T19:37:51.843257] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-19T19:37:51.849225] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T19:37:51.963675] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T19:37:52.643260] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-19T19:37:53.429424] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:37:53.433369] [INFO ] [REMOTE ] KFRC: Full fetch complete (25086 records). [2025-09-19T19:37:53.433456] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-19T19:37:53.448358] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-19T19:37:53.803189] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-19T19:37:53.803331] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-19T19:37:53.803900] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-19T19:37:53.803962] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-19T19:37:53.804634] [DEBUG] [LOCAL ] KFRC: Trimmed 25086 records to 19497 (keeping 200 days of data) [2025-09-19T19:37:53.941731] [DEBUG] [LOCAL ] KFRC: Primary data saved (19497 records). [2025-09-19T19:37:53.941868] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-19T19:37:53.941975] [INFO ] [MAIN ] Update Progress: 1189/2372 symbols completed. KFRC took 36.2s. Estimated remaining: 2h 37m 2s. Rate: 7.5 symbols/min [2025-09-19T19:37:54.113048] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:54.151089] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T19:37:54.185412] [DEBUG] [LOCAL ] KGS: Loaded 46132 existing records from primary storage. [2025-09-19T19:37:54.185573] [INFO ] [MAIN ] KGS: Loaded 46132 existing records. [2025-09-19T19:37:54.249546] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-19T19:37:54.380570] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:54.381182] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-19T19:37:54.381243] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-19T19:37:54.382395] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-19T19:37:54.382460] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-19T19:37:54.744069] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:55.043232] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-19T19:37:55.396700] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T19:37:55.396892] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T19:37:55.411808] [INFO ] [REMOTE ] KFS: Full fetch complete (10364 records). [2025-09-19T19:37:55.411976] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-19T19:37:55.780673] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-19T19:37:55.780763] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-19T19:37:55.781009] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-19T19:37:55.781046] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-19T19:37:55.781488] [DEBUG] [LOCAL ] KFS: Trimmed 10364 records to 8270 (keeping 200 days of data) [2025-09-19T19:37:55.832616] [DEBUG] [LOCAL ] KFS: Primary data saved (8270 records). [2025-09-19T19:37:55.832785] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-19T19:37:55.832944] [INFO ] [MAIN ] Update Progress: 1190/2372 symbols completed. KFS took 30.2s. Estimated remaining: 2h 36m 48s. Rate: 7.5 symbols/min [2025-09-19T19:37:55.848408] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-19T19:37:56.022476] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:56.096500] [DEBUG] [LOCAL ] KIM: Loaded 53461 existing records from primary storage. [2025-09-19T19:37:56.096707] [INFO ] [MAIN ] KIM: Loaded 53461 existing records. [2025-09-19T19:37:56.282999] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:56.283266] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-19T19:37:56.283317] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-19T19:37:56.284688] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-19T19:37:56.284752] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-19T19:37:56.654153] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-19T19:37:56.676153] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:56.886788] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T19:37:57.443298] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-19T19:37:58.243254] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-19T19:37:58.295498] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T19:37:58.328126] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T19:37:59.043238] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-19T19:37:59.153144] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T19:37:59.843263] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-19T19:38:00.266565] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T19:38:00.643233] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-19T19:38:01.311436] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T19:38:01.443282] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-19T19:38:01.597199] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:38:02.243300] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-19T19:38:02.407736] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:38:03.043235] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-19T19:38:03.499076] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T19:38:03.560046] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:38:03.843269] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-19T19:38:04.594608] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T19:38:04.643224] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-19T19:38:05.443269] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-19T19:38:05.700089] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:38:06.243277] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-19T19:38:06.484259] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:38:07.043252] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-19T19:38:07.663328] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T19:38:07.688737] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T19:38:07.693860] [INFO ] [REMOTE ] KFY: Full fetch complete (43862 records). [2025-09-19T19:38:07.693957] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-19T19:38:07.845019] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-19T19:38:08.071850] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-19T19:38:08.071932] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-19T19:38:08.072674] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-19T19:38:08.072736] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-19T19:38:08.073668] [DEBUG] [LOCAL ] KFY: Trimmed 43862 records to 31278 (keeping 200 days of data) [2025-09-19T19:38:08.275048] [DEBUG] [LOCAL ] KFY: Primary data saved (31278 records). [2025-09-19T19:38:08.275225] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-19T19:38:08.275349] [INFO ] [MAIN ] Update Progress: 1191/2372 symbols completed. KFY took 31.9s. Estimated remaining: 2h 36m 44s. Rate: 7.5 symbols/min [2025-09-19T19:38:08.443617] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:08.465975] [DEBUG] [LOCAL ] KIO: Loaded 21562 existing records from primary storage. [2025-09-19T19:38:08.466107] [INFO ] [MAIN ] KIO: Loaded 21562 existing records. [2025-09-19T19:38:08.641808] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:38:08.642097] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-19T19:38:08.642148] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-19T19:38:08.642975] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-19T19:38:08.643049] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-19T19:38:08.674219] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-19T19:38:09.040004] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:09.066040] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T19:38:09.443224] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-19T19:38:10.199794] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-19T19:38:10.243224] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-19T19:38:10.837931] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T19:38:11.043257] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-19T19:38:11.132581] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:38:11.843244] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-19T19:38:11.996192] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T19:38:12.084096] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:38:12.643279] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-19T19:38:13.443366] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-19T19:38:13.574003] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T19:38:13.610447] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:38:14.243327] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-19T19:38:15.043358] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-19T19:38:15.268282] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T19:38:15.577594] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T19:38:15.843334] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-19T19:38:16.643290] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-19T19:38:16.951929] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T19:38:17.443274] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-19T19:38:17.838174] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:38:18.136974] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:38:18.243251] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-19T19:38:19.043279] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-19T19:38:19.498217] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T19:38:19.535210] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T19:38:19.547149] [INFO ] [REMOTE ] KGC: Full fetch complete (77689 records). [2025-09-19T19:38:19.547333] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-19T19:38:19.848475] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-19T19:38:19.966741] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-19T19:38:19.966850] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-19T19:38:19.967951] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-19T19:38:19.968042] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-19T19:38:19.969827] [DEBUG] [LOCAL ] KGC: Trimmed 77689 records to 54479 (keeping 200 days of data) [2025-09-19T19:38:20.323626] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-09-19T19:38:20.323789] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-19T19:38:20.323876] [INFO ] [MAIN ] Update Progress: 1192/2372 symbols completed. KGC took 42.8s. Estimated remaining: 2h 36m 40s. Rate: 7.5 symbols/min [2025-09-19T19:38:20.507371] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:20.563534] [DEBUG] [LOCAL ] KKR: Loaded 53901 existing records from primary storage. [2025-09-19T19:38:20.563709] [INFO ] [MAIN ] KKR: Loaded 53901 existing records. [2025-09-19T19:38:20.648474] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-19T19:38:20.757628] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:38:20.757900] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-19T19:38:20.757970] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-19T19:38:20.759227] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-19T19:38:20.759288] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-19T19:38:21.140210] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:21.175113] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T19:38:21.182433] [INFO ] [REMOTE ] KGS: Full fetch complete (65780 records). [2025-09-19T19:38:21.182559] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-19T19:38:21.451561] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-19T19:38:21.576069] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-19T19:38:21.576155] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-19T19:38:21.577048] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-19T19:38:21.577111] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-19T19:38:21.578405] [DEBUG] [LOCAL ] KGS: Trimmed 65780 records to 46501 (keeping 200 days of data) [2025-09-19T19:38:21.854522] [DEBUG] [LOCAL ] KGS: Primary data saved (46501 records). [2025-09-19T19:38:21.854675] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-19T19:38:21.855299] [INFO ] [MAIN ] Update Progress: 1193/2372 symbols completed. KGS took 27.9s. Estimated remaining: 2h 36m 26s. Rate: 7.5 symbols/min [2025-09-19T19:38:22.058841] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T19:38:22.058219] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:22.073328] [DEBUG] [LOCAL ] KKRS: Loaded 5768 existing records from primary storage. [2025-09-19T19:38:22.073452] [INFO ] [MAIN ] KKRS: Loaded 5768 existing records. [2025-09-19T19:38:22.271847] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-19T19:38:22.277956] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:38:22.291039] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-19T19:38:22.291127] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-19T19:38:22.293176] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-19T19:38:22.291821] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-19T19:38:22.303612] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-19T19:38:22.692480] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:23.043308] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-19T19:38:23.133775] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T19:38:23.393488] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T19:38:23.843319] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-19T19:38:24.643318] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-19T19:38:24.998851] [DEBUG] [REMOTE ] KKR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T19:38:24.999338] [WARN ] [REMOTE ] KKR: No data returned for month 2025-01 [2025-09-19T19:38:25.038193] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T19:38:25.043452] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T19:38:25.443278] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-19T19:38:26.243256] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-19T19:38:26.742494] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T19:38:26.926293] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T19:38:27.043298] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-19T19:38:27.843348] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-19T19:38:28.454204] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T19:38:28.643362] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-19T19:38:29.035631] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T19:38:29.443294] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-19T19:38:29.924123] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T19:38:30.243299] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-19T19:38:31.043286] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-19T19:38:31.432876] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T19:38:31.843305] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-19T19:38:31.897724] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:38:32.390931] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T19:38:32.394281] [INFO ] [REMOTE ] KIO: Full fetch complete (30987 records). [2025-09-19T19:38:32.394456] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-19T19:38:32.658690] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-19T19:38:32.634064] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T19:38:32.788392] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-19T19:38:32.788485] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-19T19:38:32.789118] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-19T19:38:32.789181] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-19T19:38:32.790074] [DEBUG] [LOCAL ] KIO: Trimmed 30987 records to 21731 (keeping 200 days of data) [2025-09-19T19:38:32.929283] [DEBUG] [LOCAL ] KIO: Primary data saved (21731 records). [2025-09-19T19:38:32.929420] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-19T19:38:32.929518] [INFO ] [MAIN ] Update Progress: 1194/2372 symbols completed. KIO took 24.7s. Estimated remaining: 2h 36m 21s. Rate: 7.5 symbols/min [2025-09-19T19:38:33.108351] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:33.108606] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-19T19:38:33.108684] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-19T19:38:33.108854] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-19T19:38:33.108916] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-19T19:38:33.108983] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-19T19:38:33.109038] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-19T19:38:33.457280] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-19T19:38:33.466148] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:34.243286] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-19T19:38:34.702759] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T19:38:34.710506] [INFO ] [REMOTE ] KIM: Full fetch complete (76821 records). [2025-09-19T19:38:34.710687] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-19T19:38:35.045967] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-19T19:38:35.101432] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-19T19:38:35.101514] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-19T19:38:35.102498] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-19T19:38:35.102590] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-19T19:38:35.104136] [DEBUG] [LOCAL ] KIM: Trimmed 76821 records to 53850 (keeping 200 days of data) [2025-09-19T19:38:35.326595] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:35.327626] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-19T19:38:35.433342] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T19:38:35.457485] [DEBUG] [LOCAL ] KIM: Primary data saved (53850 records). [2025-09-19T19:38:35.457607] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-19T19:38:35.457746] [INFO ] [MAIN ] Update Progress: 1195/2372 symbols completed. KIM took 39.6s. Estimated remaining: 2h 36m 8s. Rate: 7.5 symbols/min [2025-09-19T19:38:35.626891] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:35.627212] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-19T19:38:35.627300] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-19T19:38:35.627666] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-19T19:38:35.627763] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-19T19:38:35.627840] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-19T19:38:35.627903] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-19T19:38:35.849183] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-19T19:38:35.999436] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:36.033017] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-19T19:38:36.643278] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-19T19:38:36.802383] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:38:37.443283] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-19T19:38:38.244552] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-19T19:38:38.247237] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T19:38:38.790712] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:38.791124] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-19T19:38:38.824609] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T19:38:39.043276] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-19T19:38:39.800738] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T19:38:39.843319] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-19T19:38:40.066622] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:40.067020] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-19T19:38:40.643313] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-19T19:38:41.443264] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-19T19:38:41.675189] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:41.675506] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-19T19:38:42.243282] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-19T19:38:42.484820] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:42.485152] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-19T19:38:42.727483] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T19:38:43.043271] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-19T19:38:43.263756] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:43.264173] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-19T19:38:43.843289] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-19T19:38:44.607474] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T19:38:44.643288] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-19T19:38:45.443266] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-19T19:38:46.110727] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T19:38:46.111937] [INFO ] [REMOTE ] KKRS: Full fetch complete (8041 records). [2025-09-19T19:38:46.112008] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-19T19:38:46.250700] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-19T19:38:46.473194] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-19T19:38:46.473273] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-19T19:38:46.473489] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-19T19:38:46.473526] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-19T19:38:46.473959] [DEBUG] [LOCAL ] KKRS: Trimmed 8041 records to 5784 (keeping 200 days of data) [2025-09-19T19:38:46.509468] [DEBUG] [LOCAL ] KKRS: Primary data saved (5784 records). [2025-09-19T19:38:46.509598] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-19T19:38:46.509709] [INFO ] [MAIN ] Update Progress: 1196/2372 symbols completed. KKRS took 24.7s. Estimated remaining: 2h 36m 3s. Rate: 7.5 symbols/min [2025-09-19T19:38:46.687930] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:46.726076] [DEBUG] [LOCAL ] KLC: Loaded 36441 existing records from primary storage. [2025-09-19T19:38:46.726216] [INFO ] [MAIN ] KLC: Loaded 36441 existing records. [2025-09-19T19:38:46.830993] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T19:38:46.916333] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:38:46.916866] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-19T19:38:46.917002] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-19T19:38:46.917936] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-19T19:38:46.918000] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-19T19:38:47.045960] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-19T19:38:47.259856] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T19:38:47.346180] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:47.342949] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:47.346719] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-19T19:38:47.843256] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-19T19:38:48.318035] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:48.318361] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-19T19:38:48.643262] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-19T19:38:48.884469] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:48.884848] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-19T19:38:49.443303] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-19T19:38:50.243253] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-19T19:38:50.772066] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:38:51.043279] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-19T19:38:51.273835] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:51.274172] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-19T19:38:51.843219] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-19T19:38:51.888344] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T19:38:52.643353] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-19T19:38:53.443325] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-19T19:38:53.672539] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:53.672942] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-19T19:38:53.972987] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:38:54.005249] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T19:38:54.243306] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-19T19:38:55.043321] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-19T19:38:55.148945] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T19:38:55.268272] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:55.268798] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-19T19:38:55.843284] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-19T19:38:56.061852] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:56.062200] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-19T19:38:56.643310] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-19T19:38:56.875632] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:56.875893] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-19T19:38:57.443286] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-19T19:38:58.243339] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-19T19:38:58.504157] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T19:38:58.506102] [INFO ] [REMOTE ] KKRT: Full fetch complete (8236 records). [2025-09-19T19:38:58.506175] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-19T19:38:58.698319] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 78 unique days, need 200 days [2025-09-19T19:38:58.698576] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:38:58.698671] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:38:58.698733] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-19T19:38:58.698806] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-19T19:38:58.698863] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-19T19:38:58.698921] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-19T19:38:58.699032] [INFO ] [MAIN ] Update Progress: 1197/2372 symbols completed. KKRT took 25.8s. Estimated remaining: 2h 35m 59s. Rate: 7.5 symbols/min [2025-09-19T19:38:59.043281] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-19T19:38:59.669801] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:38:59.843307] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-19T19:39:00.614508] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T19:39:00.618887] [INFO ] [REMOTE ] KLAR: Full fetch complete (2901 records). [2025-09-19T19:39:00.619014] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-19T19:39:00.651728] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-19T19:39:00.806471] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 8 unique days, need 200 days [2025-09-19T19:39:00.806777] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:39:00.807118] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:39:00.807201] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-19T19:39:00.807388] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-19T19:39:00.807491] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-19T19:39:00.821624] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-19T19:39:00.821822] [INFO ] [MAIN ] Update Progress: 1198/2372 symbols completed. KLAR took 25.4s. Estimated remaining: 2h 35m 46s. Rate: 7.5 symbols/min [2025-09-19T19:39:00.823145] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T19:39:01.443320] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-19T19:39:03.212056] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-19T19:39:03.219728] [INFO ] [REMOTE ] KKR: Full fetch complete (69671 records). [2025-09-19T19:39:03.219843] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-19T19:39:03.411213] [WARN ] [VALIDATOR ] KKR: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T19:39:03.411934] [FATAL] [MAIN ] KKR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:39:03.412007] [WARN ] [MAIN ] KKR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:39:03.412077] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-19T19:39:03.412141] [DEBUG] [LOCAL ] KKR: No primary data file found to delete. [2025-09-19T19:39:03.412175] [INFO ] [LOCAL ] KKR: Starting deletion of derivative data. [2025-09-19T19:39:03.412674] [DEBUG] [LOCAL ] KKR: Deleted derivative data file. [2025-09-19T19:39:03.412795] [INFO ] [MAIN ] Update Progress: 1199/2372 symbols completed. KKR took 43.1s. Estimated remaining: 2h 35m 32s. Rate: 7.5 symbols/min [2025-09-19T19:39:04.398353] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-09-19T19:39:04.406130] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-19T19:39:06.035090] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T19:39:06.043487] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-19T19:39:07.581076] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:39:07.589051] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-19T19:39:09.102604] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T19:39:09.109951] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-19T19:39:10.621249] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T19:39:10.628851] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-19T19:39:11.887513] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T19:39:11.896097] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-19T19:39:13.557223] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T19:39:13.563666] [INFO ] [REMOTE ] KLC: Full fetch complete (50807 records). [2025-09-19T19:39:13.563785] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-19T19:39:13.959169] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-19T19:39:13.959277] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-19T19:39:13.960069] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-19T19:39:13.960131] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-19T19:39:13.961258] [DEBUG] [LOCAL ] KLC: Trimmed 50807 records to 36718 (keeping 200 days of data) [2025-09-19T19:39:14.165202] [DEBUG] [LOCAL ] KLC: Primary data saved (36718 records). [2025-09-19T19:39:14.165340] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-19T19:39:14.165437] [INFO ] [MAIN ] Update Progress: 1200/2372 symbols completed. KLC took 27.7s. Estimated remaining: 2h 35m 27s. Rate: 7.5 symbols/min [2025-09-19T19:39:14.791254] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:14.775343] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:14.828671] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:14.843261] [DEBUG] [LOCAL ] KMPB: Loaded 3640 existing records from primary storage. [2025-09-19T19:39:14.873336] [INFO ] [MAIN ] KMPB: Loaded 3640 existing records. [2025-09-19T19:39:14.974736] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:15.152193] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:15.148348] [DEBUG] [LOCAL ] KMPR: Loaded 38088 existing records from primary storage. [2025-09-19T19:39:15.152713] [INFO ] [MAIN ] KMPR: Loaded 38088 existing records. [2025-09-19T19:39:15.158796] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-19T19:39:15.184744] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-19T19:39:15.244316] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-19T19:39:15.256307] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-19T19:39:15.269324] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-09-19T19:39:15.326695] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-09-19T19:39:15.357757] [DEBUG] [LOCAL ] KLG: Loaded 42255 existing records from primary storage. [2025-09-19T19:39:15.375472] [INFO ] [MAIN ] KLG: Loaded 42255 existing records. [2025-09-19T19:39:15.718637] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:15.756954] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-19T19:39:15.777639] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-19T19:39:15.925696] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-19T19:39:15.941817] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-19T19:39:16.030361] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:16.065683] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-19T19:39:16.020615] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:16.088514] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-19T19:39:16.122560] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-19T19:39:16.122734] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-19T19:39:16.154570] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-19T19:39:16.174368] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-19T19:39:16.174929] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-19T19:39:16.174516] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-19T19:39:16.484162] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:16.548406] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-19T19:39:17.100724] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:17.128626] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-19T19:39:17.291082] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:17.301802] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-19T19:39:17.367964] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:17.368388] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-19T19:39:17.461121] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T19:39:17.463405] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-19T19:39:17.771237] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-19T19:39:17.772473] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-19T19:39:18.297623] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T19:39:18.299049] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-19T19:39:18.718688] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T19:39:18.724618] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-19T19:39:18.966323] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T19:39:18.968006] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-19T19:39:19.007529] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T19:39:19.016908] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-19T19:39:19.136105] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T19:39:19.147497] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-19T19:39:19.311963] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-19T19:39:19.313445] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-19T19:39:19.861768] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T19:39:19.863256] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-19T19:39:20.233366] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T19:39:20.239105] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-19T19:39:20.548291] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T19:39:20.550080] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-19T19:39:20.814435] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T19:39:20.823992] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-19T19:39:21.086068] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T19:39:21.097586] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-19T19:39:21.188056] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T19:39:21.189510] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-19T19:39:21.516481] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T19:39:21.523283] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-19T19:39:21.920704] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T19:39:22.243294] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-19T19:39:22.488292] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:39:22.676468] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T19:39:22.878705] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T19:39:22.942272] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T19:39:22.943327] [INFO ] [REMOTE ] KMPB: Full fetch complete (4840 records). [2025-09-19T19:39:22.943427] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-19T19:39:23.046482] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-19T19:39:23.306203] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-19T19:39:23.306282] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-19T19:39:23.306430] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-19T19:39:23.306468] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-19T19:39:23.306868] [DEBUG] [LOCAL ] KMPB: Trimmed 4840 records to 3656 (keeping 200 days of data) [2025-09-19T19:39:23.328987] [DEBUG] [LOCAL ] KMPB: Primary data saved (3656 records). [2025-09-19T19:39:23.329066] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-19T19:39:23.329149] [INFO ] [MAIN ] Update Progress: 1201/2372 symbols completed. KMPB took 9.1s. Estimated remaining: 2h 35m 20s. Rate: 7.5 symbols/min [2025-09-19T19:39:23.496439] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:23.541711] [DEBUG] [LOCAL ] KMT: Loaded 43538 existing records from primary storage. [2025-09-19T19:39:23.541895] [INFO ] [MAIN ] KMT: Loaded 43538 existing records. [2025-09-19T19:39:23.723102] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:23.723606] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-19T19:39:23.723720] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-19T19:39:23.726262] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-19T19:39:23.726331] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-19T19:39:23.848540] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-19T19:39:24.093622] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:24.643289] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-19T19:39:24.926060] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T19:39:25.443232] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-19T19:39:25.896636] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:39:26.198334] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-19T19:39:26.243230] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-19T19:39:27.043319] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-19T19:39:27.843304] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-19T19:39:28.108995] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T19:39:28.643300] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-19T19:39:28.720981] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T19:39:28.874848] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:39:29.443280] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-19T19:39:29.540103] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T19:39:30.243298] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-19T19:39:30.369225] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T19:39:31.043302] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-19T19:39:31.298689] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T19:39:31.843296] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-19T19:39:32.462781] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T19:39:32.608332] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T19:39:32.643225] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-19T19:39:33.443286] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-19T19:39:33.655875] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T19:39:34.243267] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-19T19:39:34.398868] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T19:39:35.043241] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-19T19:39:35.422115] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T19:39:35.703919] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T19:39:35.843271] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-19T19:39:36.226705] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T19:39:36.643264] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-19T19:39:37.443264] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-19T19:39:37.635218] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:39:38.243275] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-19T19:39:38.427541] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:39:38.809256] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T19:39:39.043331] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-19T19:39:39.843278] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-19T19:39:40.383281] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T19:39:40.643296] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-19T19:39:41.443234] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-19T19:39:41.534138] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:39:41.657498] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-19T19:39:41.998451] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T19:39:42.005088] [INFO ] [REMOTE ] KMPR: Full fetch complete (50106 records). [2025-09-19T19:39:42.005185] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-19T19:39:42.253224] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-19T19:39:42.392105] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-19T19:39:42.392224] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-19T19:39:42.393173] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-19T19:39:42.393253] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-19T19:39:42.394555] [DEBUG] [LOCAL ] KMPR: Trimmed 50106 records to 38460 (keeping 200 days of data) [2025-09-19T19:39:42.665255] [DEBUG] [LOCAL ] KMPR: Primary data saved (38460 records). [2025-09-19T19:39:42.665456] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-19T19:39:42.665629] [INFO ] [MAIN ] Update Progress: 1202/2372 symbols completed. KMPR took 28.5s. Estimated remaining: 2h 35m 23s. Rate: 7.5 symbols/min [2025-09-19T19:39:42.839260] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:42.898528] [DEBUG] [LOCAL ] KMX: Loaded 53480 existing records from primary storage. [2025-09-19T19:39:42.898731] [INFO ] [MAIN ] KMX: Loaded 53480 existing records. [2025-09-19T19:39:43.048421] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-19T19:39:43.079244] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:43.079605] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-19T19:39:43.079713] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-19T19:39:43.089941] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-19T19:39:43.096352] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-19T19:39:43.183207] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T19:39:43.495493] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:43.529271] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T19:39:43.843264] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-19T19:39:44.643306] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-19T19:39:45.310804] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T19:39:45.443266] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-19T19:39:45.834511] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T19:39:46.243269] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-19T19:39:46.269226] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T19:39:46.276403] [INFO ] [REMOTE ] KLG: Full fetch complete (61873 records). [2025-09-19T19:39:46.276568] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-19T19:39:46.663443] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-19T19:39:46.663532] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-19T19:39:46.664494] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-19T19:39:46.664560] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-19T19:39:46.666114] [DEBUG] [LOCAL ] KLG: Trimmed 61873 records to 42547 (keeping 200 days of data) [2025-09-19T19:39:46.952668] [DEBUG] [LOCAL ] KLG: Primary data saved (42547 records). [2025-09-19T19:39:46.952929] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-19T19:39:46.953138] [INFO ] [MAIN ] Update Progress: 1203/2372 symbols completed. KLG took 32.8s. Estimated remaining: 2h 35m 12s. Rate: 7.5 symbols/min [2025-09-19T19:39:47.051967] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-19T19:39:47.135750] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:47.177224] [DEBUG] [LOCAL ] KN: Loaded 39405 existing records from primary storage. [2025-09-19T19:39:47.177362] [INFO ] [MAIN ] KN: Loaded 39405 existing records. [2025-09-19T19:39:47.353243] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:47.353522] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-19T19:39:47.353573] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-19T19:39:47.354698] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-19T19:39:47.354800] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-19T19:39:47.751940] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:47.779623] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T19:39:47.789768] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-19T19:39:47.789927] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-19T19:39:47.855028] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-19T19:39:48.209413] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-19T19:39:48.209520] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-19T19:39:48.210564] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-19T19:39:48.210787] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-19T19:39:48.214820] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54473 (keeping 200 days of data) [2025-09-19T19:39:48.323867] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T19:39:48.607780] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-09-19T19:39:48.607967] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-19T19:39:48.608136] [INFO ] [MAIN ] Update Progress: 1204/2372 symbols completed. KMI took 34.4s. Estimated remaining: 2h 34m 58s. Rate: 7.5 symbols/min [2025-09-19T19:39:48.651769] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-19T19:39:48.782697] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:48.825003] [DEBUG] [LOCAL ] KNF: Loaded 36005 existing records from primary storage. [2025-09-19T19:39:48.825173] [INFO ] [MAIN ] KNF: Loaded 36005 existing records. [2025-09-19T19:39:49.018924] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:49.019701] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-19T19:39:49.019855] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-19T19:39:49.020876] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-19T19:39:49.020967] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-19T19:39:49.314093] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T19:39:49.424756] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T19:39:49.472422] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:49.465899] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-19T19:39:50.243268] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-19T19:39:50.569785] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:39:51.035065] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:39:51.043223] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-19T19:39:51.843322] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-19T19:39:51.945514] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T19:39:52.643283] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-19T19:39:53.060623] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T19:39:53.443281] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-19T19:39:53.676097] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T19:39:53.689617] [INFO ] [REMOTE ] KMT: Full fetch complete (61894 records). [2025-09-19T19:39:53.689883] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-19T19:39:54.136283] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-19T19:39:54.136511] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-19T19:39:54.137495] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-19T19:39:54.137637] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-19T19:39:54.139169] [DEBUG] [LOCAL ] KMT: Trimmed 61894 records to 43803 (keeping 200 days of data) [2025-09-19T19:39:54.222074] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T19:39:54.255229] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-19T19:39:54.438079] [DEBUG] [LOCAL ] KMT: Primary data saved (43803 records). [2025-09-19T19:39:54.438248] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-19T19:39:54.438361] [INFO ] [MAIN ] Update Progress: 1205/2372 symbols completed. KMT took 31.1s. Estimated remaining: 2h 34m 48s. Rate: 7.5 symbols/min [2025-09-19T19:39:54.616715] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:54.644214] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T19:39:54.657038] [DEBUG] [LOCAL ] KNOP: Loaded 9985 existing records from primary storage. [2025-09-19T19:39:54.657176] [INFO ] [MAIN ] KNOP: Loaded 9985 existing records. [2025-09-19T19:39:54.834212] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:54.834511] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-19T19:39:54.834561] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-19T19:39:54.835126] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-19T19:39:54.835187] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-19T19:39:55.050629] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-19T19:39:55.199019] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:55.843241] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-19T19:39:55.939589] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:39:56.198568] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T19:39:56.643275] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-19T19:39:57.443299] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-19T19:39:57.503210] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:39:58.243275] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-19T19:39:58.608514] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T19:39:58.835526] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-19T19:39:59.043272] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-19T19:39:59.233310] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T19:39:59.843268] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-19T19:39:59.944310] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T19:40:00.643261] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-19T19:40:01.271595] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T19:40:01.443334] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-19T19:40:02.243283] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-19T19:40:02.748816] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T19:40:03.043315] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-19T19:40:03.182877] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T19:40:03.843273] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-19T19:40:03.881373] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T19:40:04.643274] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-19T19:40:04.692860] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T19:40:05.443282] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-19T19:40:05.589139] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T19:40:06.248571] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-19T19:40:06.259223] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T19:40:06.415930] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T19:40:07.043269] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-19T19:40:07.843263] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-19T19:40:07.933254] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T19:40:08.623585] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T19:40:08.643213] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-19T19:40:09.391331] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T19:40:09.443238] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-19T19:40:10.243278] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-19T19:40:10.726040] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:40:10.733830] [INFO ] [REMOTE ] KMX: Full fetch complete (75895 records). [2025-09-19T19:40:10.733972] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-19T19:40:11.045879] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-19T19:40:11.134550] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-19T19:40:11.134693] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-19T19:40:11.135781] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-19T19:40:11.135958] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-19T19:40:11.137623] [DEBUG] [LOCAL ] KMX: Trimmed 75895 records to 53867 (keeping 200 days of data) [2025-09-19T19:40:11.253871] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T19:40:11.499809] [DEBUG] [LOCAL ] KMX: Primary data saved (53867 records). [2025-09-19T19:40:11.499968] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-19T19:40:11.500836] [INFO ] [MAIN ] Update Progress: 1206/2372 symbols completed. KMX took 28.8s. Estimated remaining: 2h 34m 49s. Rate: 7.5 symbols/min [2025-09-19T19:40:11.671846] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:11.698254] [DEBUG] [LOCAL ] KNSL: Loaded 18273 existing records from primary storage. [2025-09-19T19:40:11.698405] [INFO ] [MAIN ] KNSL: Loaded 18273 existing records. [2025-09-19T19:40:11.844239] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-19T19:40:11.882066] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:11.882564] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-19T19:40:11.882663] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-19T19:40:11.883969] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-19T19:40:11.884047] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-19T19:40:11.996795] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:40:12.220970] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T19:40:12.286511] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:12.643338] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-19T19:40:13.443278] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-19T19:40:13.473935] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T19:40:14.042495] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T19:40:14.243303] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-19T19:40:15.043341] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-19T19:40:15.063573] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T19:40:15.069691] [INFO ] [REMOTE ] KN: Full fetch complete (56268 records). [2025-09-19T19:40:15.069806] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-19T19:40:15.455371] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-19T19:40:15.455453] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-19T19:40:15.456381] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-19T19:40:15.456444] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-19T19:40:15.458401] [DEBUG] [LOCAL ] KN: Trimmed 56268 records to 39680 (keeping 200 days of data) [2025-09-19T19:40:15.690262] [DEBUG] [LOCAL ] KN: Primary data saved (39680 records). [2025-09-19T19:40:15.690401] [INFO ] [MAIN ] KN: Full history saved. [2025-09-19T19:40:15.690488] [INFO ] [MAIN ] Update Progress: 1207/2372 symbols completed. KN took 28.7s. Estimated remaining: 2h 34m 37s. Rate: 7.5 symbols/min [2025-09-19T19:40:15.870064] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:15.866452] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-19T19:40:15.888316] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T19:40:15.894635] [INFO ] [REMOTE ] KNF: Full fetch complete (50110 records). [2025-09-19T19:40:15.894843] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-19T19:40:16.212731] [DEBUG] [LOCAL ] KNTK: Loaded 46485 existing records from primary storage. [2025-09-19T19:40:16.223804] [INFO ] [MAIN ] KNTK: Loaded 46485 existing records. [2025-09-19T19:40:16.501906] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-19T19:40:16.501776] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:16.502158] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-19T19:40:16.503375] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-19T19:40:16.503665] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-19T19:40:16.503551] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-19T19:40:16.503886] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-19T19:40:16.515242] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-19T19:40:16.517054] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-19T19:40:16.518110] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T19:40:16.510441] [DEBUG] [LOCAL ] KNF: Trimmed 50110 records to 36245 (keeping 200 days of data) [2025-09-19T19:40:16.648151] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-19T19:40:16.812609] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T19:40:17.034101] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:17.135815] [DEBUG] [LOCAL ] KNF: Primary data saved (36245 records). [2025-09-19T19:40:17.135959] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-19T19:40:17.136044] [INFO ] [MAIN ] Update Progress: 1208/2372 symbols completed. KNF took 28.5s. Estimated remaining: 2h 34m 23s. Rate: 7.5 symbols/min [2025-09-19T19:40:17.317145] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:17.371184] [DEBUG] [LOCAL ] KNX: Loaded 52977 existing records from primary storage. [2025-09-19T19:40:17.371359] [INFO ] [MAIN ] KNX: Loaded 52977 existing records. [2025-09-19T19:40:17.449535] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-19T19:40:17.561155] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:17.561431] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-19T19:40:17.561511] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-19T19:40:17.566550] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-19T19:40:17.566719] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-19T19:40:17.931948] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:18.196423] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T19:40:18.243292] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-19T19:40:18.594621] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:40:19.043312] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-19T19:40:19.843279] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-19T19:40:19.992234] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:40:20.073726] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T19:40:20.643272] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-19T19:40:21.443281] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-19T19:40:21.507326] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T19:40:21.531723] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T19:40:22.243268] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-19T19:40:23.043300] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-19T19:40:23.521297] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T19:40:23.843266] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-19T19:40:23.881026] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T19:40:23.926052] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T19:40:24.643284] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-19T19:40:25.443271] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-19T19:40:25.637959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:40:25.987738] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T19:40:26.243325] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-19T19:40:26.649556] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T19:40:27.043315] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-19T19:40:27.843251] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-19T19:40:28.215489] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T19:40:28.324787] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:40:28.643316] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-19T19:40:29.040067] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T19:40:29.139827] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T19:40:29.443281] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-19T19:40:30.243268] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-19T19:40:31.043320] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-19T19:40:31.267222] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T19:40:31.269337] [INFO ] [REMOTE ] KNOP: Full fetch complete (14742 records). [2025-09-19T19:40:31.269408] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-19T19:40:31.646448] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-19T19:40:31.646666] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-19T19:40:31.647200] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-19T19:40:31.647309] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-19T19:40:31.648110] [DEBUG] [LOCAL ] KNOP: Trimmed 14742 records to 10092 (keeping 200 days of data) [2025-09-19T19:40:31.746348] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T19:40:31.781017] [DEBUG] [LOCAL ] KNOP: Primary data saved (10092 records). [2025-09-19T19:40:31.781263] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-19T19:40:31.781411] [INFO ] [MAIN ] Update Progress: 1209/2372 symbols completed. KNOP took 37.3s. Estimated remaining: 2h 34m 21s. Rate: 7.5 symbols/min [2025-09-19T19:40:31.852056] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-19T19:40:32.029246] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:32.098500] [DEBUG] [LOCAL ] KO: Loaded 54208 existing records from primary storage. [2025-09-19T19:40:32.098718] [INFO ] [MAIN ] KO: Loaded 54208 existing records. [2025-09-19T19:40:32.353338] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:32.353935] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-19T19:40:32.354026] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-19T19:40:32.361829] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-19T19:40:32.374693] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-19T19:40:32.383782] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:40:32.650535] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-19T19:40:32.941346] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:33.443323] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-19T19:40:33.940714] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T19:40:34.024888] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T19:40:34.243309] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-19T19:40:35.043284] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-19T19:40:35.843338] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-19T19:40:36.246477] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T19:40:36.472233] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-09-19T19:40:36.504007] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T19:40:36.643276] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-19T19:40:37.443271] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-19T19:40:37.768633] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T19:40:38.243311] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-19T19:40:38.680429] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T19:40:39.043249] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-19T19:40:39.469588] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-19T19:40:39.843276] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-19T19:40:40.152404] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T19:40:40.643292] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-19T19:40:40.954237] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T19:40:41.027789] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T19:40:41.030984] [INFO ] [REMOTE ] KNSL: Full fetch complete (26719 records). [2025-09-19T19:40:41.031125] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-19T19:40:41.431293] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-19T19:40:41.431436] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-19T19:40:41.432089] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-19T19:40:41.432155] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-19T19:40:41.432968] [DEBUG] [LOCAL ] KNSL: Trimmed 26719 records to 18452 (keeping 200 days of data) [2025-09-19T19:40:41.495961] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-19T19:40:41.563931] [DEBUG] [LOCAL ] KNSL: Primary data saved (18452 records). [2025-09-19T19:40:41.564080] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-19T19:40:41.564167] [INFO ] [MAIN ] Update Progress: 1210/2372 symbols completed. KNSL took 30.1s. Estimated remaining: 2h 34m 15s. Rate: 7.5 symbols/min [2025-09-19T19:40:41.737705] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:41.778734] [DEBUG] [LOCAL ] KODK: Loaded 43791 existing records from primary storage. [2025-09-19T19:40:41.778885] [INFO ] [MAIN ] KODK: Loaded 43791 existing records. [2025-09-19T19:40:41.976554] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:41.976913] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-19T19:40:41.976984] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-19T19:40:41.978256] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-19T19:40:41.978319] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-19T19:40:42.248421] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-19T19:40:42.359986] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:43.043266] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-19T19:40:43.386137] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:40:43.430298] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-19T19:40:43.688845] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T19:40:43.843255] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-19T19:40:44.514238] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T19:40:44.643242] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-19T19:40:45.443282] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-19T19:40:45.856028] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T19:40:45.916093] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T19:40:45.923265] [INFO ] [REMOTE ] KNTK: Full fetch complete (63757 records). [2025-09-19T19:40:45.923391] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-19T19:40:46.248404] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-19T19:40:46.318287] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-19T19:40:46.318373] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-19T19:40:46.319291] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-19T19:40:46.319354] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-19T19:40:46.320837] [DEBUG] [LOCAL ] KNTK: Trimmed 63757 records to 46851 (keeping 200 days of data) [2025-09-19T19:40:46.642268] [DEBUG] [LOCAL ] KNTK: Primary data saved (46851 records). [2025-09-19T19:40:46.642448] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-19T19:40:46.642589] [INFO ] [MAIN ] Update Progress: 1211/2372 symbols completed. KNTK took 31.0s. Estimated remaining: 2h 34m 4s. Rate: 7.5 symbols/min [2025-09-19T19:40:46.823303] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:46.849509] [DEBUG] [LOCAL ] KOF: Loaded 26218 existing records from primary storage. [2025-09-19T19:40:46.849670] [INFO ] [MAIN ] KOF: Loaded 26218 existing records. [2025-09-19T19:40:47.027266] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:47.027545] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-19T19:40:47.027593] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-19T19:40:47.028340] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-19T19:40:47.028399] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-19T19:40:47.060325] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-19T19:40:47.398801] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:47.843270] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-19T19:40:48.112229] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:40:48.419079] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-09-19T19:40:48.498499] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T19:40:48.506360] [INFO ] [REMOTE ] KNX: Full fetch complete (75667 records). [2025-09-19T19:40:48.506503] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-19T19:40:48.654076] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-19T19:40:48.919241] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-19T19:40:48.919330] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-19T19:40:48.920440] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-19T19:40:48.920563] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-19T19:40:48.922218] [DEBUG] [LOCAL ] KNX: Trimmed 75667 records to 53366 (keeping 200 days of data) [2025-09-19T19:40:49.257390] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T19:40:49.274426] [DEBUG] [LOCAL ] KNX: Primary data saved (53366 records). [2025-09-19T19:40:49.274610] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-19T19:40:49.274764] [INFO ] [MAIN ] Update Progress: 1212/2372 symbols completed. KNX took 32.1s. Estimated remaining: 2h 33m 51s. Rate: 7.5 symbols/min [2025-09-19T19:40:49.452989] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:49.449460] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-19T19:40:49.473037] [DEBUG] [LOCAL ] KOP: Loaded 18197 existing records from primary storage. [2025-09-19T19:40:49.473171] [INFO ] [MAIN ] KOP: Loaded 18197 existing records. [2025-09-19T19:40:49.661785] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:49.662056] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-19T19:40:49.662105] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-19T19:40:49.662833] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-19T19:40:49.662895] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-19T19:40:50.049685] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:50.243251] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-19T19:40:50.658313] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T19:40:51.043267] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-19T19:40:51.418076] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T19:40:51.843357] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-19T19:40:52.264468] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-19T19:40:52.643300] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-19T19:40:52.882877] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T19:40:53.005953] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T19:40:53.443266] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-19T19:40:54.243298] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-19T19:40:55.043289] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-19T19:40:55.186883] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T19:40:55.491688] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-19T19:40:55.750843] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T19:40:55.843259] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-19T19:40:56.472463] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:40:56.643262] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-19T19:40:57.443244] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-19T19:40:57.763639] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:40:57.975135] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T19:40:58.243278] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-19T19:40:59.043317] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-19T19:40:59.596528] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T19:40:59.843294] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-19T19:41:00.186497] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-09-19T19:41:00.643291] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-19T19:41:00.732062] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:41:01.267698] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T19:41:01.443307] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-19T19:41:02.243272] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-19T19:41:02.586093] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T19:41:03.043253] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-19T19:41:03.693754] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-09-19T19:41:03.717902] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-19T19:41:03.823890] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T19:41:03.843227] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-19T19:41:04.643219] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-19T19:41:05.192629] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:41:05.443276] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-19T19:41:05.879165] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T19:41:06.243274] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-19T19:41:07.043258] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-19T19:41:07.445976] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:41:07.597498] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T19:41:07.843248] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-19T19:41:08.643326] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-19T19:41:09.397735] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T19:41:09.443270] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-19T19:41:09.552932] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-19T19:41:09.988673] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T19:41:09.992114] [INFO ] [REMOTE ] KOP: Full fetch complete (25353 records). [2025-09-19T19:41:09.992186] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-19T19:41:10.249950] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-19T19:41:10.375028] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-19T19:41:10.375114] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-19T19:41:10.375633] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-19T19:41:10.375712] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-19T19:41:10.376411] [DEBUG] [LOCAL ] KOP: Trimmed 25353 records to 18334 (keeping 200 days of data) [2025-09-19T19:41:10.487761] [DEBUG] [LOCAL ] KOP: Primary data saved (18334 records). [2025-09-19T19:41:10.487919] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-19T19:41:10.488079] [INFO ] [MAIN ] Update Progress: 1213/2372 symbols completed. KOP took 21.2s. Estimated remaining: 2h 33m 56s. Rate: 7.5 symbols/min [2025-09-19T19:41:10.656231] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:10.659780] [DEBUG] [LOCAL ] KORE: Loaded 1964 existing records from primary storage. [2025-09-19T19:41:10.659855] [INFO ] [MAIN ] KORE: Loaded 1964 existing records. [2025-09-19T19:41:10.837768] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:10.838097] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-19T19:41:10.838167] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-19T19:41:10.838411] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-19T19:41:10.838469] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-19T19:41:11.054673] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-19T19:41:11.226266] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:41:11.230513] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:11.843322] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-19T19:41:12.643230] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-19T19:41:12.896587] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:41:12.902735] [INFO ] [REMOTE ] KODK: Full fetch complete (63704 records). [2025-09-19T19:41:12.902849] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-19T19:41:13.309300] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-19T19:41:13.309513] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-19T19:41:13.310466] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-19T19:41:13.310552] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-19T19:41:13.328829] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T19:41:13.334672] [DEBUG] [LOCAL ] KODK: Trimmed 63704 records to 44070 (keeping 200 days of data) [2025-09-19T19:41:13.445143] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-19T19:41:13.562269] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (3.31 seconds). [2025-09-19T19:41:13.571866] [INFO ] [REMOTE ] KO: Full fetch complete (77994 records). [2025-09-19T19:41:13.572543] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-19T19:41:13.934875] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T19:41:14.028892] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-19T19:41:14.032220] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-19T19:41:14.033424] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-19T19:41:14.033515] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-19T19:41:14.053494] [DEBUG] [LOCAL ] KO: Trimmed 77994 records to 54598 (keeping 200 days of data) [2025-09-19T19:41:14.059590] [DEBUG] [LOCAL ] KODK: Primary data saved (44070 records). [2025-09-19T19:41:14.125742] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-19T19:41:14.127760] [INFO ] [MAIN ] Update Progress: 1214/2372 symbols completed. KODK took 32.6s. Estimated remaining: 2h 33m 44s. Rate: 7.5 symbols/min [2025-09-19T19:41:14.250185] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-19T19:41:14.341511] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:14.472374] [DEBUG] [LOCAL ] KOS: Loaded 53459 existing records from primary storage. [2025-09-19T19:41:14.499634] [INFO ] [MAIN ] KOS: Loaded 53459 existing records. [2025-09-19T19:41:14.701790] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:14.704816] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-19T19:41:14.706113] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-19T19:41:14.708457] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-19T19:41:14.708913] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-19T19:41:14.798667] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T19:41:15.045674] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-19T19:41:15.177052] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:15.229385] [DEBUG] [LOCAL ] KO: Primary data saved (54598 records). [2025-09-19T19:41:15.229516] [INFO ] [MAIN ] KO: Full history saved. [2025-09-19T19:41:15.229602] [INFO ] [MAIN ] Update Progress: 1215/2372 symbols completed. KO took 43.4s. Estimated remaining: 2h 33m 29s. Rate: 7.5 symbols/min [2025-09-19T19:41:15.416803] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:15.468967] [DEBUG] [LOCAL ] KR: Loaded 54072 existing records from primary storage. [2025-09-19T19:41:15.469115] [INFO ] [MAIN ] KR: Loaded 54072 existing records. [2025-09-19T19:41:15.612132] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T19:41:15.675902] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:15.676163] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-19T19:41:15.676215] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-19T19:41:15.677706] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-19T19:41:15.677771] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-19T19:41:15.856086] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-19T19:41:16.043566] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:16.527068] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T19:41:16.601906] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T19:41:16.643258] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-19T19:41:17.443313] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-19T19:41:17.977843] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T19:41:18.243258] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-19T19:41:18.807346] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T19:41:19.043280] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-19T19:41:19.843289] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-19T19:41:19.900190] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T19:41:19.906010] [INFO ] [REMOTE ] KOF: Full fetch complete (37037 records). [2025-09-19T19:41:19.906314] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-19T19:41:20.324125] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-19T19:41:20.324219] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-19T19:41:20.324963] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-19T19:41:20.325031] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-19T19:41:20.325981] [DEBUG] [LOCAL ] KOF: Trimmed 37037 records to 26373 (keeping 200 days of data) [2025-09-19T19:41:20.502994] [DEBUG] [LOCAL ] KOF: Primary data saved (26373 records). [2025-09-19T19:41:20.503154] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-19T19:41:20.503260] [INFO ] [MAIN ] Update Progress: 1216/2372 symbols completed. KOF took 33.9s. Estimated remaining: 2h 33m 19s. Rate: 7.5 symbols/min [2025-09-19T19:41:20.652075] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-19T19:41:20.681969] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:20.733230] [DEBUG] [LOCAL ] KRC: Loaded 48795 existing records from primary storage. [2025-09-19T19:41:20.733453] [INFO ] [MAIN ] KRC: Loaded 48795 existing records. [2025-09-19T19:41:20.919899] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:20.920298] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-19T19:41:20.920424] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-19T19:41:20.921731] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-19T19:41:20.921797] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-19T19:41:21.267121] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-19T19:41:21.286124] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T19:41:21.353822] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:21.443247] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-19T19:41:22.113208] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:41:22.243274] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-19T19:41:22.795439] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T19:41:23.043270] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-19T19:41:23.486087] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-19T19:41:23.514297] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T19:41:23.843279] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-19T19:41:24.643281] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-19T19:41:25.443303] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-19T19:41:26.213816] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-19T19:41:26.243332] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-19T19:41:26.396762] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T19:41:26.826193] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-19T19:41:27.043271] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-19T19:41:27.453853] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T19:41:27.843282] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-19T19:41:28.409198] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T19:41:28.643266] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-19T19:41:29.318404] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:41:29.443262] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-19T19:41:29.925239] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:41:30.243275] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-19T19:41:31.043293] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-19T19:41:31.585447] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T19:41:31.843262] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-19T19:41:32.419330] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T19:41:32.643272] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-19T19:41:32.917090] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T19:41:33.443269] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-19T19:41:33.878391] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T19:41:34.027360] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T19:41:34.028264] [INFO ] [REMOTE ] KORE: Full fetch complete (6106 records). [2025-09-19T19:41:34.028334] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-19T19:41:34.250565] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-19T19:41:34.416920] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-19T19:41:34.417005] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-19T19:41:34.417205] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-19T19:41:34.417245] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-19T19:41:34.417624] [DEBUG] [LOCAL ] KORE: Trimmed 6106 records to 1975 (keeping 200 days of data) [2025-09-19T19:41:34.429035] [DEBUG] [LOCAL ] KORE: Primary data saved (1975 records). [2025-09-19T19:41:34.429110] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-19T19:41:34.429216] [INFO ] [MAIN ] Update Progress: 1217/2372 symbols completed. KORE took 23.9s. Estimated remaining: 2h 33m 17s. Rate: 7.5 symbols/min [2025-09-19T19:41:34.605522] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:34.644687] [DEBUG] [LOCAL ] KREF: Loaded 37241 existing records from primary storage. [2025-09-19T19:41:34.644837] [INFO ] [MAIN ] KREF: Loaded 37241 existing records. [2025-09-19T19:41:34.827884] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:34.828384] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-19T19:41:34.828557] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-19T19:41:34.829700] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-19T19:41:34.829783] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-19T19:41:35.024572] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T19:41:35.063395] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-19T19:41:35.246183] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:35.843291] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-19T19:41:36.417768] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:41:36.543167] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T19:41:36.643232] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-19T19:41:37.443266] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-19T19:41:37.939383] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T19:41:38.243281] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-19T19:41:38.525072] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T19:41:38.910086] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-19T19:41:39.043295] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-19T19:41:39.843288] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-19T19:41:40.338480] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T19:41:40.643415] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-19T19:41:41.285694] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T19:41:41.443272] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-19T19:41:41.501898] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T19:41:41.510093] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-09-19T19:41:41.510259] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-19T19:41:41.934059] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-19T19:41:41.934153] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-19T19:41:41.935206] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-19T19:41:41.935272] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-19T19:41:41.936833] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 54462 (keeping 200 days of data) [2025-09-19T19:41:42.259442] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-19T19:41:42.289793] [DEBUG] [LOCAL ] KR: Primary data saved (54462 records). [2025-09-19T19:41:42.289958] [INFO ] [MAIN ] KR: Full history saved. [2025-09-19T19:41:42.290138] [INFO ] [MAIN ] Update Progress: 1218/2372 symbols completed. KR took 27.1s. Estimated remaining: 2h 33m 8s. Rate: 7.5 symbols/min [2025-09-19T19:41:42.474230] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:42.522174] [DEBUG] [LOCAL ] KRG: Loaded 49537 existing records from primary storage. [2025-09-19T19:41:42.522335] [INFO ] [MAIN ] KRG: Loaded 49537 existing records. [2025-09-19T19:41:42.721509] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:42.721942] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-19T19:41:42.722084] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-19T19:41:42.723500] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-19T19:41:42.723624] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-19T19:41:42.875149] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T19:41:43.052471] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-19T19:41:43.168244] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:43.186276] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:41:43.651803] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T19:41:43.843252] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-19T19:41:44.643288] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-19T19:41:45.284097] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T19:41:45.443315] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-19T19:41:45.772353] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T19:41:46.243267] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-19T19:41:46.458004] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T19:41:47.053989] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-19T19:41:47.056985] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T19:41:47.725524] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T19:41:47.843278] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-19T19:41:48.643284] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-19T19:41:49.109367] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T19:41:49.443270] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-19T19:41:49.720302] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T19:41:50.243265] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-19T19:41:50.596338] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:41:51.043266] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-19T19:41:51.187319] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T19:41:51.843300] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-19T19:41:51.918594] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:41:52.317309] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T19:41:52.643260] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-19T19:41:53.443237] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-19T19:41:53.482760] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T19:41:53.491077] [INFO ] [REMOTE ] KOS: Full fetch complete (76834 records). [2025-09-19T19:41:53.491320] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-19T19:41:53.897739] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-19T19:41:53.897830] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-19T19:41:53.898820] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-19T19:41:53.898910] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-19T19:41:53.901049] [DEBUG] [LOCAL ] KOS: Trimmed 76834 records to 53842 (keeping 200 days of data) [2025-09-19T19:41:54.225796] [DEBUG] [LOCAL ] KOS: Primary data saved (53842 records). [2025-09-19T19:41:54.225965] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-19T19:41:54.226449] [INFO ] [MAIN ] Update Progress: 1219/2372 symbols completed. KOS took 40.1s. Estimated remaining: 2h 33m 4s. Rate: 7.5 symbols/min [2025-09-19T19:41:54.251682] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-19T19:41:54.402372] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:54.402582] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-19T19:41:54.402722] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-19T19:41:54.403081] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-19T19:41:54.403255] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-19T19:41:54.403378] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-19T19:41:54.403731] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-19T19:41:54.809402] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:54.812110] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T19:41:55.043231] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-19T19:41:55.123801] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T19:41:55.843226] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-19T19:41:56.519326] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T19:41:56.529289] [INFO ] [REMOTE ] KRC: Full fetch complete (69546 records). [2025-09-19T19:41:56.529455] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-19T19:41:56.648406] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-19T19:41:56.917367] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-19T19:41:56.917581] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-19T19:41:56.918716] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-19T19:41:56.918829] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-19T19:41:56.922274] [DEBUG] [LOCAL ] KRC: Trimmed 69546 records to 49159 (keeping 200 days of data) [2025-09-19T19:41:56.994586] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:41:57.033000] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-19T19:41:57.074393] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T19:41:57.290623] [DEBUG] [LOCAL ] KRC: Primary data saved (49159 records). [2025-09-19T19:41:57.290942] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-19T19:41:57.291066] [INFO ] [MAIN ] Update Progress: 1220/2372 symbols completed. KRC took 36.8s. Estimated remaining: 2h 32m 52s. Rate: 7.5 symbols/min [2025-09-19T19:41:57.455198] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-19T19:41:57.458381] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:57.488048] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:41:57.517738] [DEBUG] [LOCAL ] KRO: Loaded 25967 existing records from primary storage. [2025-09-19T19:41:57.517886] [INFO ] [MAIN ] KRO: Loaded 25967 existing records. [2025-09-19T19:41:57.696795] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:57.697100] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-19T19:41:57.697150] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-19T19:41:57.698120] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-19T19:41:57.698181] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-19T19:41:57.730540] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:41:57.768335] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-19T19:41:58.060956] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:58.243265] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-19T19:41:59.043260] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-19T19:41:59.843286] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-19T19:41:59.938626] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T19:42:00.643238] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-19T19:42:01.176583] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T19:42:01.218391] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T19:42:01.443262] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-19T19:42:02.036000] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T19:42:02.243266] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-19T19:42:03.043264] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-19T19:42:03.843268] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-19T19:42:05.102865] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-19T19:42:05.111071] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-19T19:42:06.029817] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (4.59 seconds). [2025-09-19T19:42:06.040177] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-19T19:42:06.156260] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-19T19:42:06.243269] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-19T19:42:06.348065] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T19:42:06.928166] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (3.08 seconds). [2025-09-19T19:42:06.934111] [INFO ] [REMOTE ] KREF: Full fetch complete (51638 records). [2025-09-19T19:42:06.934235] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-19T19:42:07.048430] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-19T19:42:07.336919] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-19T19:42:07.337025] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-19T19:42:07.337825] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-19T19:42:07.337889] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-19T19:42:07.339408] [DEBUG] [LOCAL ] KREF: Trimmed 51638 records to 37539 (keeping 200 days of data) [2025-09-19T19:42:07.587737] [DEBUG] [LOCAL ] KREF: Primary data saved (37539 records). [2025-09-19T19:42:07.587947] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-19T19:42:07.588091] [INFO ] [MAIN ] Update Progress: 1221/2372 symbols completed. KREF took 33.2s. Estimated remaining: 2h 32m 46s. Rate: 7.5 symbols/min [2025-09-19T19:42:07.790711] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:07.840029] [DEBUG] [LOCAL ] KRP: Loaded 38364 existing records from primary storage. [2025-09-19T19:42:07.840207] [INFO ] [MAIN ] KRP: Loaded 38364 existing records. [2025-09-19T19:42:08.030190] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:08.030636] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-19T19:42:08.031177] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-19T19:42:08.047928] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-19T19:42:08.058848] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-19T19:42:08.121224] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T19:42:08.207293] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-19T19:42:08.421709] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T19:42:08.447379] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T19:42:08.508750] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:08.643264] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-19T19:42:09.443289] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-19T19:42:09.996834] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:42:10.243302] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-19T19:42:10.452046] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T19:42:11.043276] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-19T19:42:11.085103] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T19:42:11.843262] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-19T19:42:11.938042] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T19:42:12.643312] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-19T19:42:13.030363] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:42:13.037792] [INFO ] [REMOTE ] KRG: Full fetch complete (70899 records). [2025-09-19T19:42:13.037949] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-19T19:42:13.423712] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-19T19:42:13.423823] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-19T19:42:13.424778] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-19T19:42:13.424844] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-19T19:42:13.427340] [DEBUG] [LOCAL ] KRG: Trimmed 70899 records to 49895 (keeping 200 days of data) [2025-09-19T19:42:13.443286] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-19T19:42:13.756933] [DEBUG] [LOCAL ] KRG: Primary data saved (49895 records). [2025-09-19T19:42:13.757129] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-19T19:42:13.757295] [INFO ] [MAIN ] Update Progress: 1222/2372 symbols completed. KRG took 31.5s. Estimated remaining: 2h 32m 36s. Rate: 7.5 symbols/min [2025-09-19T19:42:13.926060] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:13.984558] [DEBUG] [LOCAL ] KSS: Loaded 54002 existing records from primary storage. [2025-09-19T19:42:13.984760] [INFO ] [MAIN ] KSS: Loaded 54002 existing records. [2025-09-19T19:42:14.163579] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:14.163923] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-19T19:42:14.164070] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-19T19:42:14.165801] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-19T19:42:14.165868] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-19T19:42:14.497021] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T19:42:14.568714] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-19T19:42:14.597986] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:15.043320] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-19T19:42:15.193442] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-19T19:42:15.843352] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-19T19:42:15.966196] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-19T19:42:16.656197] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-19T19:42:16.663073] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T19:42:16.775107] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T19:42:17.443243] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-19T19:42:17.494106] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T19:42:17.972692] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T19:42:18.243324] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-19T19:42:19.043359] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-19T19:42:19.551734] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T19:42:19.843268] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-19T19:42:20.035133] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T19:42:20.643308] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-19T19:42:21.184711] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T19:42:21.443245] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-19T19:42:21.557478] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T19:42:22.224216] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T19:42:22.243224] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-19T19:42:22.314414] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-19T19:42:23.043266] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-19T19:42:23.843258] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-19T19:42:23.924616] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T19:42:24.370818] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:42:24.643262] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-19T19:42:25.443300] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-19T19:42:26.139475] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T19:42:26.243311] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-19T19:42:26.389344] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:42:26.843954] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T19:42:26.851858] [INFO ] [REMOTE ] KRMN: Full fetch complete (48832 records). [2025-09-19T19:42:26.852038] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-19T19:42:27.043675] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-19T19:42:27.058732] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 151 unique days, need 200 days [2025-09-19T19:42:27.059581] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:42:27.059693] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:42:27.059798] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-19T19:42:27.059962] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-19T19:42:27.060033] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-19T19:42:27.060124] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-19T19:42:27.060265] [INFO ] [MAIN ] Update Progress: 1223/2372 symbols completed. KRMN took 32.8s. Estimated remaining: 2h 32m 33s. Rate: 7.5 symbols/min [2025-09-19T19:42:27.284987] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:27.349691] [DEBUG] [LOCAL ] KT: Loaded 46030 existing records from primary storage. [2025-09-19T19:42:27.349908] [INFO ] [MAIN ] KT: Loaded 46030 existing records. [2025-09-19T19:42:27.536267] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:27.536713] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-19T19:42:27.536836] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-19T19:42:27.538391] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-19T19:42:27.538455] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-19T19:42:27.852105] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-19T19:42:27.941353] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:28.595451] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T19:42:28.622141] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T19:42:28.627068] [INFO ] [REMOTE ] KRO: Full fetch complete (34701 records). [2025-09-19T19:42:28.627205] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-19T19:42:28.649330] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-19T19:42:29.034627] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-19T19:42:29.034769] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-19T19:42:29.035578] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-19T19:42:29.035677] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-19T19:42:29.036810] [DEBUG] [LOCAL ] KRO: Trimmed 34701 records to 26145 (keeping 200 days of data) [2025-09-19T19:42:29.198216] [DEBUG] [LOCAL ] KRO: Primary data saved (26145 records). [2025-09-19T19:42:29.198373] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-19T19:42:29.198462] [INFO ] [MAIN ] Update Progress: 1224/2372 symbols completed. KRO took 31.9s. Estimated remaining: 2h 32m 20s. Rate: 7.5 symbols/min [2025-09-19T19:42:29.428118] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:29.452559] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-19T19:42:29.455460] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T19:42:29.498740] [DEBUG] [LOCAL ] KTB: Loaded 41629 existing records from primary storage. [2025-09-19T19:42:29.498889] [INFO ] [MAIN ] KTB: Loaded 41629 existing records. [2025-09-19T19:42:29.678845] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:29.679229] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-19T19:42:29.679292] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-19T19:42:29.680223] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-19T19:42:29.680287] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-19T19:42:30.046530] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:30.243275] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-19T19:42:31.020398] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-19T19:42:31.043220] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-19T19:42:31.305571] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T19:42:31.849181] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-19T19:42:31.863217] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:42:32.643326] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-19T19:42:33.060846] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T19:42:33.443280] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-19T19:42:33.694375] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T19:42:34.238222] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:42:34.245923] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-19T19:42:35.043235] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-19T19:42:35.283437] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T19:42:35.843269] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-19T19:42:35.931682] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T19:42:36.643278] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-19T19:42:37.056115] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T19:42:37.443308] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-19T19:42:37.813558] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T19:42:38.243361] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-19T19:42:38.398871] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:42:39.049486] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-19T19:42:39.056426] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T19:42:39.843271] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-19T19:42:40.584786] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T19:42:40.593306] [INFO ] [REMOTE ] KSS: Full fetch complete (77643 records). [2025-09-19T19:42:40.593459] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-19T19:42:40.659611] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-19T19:42:41.020482] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-19T19:42:41.020594] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-19T19:42:41.021620] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-19T19:42:41.021717] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-19T19:42:41.023279] [DEBUG] [LOCAL ] KSS: Trimmed 77643 records to 54391 (keeping 200 days of data) [2025-09-19T19:42:41.278850] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T19:42:41.394128] [DEBUG] [LOCAL ] KSS: Primary data saved (54391 records). [2025-09-19T19:42:41.394287] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-19T19:42:41.394377] [INFO ] [MAIN ] Update Progress: 1225/2372 symbols completed. KSS took 27.6s. Estimated remaining: 2h 32m 16s. Rate: 7.5 symbols/min [2025-09-19T19:42:41.453547] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-19T19:42:41.591839] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:41.608524] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T19:42:41.614597] [INFO ] [REMOTE ] KRP: Full fetch complete (54876 records). [2025-09-19T19:42:41.614897] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-19T19:42:41.733688] [DEBUG] [LOCAL ] KTF: Loaded 13268 existing records from primary storage. [2025-09-19T19:42:41.733899] [INFO ] [MAIN ] KTF: Loaded 13268 existing records. [2025-09-19T19:42:42.143676] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:42.183857] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-19T19:42:42.215499] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-19T19:42:42.229173] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-19T19:42:42.229315] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-19T19:42:42.230313] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-19T19:42:42.230262] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-19T19:42:42.230412] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-19T19:42:42.230553] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-19T19:42:42.339317] [DEBUG] [LOCAL ] KRP: Trimmed 54876 records to 38635 (keeping 200 days of data) [2025-09-19T19:42:42.721834] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:42.724690] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-19T19:42:42.769727] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:42:42.927458] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T19:42:42.945290] [DEBUG] [LOCAL ] KRP: Primary data saved (38635 records). [2025-09-19T19:42:42.945419] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-19T19:42:42.945498] [INFO ] [MAIN ] Update Progress: 1226/2372 symbols completed. KRP took 35.4s. Estimated remaining: 2h 32m 2s. Rate: 7.5 symbols/min [2025-09-19T19:42:43.048445] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-19T19:42:43.127241] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:43.127446] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-19T19:42:43.127484] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-19T19:42:43.127632] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-19T19:42:43.127732] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-19T19:42:43.127802] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-19T19:42:43.127839] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-19T19:42:43.511831] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:43.843266] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-19T19:42:43.857420] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T19:42:44.643263] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-19T19:42:44.800995] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T19:42:45.104219] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T19:42:45.443279] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-19T19:42:45.575884] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T19:42:46.243299] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-19T19:42:47.043272] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-19T19:42:47.218323] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:42:47.557963] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-19T19:42:47.843266] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-19T19:42:48.071154] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T19:42:48.643277] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-19T19:42:49.443270] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-19T19:42:49.471150] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T19:42:50.202364] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T19:42:50.243237] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-19T19:42:50.558149] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T19:42:51.043288] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-19T19:42:51.610801] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T19:42:51.843271] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-19T19:42:52.182562] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T19:42:52.643284] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-19T19:42:53.443279] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-19T19:42:53.555326] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T19:42:53.604835] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T19:42:54.243268] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-19T19:42:54.746938] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T19:42:55.021336] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T19:42:55.043235] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-19T19:42:55.843303] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-19T19:42:56.171330] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T19:42:56.643268] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-19T19:42:57.443286] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-19T19:42:57.546491] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:42:57.801172] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-19T19:42:58.243302] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-19T19:42:58.573533] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T19:42:58.580593] [INFO ] [REMOTE ] KT: Full fetch complete (66886 records). [2025-09-19T19:42:58.580739] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-19T19:42:58.978752] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-19T19:42:58.978868] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-19T19:42:58.979804] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-19T19:42:58.979867] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-19T19:42:58.981198] [DEBUG] [LOCAL ] KT: Trimmed 66886 records to 46373 (keeping 200 days of data) [2025-09-19T19:42:59.046060] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-19T19:42:59.208313] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T19:42:59.283533] [DEBUG] [LOCAL ] KT: Primary data saved (46373 records). [2025-09-19T19:42:59.283703] [INFO ] [MAIN ] KT: Full history saved. [2025-09-19T19:42:59.284417] [INFO ] [MAIN ] Update Progress: 1227/2372 symbols completed. KT took 32.2s. Estimated remaining: 2h 32m 2s. Rate: 7.5 symbols/min [2025-09-19T19:42:59.465127] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:59.524386] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-09-19T19:42:59.524545] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-09-19T19:42:59.703453] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:59.703749] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-19T19:42:59.703805] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-19T19:42:59.705153] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-19T19:42:59.705217] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-19T19:42:59.848373] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-19T19:43:00.075431] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:00.512764] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-19T19:43:00.643277] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-19T19:43:00.810104] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T19:43:00.815873] [INFO ] [REMOTE ] KTB: Full fetch complete (57368 records). [2025-09-19T19:43:00.815980] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-19T19:43:01.200244] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-19T19:43:01.200333] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-19T19:43:01.201161] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-19T19:43:01.201225] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-19T19:43:01.202414] [DEBUG] [LOCAL ] KTB: Trimmed 57368 records to 41933 (keeping 200 days of data) [2025-09-19T19:43:01.443623] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-19T19:43:01.465480] [DEBUG] [LOCAL ] KTB: Primary data saved (41933 records). [2025-09-19T19:43:01.465595] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-19T19:43:01.465698] [INFO ] [MAIN ] Update Progress: 1228/2372 symbols completed. KTB took 32.3s. Estimated remaining: 2h 31m 48s. Rate: 7.5 symbols/min [2025-09-19T19:43:01.643637] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:01.700266] [DEBUG] [LOCAL ] KVYO: Loaded 50181 existing records from primary storage. [2025-09-19T19:43:01.700430] [INFO ] [MAIN ] KVYO: Loaded 50181 existing records. [2025-09-19T19:43:01.899384] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:01.899731] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-19T19:43:01.899788] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-19T19:43:01.900882] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-19T19:43:01.900943] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-19T19:43:02.248376] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-19T19:43:02.294426] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:02.724876] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T19:43:02.793528] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T19:43:02.822117] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T19:43:03.043274] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-19T19:43:03.843268] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-19T19:43:04.367171] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-19T19:43:04.643309] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-19T19:43:05.006003] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T19:43:05.443309] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-19T19:43:05.622408] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T19:43:06.160144] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T19:43:06.243229] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-19T19:43:07.043240] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-19T19:43:07.124472] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:43:07.125761] [INFO ] [REMOTE ] KUKE: Full fetch complete (7942 records). [2025-09-19T19:43:07.125836] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-19T19:43:07.306789] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T19:43:07.307032] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:43:07.307098] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:43:07.307146] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-19T19:43:07.307202] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-19T19:43:07.307246] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-19T19:43:07.307284] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-19T19:43:07.307362] [INFO ] [MAIN ] Update Progress: 1229/2372 symbols completed. KUKE took 24.4s. Estimated remaining: 2h 31m 38s. Rate: 7.5 symbols/min [2025-09-19T19:43:07.482490] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:07.519850] [DEBUG] [LOCAL ] KW: Loaded 40949 existing records from primary storage. [2025-09-19T19:43:07.519989] [INFO ] [MAIN ] KW: Loaded 40949 existing records. [2025-09-19T19:43:07.712882] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:07.713217] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-19T19:43:07.713279] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-19T19:43:07.714206] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-19T19:43:07.714268] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-19T19:43:07.848360] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-19T19:43:08.099461] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:08.643252] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-19T19:43:08.854316] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T19:43:09.053231] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T19:43:09.443272] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-19T19:43:10.243289] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-19T19:43:10.591672] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T19:43:11.043339] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-19T19:43:11.482473] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T19:43:11.578741] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T19:43:11.843306] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-19T19:43:12.643297] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-19T19:43:12.832227] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T19:43:13.443238] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-19T19:43:13.491244] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T19:43:14.122300] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T19:43:14.125268] [INFO ] [REMOTE ] KTF: Full fetch complete (18396 records). [2025-09-19T19:43:14.125371] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-19T19:43:14.248399] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-19T19:43:14.501881] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-19T19:43:14.501974] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-19T19:43:14.502362] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-19T19:43:14.502402] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-19T19:43:14.503029] [DEBUG] [LOCAL ] KTF: Trimmed 18396 records to 13320 (keeping 200 days of data) [2025-09-19T19:43:14.584846] [DEBUG] [LOCAL ] KTF: Primary data saved (13320 records). [2025-09-19T19:43:14.584980] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-19T19:43:14.585083] [INFO ] [MAIN ] Update Progress: 1230/2372 symbols completed. KTF took 33.2s. Estimated remaining: 2h 31m 30s. Rate: 7.5 symbols/min [2025-09-19T19:43:14.760143] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:14.793709] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-19T19:43:14.817517] [DEBUG] [LOCAL ] KWR: Loaded 17058 existing records from primary storage. [2025-09-19T19:43:14.817688] [INFO ] [MAIN ] KWR: Loaded 17058 existing records. [2025-09-19T19:43:14.996494] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:14.996841] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-19T19:43:14.996924] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-19T19:43:14.997464] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-19T19:43:14.997527] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-19T19:43:15.052739] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-19T19:43:15.359783] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:15.843279] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-19T19:43:16.112389] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:43:16.643285] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-19T19:43:16.743696] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T19:43:17.443239] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-19T19:43:17.633865] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T19:43:18.018967] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T19:43:18.243262] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-19T19:43:19.043293] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-19T19:43:19.128415] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:43:19.427873] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T19:43:19.843317] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-19T19:43:20.643324] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-19T19:43:20.833312] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T19:43:21.033123] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T19:43:21.443313] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-19T19:43:22.169004] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T19:43:22.235268] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T19:43:22.243220] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-19T19:43:23.043273] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-19T19:43:23.843278] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-19T19:43:24.433795] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T19:43:24.643259] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-19T19:43:24.925542] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T19:43:25.038518] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T19:43:25.443286] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-19T19:43:26.098106] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T19:43:26.243263] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-19T19:43:27.043313] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-19T19:43:27.506771] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T19:43:27.717397] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:43:27.843282] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-19T19:43:28.643256] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-19T19:43:29.275460] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T19:43:29.443272] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-19T19:43:29.886162] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T19:43:30.111966] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T19:43:30.120968] [INFO ] [REMOTE ] KVUE: Full fetch complete (77669 records). [2025-09-19T19:43:30.121178] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-19T19:43:30.248608] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-19T19:43:30.660448] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-19T19:43:30.660610] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-19T19:43:30.662125] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-19T19:43:30.662217] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-19T19:43:30.664736] [DEBUG] [LOCAL ] KVUE: Trimmed 77669 records to 54447 (keeping 200 days of data) [2025-09-19T19:43:31.044041] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-19T19:43:31.071558] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-09-19T19:43:31.071827] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-19T19:43:31.071954] [INFO ] [MAIN ] Update Progress: 1231/2372 symbols completed. KVUE took 31.8s. Estimated remaining: 2h 31m 30s. Rate: 7.5 symbols/min [2025-09-19T19:43:31.274206] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:31.303286] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T19:43:31.342671] [DEBUG] [LOCAL ] KYN: Loaded 30666 existing records from primary storage. [2025-09-19T19:43:31.342852] [INFO ] [MAIN ] KYN: Loaded 30666 existing records. [2025-09-19T19:43:31.542172] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:31.542501] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-19T19:43:31.542566] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-19T19:43:31.543578] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-19T19:43:31.543665] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-19T19:43:31.853403] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-19T19:43:31.910509] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:31.942559] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:43:32.593010] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:43:32.643240] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-19T19:43:33.443288] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-19T19:43:33.731130] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T19:43:34.243283] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-19T19:43:34.462609] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T19:43:35.043312] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-19T19:43:35.153395] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:43:35.644816] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T19:43:35.843275] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-19T19:43:36.261492] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T19:43:36.643278] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-19T19:43:37.368097] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T19:43:37.443272] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-19T19:43:37.712697] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T19:43:37.715146] [INFO ] [REMOTE ] KWR: Full fetch complete (24031 records). [2025-09-19T19:43:37.715224] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-19T19:43:38.119084] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-19T19:43:38.119165] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-19T19:43:38.119694] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-19T19:43:38.119767] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-19T19:43:38.120472] [DEBUG] [LOCAL ] KWR: Trimmed 24031 records to 17129 (keeping 200 days of data) [2025-09-19T19:43:38.226587] [DEBUG] [LOCAL ] KWR: Primary data saved (17129 records). [2025-09-19T19:43:38.226764] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-19T19:43:38.226870] [INFO ] [MAIN ] Update Progress: 1232/2372 symbols completed. KWR took 23.6s. Estimated remaining: 2h 31m 21s. Rate: 7.5 symbols/min [2025-09-19T19:43:38.248542] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-19T19:43:38.400239] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:38.439239] [DEBUG] [LOCAL ] L: Loaded 41224 existing records from primary storage. [2025-09-19T19:43:38.439442] [INFO ] [MAIN ] L: Loaded 41224 existing records. [2025-09-19T19:43:38.635577] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:38.635885] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-19T19:43:38.635944] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-19T19:43:38.637273] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-19T19:43:38.637344] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-19T19:43:39.042668] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:39.043217] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-19T19:43:39.073506] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:43:39.843334] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-19T19:43:40.214599] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:43:40.225694] [INFO ] [REMOTE ] KVYO: Full fetch complete (71282 records). [2025-09-19T19:43:40.225999] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-19T19:43:40.646856] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-19T19:43:40.647270] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-19T19:43:40.647623] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-19T19:43:40.649493] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-19T19:43:40.649579] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-19T19:43:40.651681] [DEBUG] [LOCAL ] KVYO: Trimmed 71282 records to 50569 (keeping 200 days of data) [2025-09-19T19:43:40.899166] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:43:41.012297] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:43:41.040366] [DEBUG] [LOCAL ] KVYO: Primary data saved (50569 records). [2025-09-19T19:43:41.040523] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-19T19:43:41.040629] [INFO ] [MAIN ] Update Progress: 1233/2372 symbols completed. KVYO took 39.6s. Estimated remaining: 2h 31m 8s. Rate: 7.5 symbols/min [2025-09-19T19:43:41.225518] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:41.275556] [DEBUG] [LOCAL ] LAC: Loaded 52671 existing records from primary storage. [2025-09-19T19:43:41.275762] [INFO ] [MAIN ] LAC: Loaded 52671 existing records. [2025-09-19T19:43:41.459079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-19T19:43:41.465671] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:41.466571] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-19T19:43:41.466623] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-19T19:43:41.468181] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-19T19:43:41.468259] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-19T19:43:41.823482] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:41.970697] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T19:43:42.243267] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-19T19:43:43.043256] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-19T19:43:43.277243] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T19:43:43.381743] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T19:43:43.843271] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-19T19:43:44.643321] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-19T19:43:44.856221] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:43:44.862055] [INFO ] [REMOTE ] KW: Full fetch complete (56759 records). [2025-09-19T19:43:44.862162] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-19T19:43:45.294749] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-19T19:43:45.294925] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-19T19:43:45.295886] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-19T19:43:45.295964] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-19T19:43:45.297682] [DEBUG] [LOCAL ] KW: Trimmed 56759 records to 41246 (keeping 200 days of data) [2025-09-19T19:43:45.471342] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-19T19:43:45.549321] [DEBUG] [LOCAL ] KW: Primary data saved (41246 records). [2025-09-19T19:43:45.549444] [INFO ] [MAIN ] KW: Full history saved. [2025-09-19T19:43:45.549599] [INFO ] [MAIN ] Update Progress: 1234/2372 symbols completed. KW took 38.2s. Estimated remaining: 2h 30m 57s. Rate: 7.5 symbols/min [2025-09-19T19:43:45.742339] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:45.767911] [DEBUG] [LOCAL ] LAD: Loaded 24252 existing records from primary storage. [2025-09-19T19:43:45.768046] [INFO ] [MAIN ] LAD: Loaded 24252 existing records. [2025-09-19T19:43:45.971129] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:45.971476] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-19T19:43:45.971552] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-19T19:43:45.972237] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-19T19:43:45.972311] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-19T19:43:46.334185] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:46.334675] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-19T19:43:46.392197] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-19T19:43:46.409058] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T19:43:47.043245] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-19T19:43:47.086855] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:43:47.843275] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-19T19:43:47.906348] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-19T19:43:48.643245] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-19T19:43:49.190421] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T19:43:49.443264] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-19T19:43:49.597447] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:43:50.066452] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T19:43:50.243254] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-19T19:43:51.043315] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-19T19:43:51.154512] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T19:43:51.843264] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-19T19:43:52.138194] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T19:43:52.524688] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T19:43:52.643261] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-19T19:43:53.443248] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-19T19:43:53.948799] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:43:54.243233] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-19T19:43:54.415085] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:43:55.043286] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-19T19:43:55.122150] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T19:43:55.843240] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-19T19:43:56.482005] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:43:56.568951] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T19:43:56.643224] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-19T19:43:57.443274] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-19T19:43:57.567539] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T19:43:58.243312] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-19T19:43:58.866279] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T19:43:58.989571] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:43:59.043226] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-19T19:43:59.843283] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-19T19:44:00.040155] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T19:44:00.552043] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T19:44:00.643257] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-19T19:44:01.443297] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-19T19:44:01.489965] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:44:01.639720] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T19:44:01.644576] [INFO ] [REMOTE ] KYN: Full fetch complete (45200 records). [2025-09-19T19:44:01.644760] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-19T19:44:02.048075] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-19T19:44:02.048211] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-19T19:44:02.049122] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-19T19:44:02.049220] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-19T19:44:02.050539] [DEBUG] [LOCAL ] KYN: Trimmed 45200 records to 30875 (keeping 200 days of data) [2025-09-19T19:44:02.246496] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-19T19:44:02.266384] [DEBUG] [LOCAL ] KYN: Primary data saved (30875 records). [2025-09-19T19:44:02.266570] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-19T19:44:02.266782] [INFO ] [MAIN ] Update Progress: 1235/2372 symbols completed. KYN took 31.2s. Estimated remaining: 2h 30m 57s. Rate: 7.5 symbols/min [2025-09-19T19:44:02.468319] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:02.521340] [DEBUG] [LOCAL ] LADR: Loaded 38963 existing records from primary storage. [2025-09-19T19:44:02.522169] [INFO ] [MAIN ] LADR: Loaded 38963 existing records. [2025-09-19T19:44:02.707406] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:02.707913] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-19T19:44:02.707983] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-19T19:44:02.709093] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-19T19:44:02.709167] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-19T19:44:03.062579] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-19T19:44:03.067865] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:03.213787] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T19:44:03.843247] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-19T19:44:03.958881] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T19:44:04.643335] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-19T19:44:05.081309] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T19:44:05.163170] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T19:44:05.443282] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-19T19:44:05.918887] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T19:44:06.243304] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-19T19:44:06.800986] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T19:44:06.808876] [INFO ] [REMOTE ] L: Full fetch complete (59458 records). [2025-09-19T19:44:06.809051] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-19T19:44:07.055391] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-19T19:44:07.234619] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-19T19:44:07.234737] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-19T19:44:07.235668] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-19T19:44:07.235731] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-19T19:44:07.236982] [DEBUG] [LOCAL ] L: Trimmed 59458 records to 41511 (keeping 200 days of data) [2025-09-19T19:44:07.507165] [DEBUG] [LOCAL ] L: Primary data saved (41511 records). [2025-09-19T19:44:07.507302] [INFO ] [MAIN ] L: Full history saved. [2025-09-19T19:44:07.507426] [INFO ] [MAIN ] Update Progress: 1236/2372 symbols completed. L took 29.3s. Estimated remaining: 2h 30m 47s. Rate: 7.5 symbols/min [2025-09-19T19:44:07.687501] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:07.693938] [DEBUG] [LOCAL ] LANV: Loaded 2666 existing records from primary storage. [2025-09-19T19:44:07.694049] [INFO ] [MAIN ] LANV: Loaded 2666 existing records. [2025-09-19T19:44:07.850687] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-19T19:44:07.894374] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:07.895766] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-19T19:44:07.895855] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-19T19:44:07.896215] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-19T19:44:07.896287] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-19T19:44:08.252876] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T19:44:08.300968] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:08.643284] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-19T19:44:09.235312] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:44:09.346789] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T19:44:09.443275] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-19T19:44:09.523385] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-19T19:44:10.107984] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T19:44:10.243347] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-19T19:44:11.043311] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-19T19:44:11.843288] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-19T19:44:12.442175] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T19:44:12.643240] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-19T19:44:12.766004] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T19:44:12.962985] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T19:44:13.443279] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-19T19:44:14.243286] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-19T19:44:14.790273] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T19:44:14.804865] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T19:44:14.806122] [INFO ] [REMOTE ] LAC: Full fetch complete (75958 records). [2025-09-19T19:44:14.806450] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-19T19:44:15.048356] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-19T19:44:15.238706] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-19T19:44:15.238915] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-19T19:44:15.240081] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-19T19:44:15.240289] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-19T19:44:15.242594] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T19:44:15.252257] [DEBUG] [LOCAL ] LAC: Trimmed 75958 records to 53062 (keeping 200 days of data) [2025-09-19T19:44:15.487716] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-19T19:44:15.584830] [DEBUG] [LOCAL ] LAC: Primary data saved (53062 records). [2025-09-19T19:44:15.584976] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-19T19:44:15.585095] [INFO ] [MAIN ] Update Progress: 1237/2372 symbols completed. LAC took 34.5s. Estimated remaining: 2h 30m 39s. Rate: 7.5 symbols/min [2025-09-19T19:44:15.843308] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-19T19:44:16.643272] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-19T19:44:17.054521] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-19T19:44:17.207890] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T19:44:17.443269] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-19T19:44:17.946116] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T19:44:18.243320] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-19T19:44:18.777310] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-19T19:44:19.043261] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-19T19:44:19.843259] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-19T19:44:20.352583] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T19:44:20.356108] [INFO ] [REMOTE ] LAD: Full fetch complete (35342 records). [2025-09-19T19:44:20.356308] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-19T19:44:20.648968] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-19T19:44:20.745089] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-19T19:44:20.745183] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-19T19:44:20.745886] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-19T19:44:20.745948] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-19T19:44:20.746929] [DEBUG] [LOCAL ] LAD: Trimmed 35342 records to 24380 (keeping 200 days of data) [2025-09-19T19:44:20.915464] [DEBUG] [LOCAL ] LAD: Primary data saved (24380 records). [2025-09-19T19:44:20.915607] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-19T19:44:20.915732] [INFO ] [MAIN ] Update Progress: 1238/2372 symbols completed. LAD took 35.4s. Estimated remaining: 2h 30m 29s. Rate: 7.5 symbols/min [2025-09-19T19:44:21.210347] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:44:21.248824] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T19:44:21.443327] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-19T19:44:22.128253] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T19:44:22.243315] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-19T19:44:23.043311] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-19T19:44:23.100911] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:44:23.102878] [INFO ] [REMOTE ] LANV: Full fetch complete (4336 records). [2025-09-19T19:44:23.102988] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-19T19:44:23.662498] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-19T19:44:23.662706] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-19T19:44:23.663014] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-19T19:44:23.663092] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-19T19:44:23.663975] [DEBUG] [LOCAL ] LANV: Trimmed 4336 records to 2699 (keeping 200 days of data) [2025-09-19T19:44:23.682912] [DEBUG] [LOCAL ] LANV: Primary data saved (2699 records). [2025-09-19T19:44:23.683054] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-19T19:44:23.683159] [INFO ] [MAIN ] Update Progress: 1239/2372 symbols completed. LANV took 16.2s. Estimated remaining: 2h 30m 16s. Rate: 7.5 symbols/min [2025-09-19T19:44:24.922838] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:44:24.930625] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-19T19:44:26.466397] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T19:44:26.474351] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-19T19:44:28.167189] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T19:44:28.176383] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-19T19:44:29.746778] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T19:44:29.754859] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-19T19:44:31.650544] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T19:44:31.656882] [INFO ] [REMOTE ] LADR: Full fetch complete (54903 records). [2025-09-19T19:44:31.657030] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-19T19:44:32.071845] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-19T19:44:32.071978] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-19T19:44:32.073044] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-19T19:44:32.073136] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-19T19:44:32.074807] [DEBUG] [LOCAL ] LADR: Trimmed 54903 records to 39244 (keeping 200 days of data) [2025-09-19T19:44:32.318283] [DEBUG] [LOCAL ] LADR: Primary data saved (39244 records). [2025-09-19T19:44:32.318431] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-19T19:44:32.319825] [INFO ] [MAIN ] Update Progress: 1240/2372 symbols completed. LADR took 30.1s. Estimated remaining: 2h 30m 9s. Rate: 7.5 symbols/min [2025-09-19T19:44:32.985768] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:33.023019] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:33.066019] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-19T19:44:33.065442] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:33.066202] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-19T19:44:33.046229] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:33.066680] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-19T19:44:33.066803] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-19T19:44:33.067886] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-19T19:44:33.073560] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-19T19:44:33.194897] [DEBUG] [LOCAL ] LAW: Loaded 13988 existing records from primary storage. [2025-09-19T19:44:33.195272] [INFO ] [MAIN ] LAW: Loaded 13988 existing records. [2025-09-19T19:44:33.503709] [DEBUG] [LOCAL ] LAZ: Loaded 45782 existing records from primary storage. [2025-09-19T19:44:33.524251] [INFO ] [MAIN ] LAZ: Loaded 45782 existing records. [2025-09-19T19:44:33.561468] [DEBUG] [LOCAL ] LB: Loaded 38177 existing records from primary storage. [2025-09-19T19:44:33.666815] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:33.658137] [INFO ] [MAIN ] LB: Loaded 38177 existing records. [2025-09-19T19:44:33.786392] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-19T19:44:33.848050] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-19T19:44:33.872486] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:33.883176] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-19T19:44:33.890581] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-19T19:44:33.927823] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-19T19:44:34.105422] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:34.137619] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-19T19:44:34.163133] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-19T19:44:34.220881] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-19T19:44:34.228483] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:34.228586] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-19T19:44:34.249790] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:44:34.281187] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-19T19:44:34.275749] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-19T19:44:34.311740] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-19T19:44:34.358184] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-19T19:44:34.363797] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-19T19:44:34.312256] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-19T19:44:35.096906] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:35.128126] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-19T19:44:35.213056] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:35.224580] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-19T19:44:35.306785] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:35.307150] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-19T19:44:35.419321] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T19:44:35.422447] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-19T19:44:36.377002] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:44:36.380940] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-19T19:44:37.141972] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T19:44:37.150960] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-19T19:44:37.227479] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T19:44:37.236397] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-19T19:44:37.264726] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T19:44:37.274222] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-19T19:44:37.339841] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T19:44:37.343412] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-19T19:44:38.472187] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T19:44:38.476217] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-19T19:44:38.887959] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T19:44:38.897133] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-19T19:44:38.934997] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:44:38.945417] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-19T19:44:39.022356] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:44:39.032052] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-19T19:44:39.506073] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T19:44:39.509637] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-19T19:44:40.453507] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T19:44:40.457112] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-19T19:44:40.581894] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:44:40.643254] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-19T19:44:40.896301] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T19:44:41.178258] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-19T19:44:41.443269] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-19T19:44:41.556364] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T19:44:42.243275] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-19T19:44:42.412120] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T19:44:43.010986] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T19:44:43.043225] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-19T19:44:43.258119] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T19:44:43.624936] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-19T19:44:43.843269] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-19T19:44:44.643276] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-19T19:44:45.374150] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T19:44:45.396547] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T19:44:45.443265] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-19T19:44:46.243272] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-19T19:44:47.043348] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-19T19:44:47.321638] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T19:44:47.843328] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-19T19:44:47.949932] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T19:44:48.643253] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-19T19:44:48.836447] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:44:48.943613] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T19:44:48.946571] [INFO ] [REMOTE ] LAW: Full fetch complete (20680 records). [2025-09-19T19:44:48.946677] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-19T19:44:49.320522] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-19T19:44:49.320818] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-19T19:44:49.321315] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-19T19:44:49.321356] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-19T19:44:49.322005] [DEBUG] [LOCAL ] LAW: Trimmed 20680 records to 14108 (keeping 200 days of data) [2025-09-19T19:44:49.402740] [DEBUG] [LOCAL ] LAW: Primary data saved (14108 records). [2025-09-19T19:44:49.402904] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-19T19:44:49.402994] [INFO ] [MAIN ] Update Progress: 1241/2372 symbols completed. LAW took 17.1s. Estimated remaining: 2h 30m 9s. Rate: 7.5 symbols/min [2025-09-19T19:44:49.448467] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-19T19:44:49.579974] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:49.645220] [DEBUG] [LOCAL ] LBRT: Loaded 53311 existing records from primary storage. [2025-09-19T19:44:49.645382] [INFO ] [MAIN ] LBRT: Loaded 53311 existing records. [2025-09-19T19:44:49.827877] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:49.828251] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-19T19:44:49.828319] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-19T19:44:49.829931] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-19T19:44:49.829996] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-19T19:44:50.208031] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:50.231083] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T19:44:50.243221] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-19T19:44:51.043253] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-19T19:44:51.210144] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T19:44:51.843312] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-19T19:44:52.060356] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:44:52.643235] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-19T19:44:53.205573] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T19:44:53.443277] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-19T19:44:53.650750] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T19:44:54.243271] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-19T19:44:54.546173] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:44:55.043261] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-19T19:44:55.429034] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:44:55.843260] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-19T19:44:55.893126] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T19:44:56.631152] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:44:56.636243] [INFO ] [REMOTE ] LB: Full fetch complete (56158 records). [2025-09-19T19:44:56.636344] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-19T19:44:56.649568] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-19T19:44:57.042997] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-19T19:44:57.043102] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-19T19:44:57.044169] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-19T19:44:57.044237] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-19T19:44:57.045533] [DEBUG] [LOCAL ] LB: Trimmed 56158 records to 38376 (keeping 200 days of data) [2025-09-19T19:44:57.287844] [DEBUG] [LOCAL ] LB: Primary data saved (38376 records). [2025-09-19T19:44:57.288017] [INFO ] [MAIN ] LB: Full history saved. [2025-09-19T19:44:57.288380] [INFO ] [MAIN ] Update Progress: 1242/2372 symbols completed. LB took 25.0s. Estimated remaining: 2h 30m 1s. Rate: 7.5 symbols/min [2025-09-19T19:44:57.454797] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-19T19:44:57.458239] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:57.506269] [DEBUG] [LOCAL ] LC: Loaded 48396 existing records from primary storage. [2025-09-19T19:44:57.506421] [INFO ] [MAIN ] LC: Loaded 48396 existing records. [2025-09-19T19:44:57.688960] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:57.689480] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-19T19:44:57.689550] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-19T19:44:57.690803] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-19T19:44:57.690866] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-19T19:44:58.079941] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T19:44:58.124431] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:58.243269] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-19T19:44:58.801007] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T19:44:59.043251] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-19T19:44:59.405250] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:44:59.843268] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-19T19:45:00.148958] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T19:45:00.643298] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-19T19:45:00.996188] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:45:01.443306] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-19T19:45:01.946229] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T19:45:02.243313] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-19T19:45:02.880171] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T19:45:03.043299] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-19T19:45:03.843338] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-19T19:45:04.834182] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (3.39 seconds). [2025-09-19T19:45:04.841049] [INFO ] [REMOTE ] LAZ: Full fetch complete (65705 records). [2025-09-19T19:45:04.841171] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-19T19:45:05.226845] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-19T19:45:05.226925] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-19T19:45:05.227820] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-19T19:45:05.227882] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-19T19:45:05.229171] [DEBUG] [LOCAL ] LAZ: Trimmed 65705 records to 46085 (keeping 200 days of data) [2025-09-19T19:45:05.514363] [DEBUG] [LOCAL ] LAZ: Primary data saved (46085 records). [2025-09-19T19:45:05.514517] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-19T19:45:05.514607] [INFO ] [MAIN ] Update Progress: 1243/2372 symbols completed. LAZ took 33.2s. Estimated remaining: 2h 29m 53s. Rate: 7.5 symbols/min [2025-09-19T19:45:05.684231] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:05.713383] [DEBUG] [LOCAL ] LCII: Loaded 28969 existing records from primary storage. [2025-09-19T19:45:05.713539] [INFO ] [MAIN ] LCII: Loaded 28969 existing records. [2025-09-19T19:45:05.892050] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:05.892458] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-19T19:45:05.892546] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-19T19:45:05.893420] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-19T19:45:05.893481] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-19T19:45:06.224632] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (3.98 seconds). [2025-09-19T19:45:06.288090] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-19T19:45:06.322299] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:06.323073] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-19T19:45:06.396635] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-19T19:45:06.408904] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-19T19:45:06.719856] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (3.68 seconds). [2025-09-19T19:45:06.727453] [INFO ] [REMOTE ] LAR: Full fetch complete (53671 records). [2025-09-19T19:45:06.727563] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-19T19:45:06.917142] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-09-19T19:45:06.917858] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:45:06.917931] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:45:06.918006] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-19T19:45:06.918083] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-19T19:45:06.918120] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-19T19:45:06.918225] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-19T19:45:06.918323] [INFO ] [MAIN ] Update Progress: 1244/2372 symbols completed. LAR took 34.6s. Estimated remaining: 2h 29m 39s. Rate: 7.5 symbols/min [2025-09-19T19:45:07.118501] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:07.162722] [DEBUG] [LOCAL ] LDI: Loaded 43745 existing records from primary storage. [2025-09-19T19:45:07.162895] [INFO ] [MAIN ] LDI: Loaded 43745 existing records. [2025-09-19T19:45:07.339346] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:07.339708] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-19T19:45:07.339771] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-19T19:45:07.340936] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-19T19:45:07.340996] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-19T19:45:07.702629] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:07.703315] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-19T19:45:07.719476] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T19:45:07.843260] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-19T19:45:08.284340] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T19:45:08.464058] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T19:45:08.607295] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T19:45:08.643228] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-19T19:45:09.441678] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T19:45:09.444795] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-19T19:45:10.054963] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T19:45:10.243253] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-19T19:45:11.043261] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-19T19:45:11.367700] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T19:45:11.848368] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-19T19:45:11.867279] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T19:45:12.643313] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-19T19:45:12.990031] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T19:45:13.443277] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-19T19:45:13.850015] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T19:45:14.243277] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-19T19:45:14.309127] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T19:45:15.043241] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-19T19:45:15.726187] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T19:45:15.836296] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T19:45:15.843522] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-19T19:45:16.643329] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-19T19:45:16.801210] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T19:45:17.443331] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-19T19:45:18.058574] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T19:45:18.243267] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-19T19:45:18.628454] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:45:18.978737] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:45:19.043306] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-19T19:45:19.830299] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T19:45:19.843228] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-19T19:45:20.443547] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T19:45:20.643271] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-19T19:45:21.443319] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-19T19:45:21.896594] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T19:45:22.171173] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T19:45:22.243225] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-19T19:45:23.043219] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-19T19:45:23.237051] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T19:45:23.622947] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T19:45:23.843294] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-19T19:45:24.643279] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-19T19:45:25.050326] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T19:45:25.443278] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-19T19:45:25.563436] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T19:45:25.898682] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T19:45:25.902240] [INFO ] [REMOTE ] LCII: Full fetch complete (38907 records). [2025-09-19T19:45:25.902336] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-19T19:45:26.253439] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-19T19:45:26.297416] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-19T19:45:26.297502] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-19T19:45:26.298299] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-19T19:45:26.298363] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-19T19:45:26.299476] [DEBUG] [LOCAL ] LCII: Trimmed 38907 records to 29177 (keeping 200 days of data) [2025-09-19T19:45:26.501482] [DEBUG] [LOCAL ] LCII: Primary data saved (29177 records). [2025-09-19T19:45:26.501673] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-19T19:45:26.501795] [INFO ] [MAIN ] Update Progress: 1245/2372 symbols completed. LCII took 21.0s. Estimated remaining: 2h 29m 42s. Rate: 7.5 symbols/min [2025-09-19T19:45:26.679184] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:26.730862] [DEBUG] [LOCAL ] LDOS: Loaded 46352 existing records from primary storage. [2025-09-19T19:45:26.731040] [INFO ] [MAIN ] LDOS: Loaded 46352 existing records. [2025-09-19T19:45:26.918899] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:26.919154] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-19T19:45:26.919204] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-19T19:45:26.920735] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-19T19:45:26.920797] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-19T19:45:27.048381] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-19T19:45:27.306616] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:27.478813] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T19:45:27.843301] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-19T19:45:27.961820] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:45:28.643322] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-19T19:45:29.233874] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T19:45:29.241565] [INFO ] [REMOTE ] LC: Full fetch complete (70300 records). [2025-09-19T19:45:29.241750] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-19T19:45:29.448939] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-19T19:45:29.662452] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-19T19:45:29.662542] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-19T19:45:29.663609] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-19T19:45:29.663698] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-19T19:45:29.665203] [DEBUG] [LOCAL ] LC: Trimmed 70300 records to 48747 (keeping 200 days of data) [2025-09-19T19:45:29.892782] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T19:45:29.903735] [INFO ] [REMOTE ] LBRT: Full fetch complete (76486 records). [2025-09-19T19:45:29.904496] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-19T19:45:30.435056] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-19T19:45:30.436936] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-19T19:45:30.437994] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-19T19:45:30.438077] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-19T19:45:30.447062] [DEBUG] [LOCAL ] LBRT: Trimmed 76486 records to 53697 (keeping 200 days of data) [2025-09-19T19:45:30.520679] [DEBUG] [LOCAL ] LC: Primary data saved (48747 records). [2025-09-19T19:45:30.546545] [INFO ] [MAIN ] LC: Full history saved. [2025-09-19T19:45:30.548102] [INFO ] [MAIN ] Update Progress: 1246/2372 symbols completed. LC took 33.3s. Estimated remaining: 2h 29m 30s. Rate: 7.5 symbols/min [2025-09-19T19:45:30.733297] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:30.756919] [DEBUG] [LOCAL ] LDP: Loaded 13295 existing records from primary storage. [2025-09-19T19:45:30.757170] [INFO ] [MAIN ] LDP: Loaded 13295 existing records. [2025-09-19T19:45:30.908569] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:45:30.965985] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-19T19:45:30.999722] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:31.001718] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-19T19:45:31.001788] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-19T19:45:31.002832] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-19T19:45:31.003143] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-19T19:45:31.500729] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:31.506096] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-19T19:45:31.622885] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T19:45:31.649736] [DEBUG] [LOCAL ] LBRT: Primary data saved (53697 records). [2025-09-19T19:45:31.649917] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-19T19:45:31.650017] [INFO ] [MAIN ] Update Progress: 1247/2372 symbols completed. LBRT took 42.2s. Estimated remaining: 2h 29m 16s. Rate: 7.5 symbols/min [2025-09-19T19:45:31.829591] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:31.843281] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-19T19:45:31.874190] [DEBUG] [LOCAL ] LEA: Loaded 42219 existing records from primary storage. [2025-09-19T19:45:31.874347] [INFO ] [MAIN ] LEA: Loaded 42219 existing records. [2025-09-19T19:45:32.056894] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:32.057227] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-19T19:45:32.057302] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-19T19:45:32.058718] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-19T19:45:32.058783] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-19T19:45:32.423728] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:32.643271] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-19T19:45:32.788085] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T19:45:32.994127] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T19:45:33.443276] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-19T19:45:33.678810] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:45:34.039250] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T19:45:34.243261] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-19T19:45:35.026066] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T19:45:35.043222] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-19T19:45:35.843268] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-19T19:45:35.918271] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T19:45:36.643281] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-19T19:45:37.299263] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T19:45:37.443300] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-19T19:45:38.099995] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T19:45:38.108182] [INFO ] [REMOTE ] LDI: Full fetch complete (59993 records). [2025-09-19T19:45:38.108300] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-19T19:45:38.258664] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-19T19:45:38.527934] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-19T19:45:38.528064] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-19T19:45:38.529099] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-19T19:45:38.529238] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-19T19:45:38.552340] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T19:45:38.552527] [DEBUG] [LOCAL ] LDI: Trimmed 59993 records to 44135 (keeping 200 days of data) [2025-09-19T19:45:38.818510] [DEBUG] [LOCAL ] LDI: Primary data saved (44135 records). [2025-09-19T19:45:38.818676] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-19T19:45:38.818788] [INFO ] [MAIN ] Update Progress: 1248/2372 symbols completed. LDI took 31.9s. Estimated remaining: 2h 29m 7s. Rate: 7.5 symbols/min [2025-09-19T19:45:38.995169] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:39.046075] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-19T19:45:39.048505] [DEBUG] [LOCAL ] LEG: Loaded 50752 existing records from primary storage. [2025-09-19T19:45:39.048763] [INFO ] [MAIN ] LEG: Loaded 50752 existing records. [2025-09-19T19:45:39.239028] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:39.239352] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-19T19:45:39.239421] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-19T19:45:39.240939] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-19T19:45:39.241012] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-19T19:45:39.645253] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:39.688202] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:45:39.723822] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:45:39.843226] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-19T19:45:40.643280] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-19T19:45:40.649602] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T19:45:41.443280] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-19T19:45:41.739145] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T19:45:42.243333] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-19T19:45:42.633160] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T19:45:43.043231] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-19T19:45:43.191259] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T19:45:43.403589] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T19:45:43.843277] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-19T19:45:44.643284] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-19T19:45:44.851748] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T19:45:44.928904] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T19:45:45.443316] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-19T19:45:46.243311] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-19T19:45:46.577367] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T19:45:47.043255] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-19T19:45:47.339625] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T19:45:47.569738] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T19:45:47.843267] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-19T19:45:48.581206] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T19:45:48.643226] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-19T19:45:48.933245] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-19T19:45:49.443259] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-19T19:45:50.243274] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-19T19:45:50.461451] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T19:45:50.482500] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T19:45:51.043294] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-19T19:45:51.384106] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T19:45:51.843263] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-19T19:45:52.643306] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-19T19:45:52.854245] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:45:52.860814] [INFO ] [REMOTE ] LDOS: Full fetch complete (67887 records). [2025-09-19T19:45:52.860945] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-19T19:45:53.257271] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-19T19:45:53.257532] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-19T19:45:53.258788] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-19T19:45:53.258914] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-19T19:45:53.261167] [DEBUG] [LOCAL ] LDOS: Trimmed 67887 records to 46704 (keeping 200 days of data) [2025-09-19T19:45:53.377844] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T19:45:53.482811] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-19T19:45:53.605682] [DEBUG] [LOCAL ] LDOS: Primary data saved (46704 records). [2025-09-19T19:45:53.605846] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-19T19:45:53.605959] [INFO ] [MAIN ] Update Progress: 1249/2372 symbols completed. LDOS took 27.1s. Estimated remaining: 2h 29m 6s. Rate: 7.5 symbols/min [2025-09-19T19:45:53.790784] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:53.859391] [DEBUG] [LOCAL ] LEN: Loaded 53574 existing records from primary storage. [2025-09-19T19:45:53.859560] [INFO ] [MAIN ] LEN: Loaded 53574 existing records. [2025-09-19T19:45:54.045553] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:54.045874] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-19T19:45:54.045929] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-19T19:45:54.047630] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-19T19:45:54.047721] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-19T19:45:54.267075] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-19T19:45:54.432058] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:54.471753] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T19:45:55.043266] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-19T19:45:55.310531] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T19:45:55.702943] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T19:45:55.843258] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-19T19:45:56.643282] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-19T19:45:57.128954] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T19:45:57.228406] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T19:45:57.443273] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-19T19:45:57.588314] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T19:45:58.243277] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-19T19:45:59.043243] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-19T19:45:59.263259] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T19:45:59.269895] [INFO ] [REMOTE ] LEA: Full fetch complete (60998 records). [2025-09-19T19:45:59.270053] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-19T19:45:59.688580] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-19T19:45:59.688704] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-19T19:45:59.689585] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-19T19:45:59.689662] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-19T19:45:59.691023] [DEBUG] [LOCAL ] LEA: Trimmed 60998 records to 42546 (keeping 200 days of data) [2025-09-19T19:45:59.881173] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-19T19:45:59.977681] [DEBUG] [LOCAL ] LEA: Primary data saved (42546 records). [2025-09-19T19:45:59.977841] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-19T19:45:59.978044] [INFO ] [MAIN ] Update Progress: 1250/2372 symbols completed. LEA took 28.3s. Estimated remaining: 2h 28m 56s. Rate: 7.5 symbols/min [2025-09-19T19:46:00.182091] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:00.227918] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T19:46:00.252334] [DEBUG] [LOCAL ] LEO: Loaded 17840 existing records from primary storage. [2025-09-19T19:46:00.253846] [INFO ] [MAIN ] LEO: Loaded 17840 existing records. [2025-09-19T19:46:00.254250] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T19:46:00.300753] [INFO ] [REMOTE ] LDP: Full fetch complete (19501 records). [2025-09-19T19:46:00.322774] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-19T19:46:00.612436] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:00.614735] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-19T19:46:00.630857] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-19T19:46:00.642110] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-19T19:46:00.652917] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-19T19:46:00.652682] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-19T19:46:01.008964] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-19T19:46:01.023490] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-19T19:46:01.033867] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-19T19:46:01.053937] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-19T19:46:01.122822] [DEBUG] [LOCAL ] LDP: Trimmed 19501 records to 13351 (keeping 200 days of data) [2025-09-19T19:46:01.281281] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:01.301618] [DEBUG] [LOCAL ] LDP: Primary data saved (13351 records). [2025-09-19T19:46:01.301794] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-19T19:46:01.301938] [INFO ] [MAIN ] Update Progress: 1251/2372 symbols completed. LDP took 30.8s. Estimated remaining: 2h 28m 42s. Rate: 7.5 symbols/min [2025-09-19T19:46:01.447962] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-19T19:46:01.480527] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:01.549226] [DEBUG] [LOCAL ] LEVI: Loaded 51868 existing records from primary storage. [2025-09-19T19:46:01.549396] [INFO ] [MAIN ] LEVI: Loaded 51868 existing records. [2025-09-19T19:46:01.728848] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:01.729092] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-19T19:46:01.729161] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-19T19:46:01.730232] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-19T19:46:01.730294] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-19T19:46:02.120419] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:02.190320] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T19:46:02.188689] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:46:02.243271] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-19T19:46:02.748806] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T19:46:03.043267] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-19T19:46:03.843276] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-19T19:46:04.160041] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T19:46:04.242019] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T19:46:04.643280] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-19T19:46:05.443269] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-19T19:46:05.758691] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T19:46:06.243232] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-19T19:46:06.584725] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T19:46:06.724804] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T19:46:07.043247] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-19T19:46:07.843268] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-19T19:46:08.262078] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T19:46:08.331247] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:46:08.643272] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-19T19:46:09.443322] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-19T19:46:10.071469] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T19:46:10.245387] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-19T19:46:10.507442] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:46:11.043319] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-19T19:46:11.611333] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T19:46:11.843324] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-19T19:46:12.162059] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T19:46:12.174334] [INFO ] [REMOTE ] LEG: Full fetch complete (73212 records). [2025-09-19T19:46:12.174591] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-19T19:46:12.625340] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T19:46:12.624200] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-19T19:46:12.631138] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-19T19:46:12.632611] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-19T19:46:12.632746] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-19T19:46:12.634176] [DEBUG] [LOCAL ] LEG: Trimmed 73212 records to 51158 (keeping 200 days of data) [2025-09-19T19:46:12.643236] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-19T19:46:12.976738] [DEBUG] [LOCAL ] LEG: Primary data saved (51158 records). [2025-09-19T19:46:12.976904] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-19T19:46:12.977054] [INFO ] [MAIN ] Update Progress: 1252/2372 symbols completed. LEG took 34.2s. Estimated remaining: 2h 28m 38s. Rate: 7.5 symbols/min [2025-09-19T19:46:13.163067] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:13.182500] [DEBUG] [LOCAL ] LFT: Loaded 17989 existing records from primary storage. [2025-09-19T19:46:13.182716] [INFO ] [MAIN ] LFT: Loaded 17989 existing records. [2025-09-19T19:46:13.365750] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:13.365992] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-19T19:46:13.366042] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-19T19:46:13.366623] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-19T19:46:13.366729] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-19T19:46:13.456140] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-19T19:46:13.719022] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:13.796607] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T19:46:14.068920] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T19:46:14.243265] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-19T19:46:15.043337] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-19T19:46:15.505324] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T19:46:15.843283] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-19T19:46:16.467566] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T19:46:16.504550] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T19:46:16.643262] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-19T19:46:17.443291] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-19T19:46:17.831936] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:46:18.110700] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-19T19:46:18.243273] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-19T19:46:18.808921] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T19:46:19.043253] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-19T19:46:19.731063] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T19:46:19.767495] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T19:46:19.843266] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-19T19:46:20.643281] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-19T19:46:21.443279] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-19T19:46:21.879592] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T19:46:22.243322] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-19T19:46:22.479362] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T19:46:22.926414] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T19:46:23.043258] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-19T19:46:23.843263] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-19T19:46:23.966507] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T19:46:24.044438] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:46:24.643307] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-19T19:46:24.967444] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T19:46:25.443297] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-19T19:46:26.243248] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-19T19:46:26.359350] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T19:46:26.541215] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T19:46:27.043270] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-19T19:46:27.286721] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T19:46:27.289522] [INFO ] [REMOTE ] LEO: Full fetch complete (27174 records). [2025-09-19T19:46:27.289608] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-19T19:46:27.654453] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-19T19:46:27.654560] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-19T19:46:27.655156] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-19T19:46:27.655221] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-19T19:46:27.656118] [DEBUG] [LOCAL ] LEO: Trimmed 27174 records to 17935 (keeping 200 days of data) [2025-09-19T19:46:27.768304] [DEBUG] [LOCAL ] LEO: Primary data saved (17935 records). [2025-09-19T19:46:27.768458] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-19T19:46:27.768545] [INFO ] [MAIN ] Update Progress: 1253/2372 symbols completed. LEO took 27.8s. Estimated remaining: 2h 28m 36s. Rate: 7.5 symbols/min [2025-09-19T19:46:27.848381] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-19T19:46:27.946275] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:27.959398] [DEBUG] [LOCAL ] LGI: Loaded 10235 existing records from primary storage. [2025-09-19T19:46:27.959500] [INFO ] [MAIN ] LGI: Loaded 10235 existing records. [2025-09-19T19:46:28.132740] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:28.132959] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-19T19:46:28.133006] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-19T19:46:28.133412] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-19T19:46:28.133472] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-19T19:46:28.480622] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:28.643215] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-19T19:46:29.263758] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T19:46:29.443228] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-19T19:46:29.832745] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T19:46:29.947283] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T19:46:30.243258] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-19T19:46:31.043310] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-19T19:46:31.843271] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-19T19:46:31.946272] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-19T19:46:31.955605] [INFO ] [REMOTE ] LEN: Full fetch complete (76971 records). [2025-09-19T19:46:31.955748] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-19T19:46:32.348142] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-19T19:46:32.353476] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-19T19:46:32.360242] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-19T19:46:32.360335] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-19T19:46:32.361745] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T19:46:32.368497] [DEBUG] [LOCAL ] LEN: Trimmed 76971 records to 53964 (keeping 200 days of data) [2025-09-19T19:46:32.389676] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T19:46:32.461578] [INFO ] [REMOTE ] LEVI: Full fetch complete (74434 records). [2025-09-19T19:46:32.487816] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-19T19:46:32.563376] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T19:46:32.646634] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-19T19:46:33.048464] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-19T19:46:33.050424] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-19T19:46:33.052153] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-19T19:46:33.052499] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-19T19:46:33.069542] [DEBUG] [LOCAL ] LEVI: Trimmed 74434 records to 52245 (keeping 200 days of data) [2025-09-19T19:46:33.285168] [DEBUG] [LOCAL ] LEN: Primary data saved (53964 records). [2025-09-19T19:46:33.286983] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-19T19:46:33.290190] [INFO ] [MAIN ] Update Progress: 1254/2372 symbols completed. LEN took 39.7s. Estimated remaining: 2h 28m 26s. Rate: 7.5 symbols/min [2025-09-19T19:46:33.450957] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-19T19:46:33.580309] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:33.687599] [DEBUG] [LOCAL ] LEVI: Primary data saved (52245 records). [2025-09-19T19:46:33.688247] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-19T19:46:33.698407] [INFO ] [MAIN ] Update Progress: 1255/2372 symbols completed. LEVI took 32.4s. Estimated remaining: 2h 28m 11s. Rate: 7.5 symbols/min [2025-09-19T19:46:33.743065] [DEBUG] [LOCAL ] LH: Loaded 39098 existing records from primary storage. [2025-09-19T19:46:33.769475] [INFO ] [MAIN ] LH: Loaded 39098 existing records. [2025-09-19T19:46:34.006243] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:34.069353] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T19:46:34.070954] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:34.076740] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-19T19:46:34.076805] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-19T19:46:34.077901] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-19T19:46:34.077961] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-19T19:46:34.259271] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-19T19:46:34.407444] [DEBUG] [LOCAL ] LHX: Loaded 49373 existing records from primary storage. [2025-09-19T19:46:34.413214] [INFO ] [MAIN ] LHX: Loaded 49373 existing records. [2025-09-19T19:46:34.561836] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:34.597639] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T19:46:34.678071] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:34.678285] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-19T19:46:34.678354] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-19T19:46:34.679692] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-19T19:46:34.679754] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-19T19:46:35.025779] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:35.043217] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-19T19:46:35.669368] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T19:46:35.843281] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-19T19:46:36.542450] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:46:36.643291] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-19T19:46:37.072080] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T19:46:37.443282] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-19T19:46:37.633159] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T19:46:38.243269] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-19T19:46:39.043271] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-19T19:46:39.403373] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T19:46:39.477563] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T19:46:39.843271] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-19T19:46:39.980560] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T19:46:40.643261] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-19T19:46:41.443234] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-19T19:46:41.491856] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T19:46:41.963632] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:46:42.243278] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-19T19:46:42.441481] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T19:46:43.043309] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-19T19:46:43.389859] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T19:46:43.392436] [INFO ] [REMOTE ] LFT: Full fetch complete (23894 records). [2025-09-19T19:46:43.392519] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-19T19:46:43.762113] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-19T19:46:43.762194] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-19T19:46:43.762700] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-19T19:46:43.762789] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-19T19:46:43.763452] [DEBUG] [LOCAL ] LFT: Trimmed 23894 records to 18069 (keeping 200 days of data) [2025-09-19T19:46:43.843330] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-19T19:46:43.874300] [DEBUG] [LOCAL ] LFT: Primary data saved (18069 records). [2025-09-19T19:46:43.874459] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-19T19:46:43.874549] [INFO ] [MAIN ] Update Progress: 1256/2372 symbols completed. LFT took 30.9s. Estimated remaining: 2h 28m 5s. Rate: 7.5 symbols/min [2025-09-19T19:46:44.048189] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:44.077043] [DEBUG] [LOCAL ] LII: Loaded 28933 existing records from primary storage. [2025-09-19T19:46:44.077210] [INFO ] [MAIN ] LII: Loaded 28933 existing records. [2025-09-19T19:46:44.256084] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:44.256350] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-19T19:46:44.256409] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-19T19:46:44.257147] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-19T19:46:44.257207] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-19T19:46:44.614569] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:44.643210] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-19T19:46:44.748718] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T19:46:44.771801] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T19:46:45.443273] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-19T19:46:46.053423] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T19:46:46.243271] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-19T19:46:46.304064] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T19:46:47.043267] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-19T19:46:47.843292] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-19T19:46:48.124013] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T19:46:48.643285] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-19T19:46:48.949638] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T19:46:49.009762] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:46:49.443270] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-19T19:46:50.163219] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T19:46:50.243261] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-19T19:46:51.043238] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-19T19:46:51.698987] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T19:46:51.843243] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-19T19:46:51.870031] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T19:46:51.957064] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T19:46:51.958751] [INFO ] [REMOTE ] LGI: Full fetch complete (14270 records). [2025-09-19T19:46:51.958822] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-19T19:46:52.320767] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-19T19:46:52.320866] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-19T19:46:52.321206] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-19T19:46:52.321256] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-19T19:46:52.322043] [DEBUG] [LOCAL ] LGI: Trimmed 14270 records to 10308 (keeping 200 days of data) [2025-09-19T19:46:52.389860] [DEBUG] [LOCAL ] LGI: Primary data saved (10308 records). [2025-09-19T19:46:52.390004] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-19T19:46:52.390092] [INFO ] [MAIN ] Update Progress: 1257/2372 symbols completed. LGI took 24.6s. Estimated remaining: 2h 27m 58s. Rate: 7.5 symbols/min [2025-09-19T19:46:52.556961] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:52.600971] [DEBUG] [LOCAL ] LION: Loaded 42669 existing records from primary storage. [2025-09-19T19:46:52.601131] [INFO ] [MAIN ] LION: Loaded 42669 existing records. [2025-09-19T19:46:52.654542] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-19T19:46:52.784291] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:52.784531] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-19T19:46:52.784593] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-19T19:46:52.785449] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-19T19:46:52.785509] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-19T19:46:53.136442] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:53.443273] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-19T19:46:53.601764] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:46:54.243246] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-19T19:46:54.575349] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T19:46:55.043289] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-19T19:46:55.152146] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T19:46:55.173697] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T19:46:55.843269] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-19T19:46:56.643268] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-19T19:46:56.816241] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:46:57.127325] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:46:57.443263] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-19T19:46:58.243331] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-19T19:46:58.417062] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T19:46:59.050299] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-19T19:46:59.055147] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T19:46:59.153994] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T19:46:59.843268] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-19T19:47:00.643278] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-19T19:47:01.189882] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T19:47:01.443293] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-19T19:47:01.781209] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T19:47:02.194817] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T19:47:02.243283] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-19T19:47:02.657965] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T19:47:03.043266] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-19T19:47:03.843305] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-19T19:47:04.352456] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T19:47:04.501227] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T19:47:04.643238] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-19T19:47:05.352406] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:47:05.443252] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-19T19:47:06.243253] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-19T19:47:06.280252] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:47:07.033001] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T19:47:07.043466] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-19T19:47:07.812028] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T19:47:07.817219] [INFO ] [REMOTE ] LH: Full fetch complete (54893 records). [2025-09-19T19:47:07.817330] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-19T19:47:07.851843] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-19T19:47:08.234861] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-19T19:47:08.234942] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-19T19:47:08.235892] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-19T19:47:08.235958] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-19T19:47:08.237300] [DEBUG] [LOCAL ] LH: Trimmed 54893 records to 39293 (keeping 200 days of data) [2025-09-19T19:47:08.502592] [DEBUG] [LOCAL ] LH: Primary data saved (39293 records). [2025-09-19T19:47:08.502812] [INFO ] [MAIN ] LH: Full history saved. [2025-09-19T19:47:08.502914] [INFO ] [MAIN ] Update Progress: 1258/2372 symbols completed. LH took 35.2s. Estimated remaining: 2h 27m 57s. Rate: 7.5 symbols/min [2025-09-19T19:47:08.649060] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-19T19:47:08.676253] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:08.683227] [DEBUG] [LOCAL ] LITB: Loaded 4298 existing records from primary storage. [2025-09-19T19:47:08.683364] [INFO ] [MAIN ] LITB: Loaded 4298 existing records. [2025-09-19T19:47:08.862289] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:08.862684] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-19T19:47:08.862767] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-19T19:47:08.863055] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-19T19:47:08.863118] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-19T19:47:09.233994] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:09.264099] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T19:47:09.291160] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T19:47:09.443239] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-19T19:47:10.243251] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-19T19:47:10.803550] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T19:47:10.834588] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T19:47:11.043256] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-19T19:47:11.314376] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T19:47:11.843330] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-19T19:47:12.643266] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-19T19:47:13.011109] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T19:47:13.377321] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:47:13.381781] [INFO ] [REMOTE ] LII: Full fetch complete (41056 records). [2025-09-19T19:47:13.381877] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-19T19:47:13.448467] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-19T19:47:13.756984] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-19T19:47:13.757120] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-19T19:47:13.757897] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-19T19:47:13.757960] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-19T19:47:13.759043] [DEBUG] [LOCAL ] LII: Trimmed 41056 records to 29065 (keeping 200 days of data) [2025-09-19T19:47:13.855612] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-19T19:47:13.950557] [DEBUG] [LOCAL ] LII: Primary data saved (29065 records). [2025-09-19T19:47:13.950746] [INFO ] [MAIN ] LII: Full history saved. [2025-09-19T19:47:13.950973] [INFO ] [MAIN ] Update Progress: 1259/2372 symbols completed. LII took 30.1s. Estimated remaining: 2h 27m 47s. Rate: 7.5 symbols/min [2025-09-19T19:47:14.101336] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T19:47:14.171811] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:14.226929] [DEBUG] [LOCAL ] LLY: Loaded 53688 existing records from primary storage. [2025-09-19T19:47:14.227101] [INFO ] [MAIN ] LLY: Loaded 53688 existing records. [2025-09-19T19:47:14.248381] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-19T19:47:14.413235] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:14.413507] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-19T19:47:14.413601] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-19T19:47:14.415386] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-19T19:47:14.415465] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-19T19:47:14.785608] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:14.867294] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-19T19:47:15.043265] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-19T19:47:15.843266] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-19T19:47:16.643255] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-19T19:47:16.662853] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T19:47:17.025387] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T19:47:17.443304] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-19T19:47:18.243280] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-19T19:47:18.381388] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T19:47:18.715095] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T19:47:18.722493] [INFO ] [REMOTE ] LHX: Full fetch complete (70859 records). [2025-09-19T19:47:18.722601] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-19T19:47:19.057727] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-19T19:47:19.116299] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-19T19:47:19.116381] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-19T19:47:19.117613] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-19T19:47:19.117701] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-19T19:47:19.119176] [DEBUG] [LOCAL ] LHX: Trimmed 70859 records to 49633 (keeping 200 days of data) [2025-09-19T19:47:19.438849] [DEBUG] [LOCAL ] LHX: Primary data saved (49633 records). [2025-09-19T19:47:19.439018] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-19T19:47:19.439142] [INFO ] [MAIN ] Update Progress: 1260/2372 symbols completed. LHX took 45.7s. Estimated remaining: 2h 27m 36s. Rate: 7.5 symbols/min [2025-09-19T19:47:19.544907] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-19T19:47:19.617403] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:19.669888] [DEBUG] [LOCAL ] LMND: Loaded 52260 existing records from primary storage. [2025-09-19T19:47:19.670076] [INFO ] [MAIN ] LMND: Loaded 52260 existing records. [2025-09-19T19:47:19.847278] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-19T19:47:19.847445] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:19.848488] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-19T19:47:19.848547] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-19T19:47:19.849785] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-19T19:47:19.849847] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-19T19:47:20.209950] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:20.338614] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-19T19:47:20.643295] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-19T19:47:20.734264] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T19:47:21.178947] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T19:47:21.443342] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-19T19:47:22.243290] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-19T19:47:22.759848] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T19:47:23.043276] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-19T19:47:23.658742] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T19:47:23.843264] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-19T19:47:24.643264] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-19T19:47:25.443237] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-19T19:47:25.514568] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T19:47:25.516134] [INFO ] [REMOTE ] LITB: Full fetch complete (5546 records). [2025-09-19T19:47:25.516206] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-19T19:47:25.915589] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-19T19:47:25.915929] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-19T19:47:25.916120] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-19T19:47:25.916239] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-19T19:47:25.917137] [DEBUG] [LOCAL ] LITB: Trimmed 5546 records to 4328 (keeping 200 days of data) [2025-09-19T19:47:25.968501] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.93 seconds). [2025-09-19T19:47:25.986280] [DEBUG] [LOCAL ] LITB: Primary data saved (4328 records). [2025-09-19T19:47:25.986477] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-19T19:47:25.986630] [INFO ] [MAIN ] Update Progress: 1261/2372 symbols completed. LITB took 17.5s. Estimated remaining: 2h 27m 27s. Rate: 7.5 symbols/min [2025-09-19T19:47:26.140445] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-19T19:47:26.206957] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:26.253671] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-19T19:47:26.256732] [DEBUG] [LOCAL ] LMT: Loaded 50362 existing records from primary storage. [2025-09-19T19:47:26.256993] [INFO ] [MAIN ] LMT: Loaded 50362 existing records. [2025-09-19T19:47:26.438583] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:26.438900] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-19T19:47:26.438948] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-19T19:47:26.440569] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-19T19:47:26.440632] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-19T19:47:26.862291] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:27.043243] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-19T19:47:27.562830] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T19:47:27.569935] [INFO ] [REMOTE ] LION: Full fetch complete (53379 records). [2025-09-19T19:47:27.570034] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-19T19:47:27.851221] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-19T19:47:27.956051] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-19T19:47:27.956129] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-19T19:47:27.957002] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-19T19:47:27.957064] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-19T19:47:27.958264] [DEBUG] [LOCAL ] LION: Trimmed 53379 records to 43038 (keeping 200 days of data) [2025-09-19T19:47:28.201681] [DEBUG] [LOCAL ] LION: Primary data saved (43038 records). [2025-09-19T19:47:28.201830] [INFO ] [MAIN ] LION: Full history saved. [2025-09-19T19:47:28.201925] [INFO ] [MAIN ] Update Progress: 1262/2372 symbols completed. LION took 35.8s. Estimated remaining: 2h 27m 14s. Rate: 7.5 symbols/min [2025-09-19T19:47:28.371916] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:28.421778] [DEBUG] [LOCAL ] LNC: Loaded 52021 existing records from primary storage. [2025-09-19T19:47:28.421928] [INFO ] [MAIN ] LNC: Loaded 52021 existing records. [2025-09-19T19:47:28.598827] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:28.599072] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-19T19:47:28.599121] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-19T19:47:28.600134] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-19T19:47:28.600194] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-19T19:47:28.971223] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:28.971547] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-19T19:47:29.005112] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-19T19:47:29.404152] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-19T19:47:29.443219] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-19T19:47:30.207495] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T19:47:30.243320] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-19T19:47:30.831757] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:47:31.043340] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-19T19:47:31.838239] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-19T19:47:31.848167] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-19T19:47:32.324793] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:47:32.643274] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-19T19:47:32.932031] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T19:47:33.443274] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-19T19:47:33.534874] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:47:34.243312] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-19T19:47:34.990032] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-19T19:47:35.043226] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-19T19:47:35.310184] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T19:47:35.843307] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-19T19:47:36.540110] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T19:47:36.643224] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-19T19:47:37.201037] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T19:47:37.443277] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-19T19:47:37.617631] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T19:47:38.097404] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T19:47:38.243269] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-19T19:47:39.043282] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-19T19:47:39.657506] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T19:47:39.843227] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-19T19:47:40.540413] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-19T19:47:40.631481] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:47:40.643235] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-19T19:47:41.443270] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-19T19:47:42.187794] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-19T19:47:42.243239] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-19T19:47:42.623323] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T19:47:43.043265] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-19T19:47:43.843331] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-19T19:47:44.464309] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-09-19T19:47:44.643266] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-19T19:47:44.805370] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-19T19:47:44.845609] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:47:45.443276] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-19T19:47:46.243743] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-19T19:47:46.243637] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T19:47:46.995000] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-19T19:47:47.043229] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-19T19:47:47.843274] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-19T19:47:48.125573] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-19T19:47:48.238347] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:47:48.643266] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-19T19:47:49.146412] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T19:47:49.443231] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-19T19:47:49.997066] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T19:47:50.104792] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T19:47:50.243259] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-19T19:47:51.043263] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-19T19:47:51.848221] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-19T19:47:51.856918] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T19:47:52.513065] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T19:47:52.522051] [INFO ] [REMOTE ] LMND: Full fetch complete (75270 records). [2025-09-19T19:47:52.522218] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-19T19:47:52.648475] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-19T19:47:52.928478] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-19T19:47:52.928575] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-19T19:47:52.929633] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-19T19:47:52.929726] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-19T19:47:52.931322] [DEBUG] [LOCAL ] LMND: Trimmed 75270 records to 52648 (keeping 200 days of data) [2025-09-19T19:47:53.242130] [DEBUG] [LOCAL ] LMND: Primary data saved (52648 records). [2025-09-19T19:47:53.242278] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-19T19:47:53.242363] [INFO ] [MAIN ] Update Progress: 1263/2372 symbols completed. LMND took 33.8s. Estimated remaining: 2h 27m 21s. Rate: 7.5 symbols/min [2025-09-19T19:47:53.420990] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:53.429256] [DEBUG] [LOCAL ] LND: Loaded 5231 existing records from primary storage. [2025-09-19T19:47:53.429397] [INFO ] [MAIN ] LND: Loaded 5231 existing records. [2025-09-19T19:47:53.660570] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:53.661019] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-19T19:47:53.661085] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-19T19:47:53.661468] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-19T19:47:53.661565] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-19T19:47:54.120225] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:54.124339] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-19T19:47:54.123997] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-09-19T19:47:54.143233] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-19T19:47:54.156295] [INFO ] [REMOTE ] LNC: Full fetch complete (73917 records). [2025-09-19T19:47:54.156510] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-19T19:47:54.250602] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-19T19:47:54.598248] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-19T19:47:54.598367] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-19T19:47:54.599371] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-19T19:47:54.599436] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-19T19:47:54.600915] [DEBUG] [LOCAL ] LNC: Trimmed 73917 records to 52409 (keeping 200 days of data) [2025-09-19T19:47:54.917908] [DEBUG] [LOCAL ] LNC: Primary data saved (52409 records). [2025-09-19T19:47:54.918082] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-19T19:47:54.918234] [INFO ] [MAIN ] Update Progress: 1264/2372 symbols completed. LNC took 26.7s. Estimated remaining: 2h 27m 8s. Rate: 7.5 symbols/min [2025-09-19T19:47:55.095813] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:55.147147] [DEBUG] [LOCAL ] LNG: Loaded 51931 existing records from primary storage. [2025-09-19T19:47:55.147364] [INFO ] [MAIN ] LNG: Loaded 51931 existing records. [2025-09-19T19:47:55.289476] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T19:47:55.301228] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-19T19:47:55.350695] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-19T19:47:55.375606] [INFO ] [REMOTE ] LMT: Full fetch complete (72557 records). [2025-09-19T19:47:55.375801] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:55.376121] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-19T19:47:55.376349] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-19T19:47:55.376761] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-19T19:47:55.389128] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-19T19:47:55.409944] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-19T19:47:56.130622] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:56.148494] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-19T19:47:56.148839] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-19T19:47:56.148996] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-19T19:47:56.154740] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-19T19:47:56.156124] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-19T19:47:56.157408] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-19T19:47:56.160986] [DEBUG] [LOCAL ] LMT: Trimmed 72557 records to 50702 (keeping 200 days of data) [2025-09-19T19:47:56.484833] [DEBUG] [LOCAL ] LMT: Primary data saved (50702 records). [2025-09-19T19:47:56.484964] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-19T19:47:56.485056] [INFO ] [MAIN ] Update Progress: 1265/2372 symbols completed. LMT took 30.5s. Estimated remaining: 2h 26m 54s. Rate: 7.5 symbols/min [2025-09-19T19:47:56.650265] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-19T19:47:56.653867] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:56.668219] [DEBUG] [LOCAL ] LNN: Loaded 11338 existing records from primary storage. [2025-09-19T19:47:56.668420] [INFO ] [MAIN ] LNN: Loaded 11338 existing records. [2025-09-19T19:47:56.849692] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:56.849985] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-19T19:47:56.850033] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-19T19:47:56.850408] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-19T19:47:56.850466] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-19T19:47:57.208670] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:57.219039] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T19:47:57.263377] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (3.01 seconds). [2025-09-19T19:47:57.443270] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-19T19:47:57.533371] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T19:47:58.243244] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-19T19:47:58.393291] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T19:47:59.043301] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-19T19:47:59.843349] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-19T19:48:00.006278] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T19:48:00.643268] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-19T19:48:01.207758] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-19T19:48:01.216757] [INFO ] [REMOTE ] LLY: Full fetch complete (77254 records). [2025-09-19T19:48:01.216950] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-19T19:48:01.457161] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-19T19:48:01.620743] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-19T19:48:01.620976] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-19T19:48:01.628900] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-19T19:48:01.629004] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-19T19:48:01.630147] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T19:48:01.635362] [DEBUG] [LOCAL ] LLY: Trimmed 77254 records to 54077 (keeping 200 days of data) [2025-09-19T19:48:02.008527] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T19:48:02.044610] [DEBUG] [LOCAL ] LLY: Primary data saved (54077 records). [2025-09-19T19:48:02.044765] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-19T19:48:02.046566] [INFO ] [MAIN ] Update Progress: 1266/2372 symbols completed. LLY took 48.1s. Estimated remaining: 2h 26m 44s. Rate: 7.5 symbols/min [2025-09-19T19:48:02.222426] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:02.243259] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-19T19:48:02.271786] [DEBUG] [LOCAL ] LOAR: Loaded 41811 existing records from primary storage. [2025-09-19T19:48:02.271922] [INFO ] [MAIN ] LOAR: Loaded 41811 existing records. [2025-09-19T19:48:02.452275] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:02.452543] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-19T19:48:02.452592] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-19T19:48:02.453544] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-19T19:48:02.453615] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-19T19:48:02.811992] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:03.043263] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-19T19:48:03.661202] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T19:48:03.843268] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-19T19:48:04.643278] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-19T19:48:05.254289] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T19:48:05.443316] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-19T19:48:05.783087] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T19:48:05.960982] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-09-19T19:48:06.243304] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-19T19:48:06.258781] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T19:48:06.307492] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (4.06 seconds). [2025-09-19T19:48:07.043261] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-19T19:48:07.652208] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:48:07.789904] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T19:48:07.843269] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-19T19:48:08.643283] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-19T19:48:08.970375] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T19:48:09.443297] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-19T19:48:10.243314] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-19T19:48:10.377907] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T19:48:10.455258] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T19:48:10.972156] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T19:48:11.043297] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-19T19:48:11.705449] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-19T19:48:11.843281] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-19T19:48:12.643285] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-19T19:48:13.329023] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:48:13.443321] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-19T19:48:14.243323] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-19T19:48:15.043283] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-19T19:48:15.814877] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T19:48:15.843262] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-19T19:48:15.951599] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-19T19:48:16.137685] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T19:48:16.139130] [INFO ] [REMOTE ] LND: Full fetch complete (8939 records). [2025-09-19T19:48:16.139266] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-19T19:48:16.264102] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (3.62 seconds). [2025-09-19T19:48:16.576785] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-19T19:48:16.576895] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-19T19:48:16.577158] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-19T19:48:16.577230] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-19T19:48:16.577733] [DEBUG] [LOCAL ] LND: Trimmed 8939 records to 5257 (keeping 200 days of data) [2025-09-19T19:48:16.611123] [DEBUG] [LOCAL ] LND: Primary data saved (5257 records). [2025-09-19T19:48:16.611284] [INFO ] [MAIN ] LND: Full history saved. [2025-09-19T19:48:16.611487] [INFO ] [MAIN ] Update Progress: 1267/2372 symbols completed. LND took 23.4s. Estimated remaining: 2h 26m 42s. Rate: 7.5 symbols/min [2025-09-19T19:48:16.648464] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-19T19:48:16.792670] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:16.828153] [DEBUG] [LOCAL ] LOB: Loaded 27714 existing records from primary storage. [2025-09-19T19:48:16.828296] [INFO ] [MAIN ] LOB: Loaded 27714 existing records. [2025-09-19T19:48:17.019232] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:17.025007] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-19T19:48:17.025086] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-19T19:48:17.029920] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-19T19:48:17.030286] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:48:17.030385] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-19T19:48:17.412355] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:17.443240] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-19T19:48:18.243251] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-19T19:48:18.294689] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T19:48:18.977231] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T19:48:19.043240] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-19T19:48:19.843255] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-19T19:48:20.273804] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T19:48:20.376783] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T19:48:20.643285] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-19T19:48:21.026588] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:48:21.443236] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-19T19:48:21.888961] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T19:48:22.243326] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-19T19:48:23.043288] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-19T19:48:23.141106] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-19T19:48:23.469854] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:48:23.843292] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-19T19:48:24.250834] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:48:24.643279] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-19T19:48:25.263608] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T19:48:25.265850] [INFO ] [REMOTE ] LNN: Full fetch complete (15484 records). [2025-09-19T19:48:25.265976] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-19T19:48:25.492446] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-19T19:48:25.684109] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-19T19:48:25.684186] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-19T19:48:25.684520] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-19T19:48:25.684558] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-19T19:48:25.685252] [DEBUG] [LOCAL ] LNN: Trimmed 15484 records to 11397 (keeping 200 days of data) [2025-09-19T19:48:25.766247] [DEBUG] [LOCAL ] LNN: Primary data saved (11397 records). [2025-09-19T19:48:25.766379] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-19T19:48:25.766509] [INFO ] [MAIN ] Update Progress: 1268/2372 symbols completed. LNN took 29.3s. Estimated remaining: 2h 26m 35s. Rate: 7.5 symbols/min [2025-09-19T19:48:25.936074] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:25.947228] [DEBUG] [LOCAL ] LOCL: Loaded 3492 existing records from primary storage. [2025-09-19T19:48:25.947381] [INFO ] [MAIN ] LOCL: Loaded 3492 existing records. [2025-09-19T19:48:26.128810] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:26.129230] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-19T19:48:26.129286] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-19T19:48:26.129568] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-19T19:48:26.129628] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-19T19:48:26.252707] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-19T19:48:26.453137] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-19T19:48:26.539403] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:27.043243] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-19T19:48:27.621849] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T19:48:27.843221] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-19T19:48:28.158437] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T19:48:28.643289] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-19T19:48:29.128238] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T19:48:29.223532] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T19:48:29.443265] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-19T19:48:30.243320] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-19T19:48:30.536227] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T19:48:31.043309] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-19T19:48:31.519569] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:48:31.526993] [INFO ] [REMOTE ] LNG: Full fetch complete (74651 records). [2025-09-19T19:48:31.527122] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-19T19:48:31.848420] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-19T19:48:31.923207] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-19T19:48:31.923317] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-19T19:48:31.924413] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-19T19:48:31.924522] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-19T19:48:31.928238] [DEBUG] [LOCAL ] LNG: Trimmed 74651 records to 52311 (keeping 200 days of data) [2025-09-19T19:48:32.062195] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T19:48:32.071204] [INFO ] [REMOTE ] LOAR: Full fetch complete (56166 records). [2025-09-19T19:48:32.072101] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-19T19:48:32.212371] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T19:48:32.510231] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-19T19:48:32.510545] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-19T19:48:32.511721] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-19T19:48:32.512016] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-19T19:48:32.516101] [DEBUG] [LOCAL ] LOAR: Trimmed 56166 records to 42056 (keeping 200 days of data) [2025-09-19T19:48:32.649636] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-19T19:48:32.946106] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T19:48:33.000588] [DEBUG] [LOCAL ] LNG: Primary data saved (52311 records). [2025-09-19T19:48:33.001418] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-19T19:48:33.001337] [DEBUG] [LOCAL ] LOAR: Primary data saved (42056 records). [2025-09-19T19:48:33.001677] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-19T19:48:33.001612] [INFO ] [MAIN ] Update Progress: 1269/2372 symbols completed. LNG took 38.1s. Estimated remaining: 2h 26m 26s. Rate: 7.5 symbols/min [2025-09-19T19:48:33.002095] [INFO ] [MAIN ] Update Progress: 1270/2372 symbols completed. LOAR took 31.0s. Estimated remaining: 2h 26m 12s. Rate: 7.5 symbols/min [2025-09-19T19:48:33.347449] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:33.346051] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:33.391245] [DEBUG] [LOCAL ] LOMA: Loaded 31637 existing records from primary storage. [2025-09-19T19:48:33.391400] [INFO ] [MAIN ] LOMA: Loaded 31637 existing records. [2025-09-19T19:48:33.455206] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-19T19:48:33.609702] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:33.610085] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-19T19:48:33.610155] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-19T19:48:33.611077] [DEBUG] [LOCAL ] LOW: Loaded 53348 existing records from primary storage. [2025-09-19T19:48:33.611149] [INFO ] [MAIN ] LOW: Loaded 53348 existing records. [2025-09-19T19:48:33.611183] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-19T19:48:33.642549] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-19T19:48:34.063525] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:34.093997] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-19T19:48:34.094439] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-19T19:48:34.116232] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-19T19:48:34.169989] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-19T19:48:34.171903] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-19T19:48:34.175523] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:34.245130] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-19T19:48:34.475222] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T19:48:34.580496] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:35.043299] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-19T19:48:35.849808] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-19T19:48:35.865079] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:48:36.276058] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-19T19:48:36.479841] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T19:48:36.643309] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-19T19:48:36.938620] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-19T19:48:37.443270] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-19T19:48:38.243303] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-19T19:48:39.043264] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-19T19:48:39.138719] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T19:48:39.628358] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T19:48:39.843250] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-19T19:48:40.070284] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T19:48:40.446357] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T19:48:40.643264] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-19T19:48:41.176637] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-19T19:48:41.443273] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-19T19:48:42.243263] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-19T19:48:43.026052] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T19:48:43.043216] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-19T19:48:43.658675] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T19:48:43.663392] [INFO ] [REMOTE ] LOB: Full fetch complete (37482 records). [2025-09-19T19:48:43.663483] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-19T19:48:43.844925] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-19T19:48:44.046165] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-19T19:48:44.046255] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-19T19:48:44.046946] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-19T19:48:44.047010] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-19T19:48:44.047870] [DEBUG] [LOCAL ] LOB: Trimmed 37482 records to 27973 (keeping 200 days of data) [2025-09-19T19:48:44.236711] [DEBUG] [LOCAL ] LOB: Primary data saved (27973 records). [2025-09-19T19:48:44.237096] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-19T19:48:44.237219] [INFO ] [MAIN ] Update Progress: 1271/2372 symbols completed. LOB took 27.6s. Estimated remaining: 2h 26m 6s. Rate: 7.5 symbols/min [2025-09-19T19:48:44.407675] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:44.456983] [DEBUG] [LOCAL ] LPG: Loaded 40699 existing records from primary storage. [2025-09-19T19:48:44.457130] [INFO ] [MAIN ] LPG: Loaded 40699 existing records. [2025-09-19T19:48:44.639273] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:44.639592] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-19T19:48:44.639697] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-19T19:48:44.646320] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-19T19:48:44.646269] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-19T19:48:44.654622] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-19T19:48:44.664518] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:48:45.029914] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:45.350250] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:48:45.443286] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-19T19:48:45.934493] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T19:48:45.999602] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T19:48:46.243267] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-19T19:48:47.043269] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-19T19:48:47.074365] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T19:48:47.075945] [INFO ] [REMOTE ] LOCL: Full fetch complete (4791 records). [2025-09-19T19:48:47.076017] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-19T19:48:47.447386] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-19T19:48:47.447471] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-19T19:48:47.447620] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-19T19:48:47.447692] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-19T19:48:47.448109] [DEBUG] [LOCAL ] LOCL: Trimmed 4791 records to 3558 (keeping 200 days of data) [2025-09-19T19:48:47.470059] [DEBUG] [LOCAL ] LOCL: Primary data saved (3558 records). [2025-09-19T19:48:47.470128] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-19T19:48:47.470204] [INFO ] [MAIN ] Update Progress: 1272/2372 symbols completed. LOCL took 21.7s. Estimated remaining: 2h 25m 54s. Rate: 7.5 symbols/min [2025-09-19T19:48:47.637440] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:47.665090] [DEBUG] [LOCAL ] LPL: Loaded 25276 existing records from primary storage. [2025-09-19T19:48:47.665224] [INFO ] [MAIN ] LPL: Loaded 25276 existing records. [2025-09-19T19:48:47.844335] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:47.844158] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-19T19:48:47.844679] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-19T19:48:47.845556] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-19T19:48:47.846320] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-19T19:48:47.846416] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-19T19:48:48.200091] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:48.643273] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-19T19:48:48.821791] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T19:48:49.316878] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T19:48:49.448356] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-19T19:48:49.457350] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-19T19:48:50.243265] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-19T19:48:51.043265] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-19T19:48:51.388975] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T19:48:51.843242] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-19T19:48:52.327019] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:48:52.357137] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T19:48:52.643251] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-19T19:48:53.443260] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-19T19:48:54.062961] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T19:48:54.243260] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-19T19:48:54.460984] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T19:48:54.634927] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T19:48:55.043262] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-19T19:48:55.843265] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-19T19:48:56.209172] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:48:56.643272] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-19T19:48:56.824769] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T19:48:56.934436] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T19:48:57.443306] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-19T19:48:58.243241] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-19T19:48:58.898783] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T19:48:59.043256] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-19T19:48:59.265116] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T19:48:59.400702] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T19:48:59.843235] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-19T19:49:00.513938] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:49:00.643285] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-19T19:49:01.443322] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-19T19:49:01.681911] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T19:49:02.243348] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-19T19:49:02.675886] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:49:02.806872] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T19:49:03.043307] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-19T19:49:03.503752] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T19:49:03.843264] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-19T19:49:03.932882] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:49:04.643257] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-19T19:49:05.443270] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-19T19:49:05.635087] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:49:06.049194] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T19:49:06.243267] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-19T19:49:06.653584] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:49:07.043333] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-19T19:49:07.833949] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T19:49:07.843206] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-19T19:49:08.643278] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-19T19:49:09.259077] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T19:49:09.443295] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-19T19:49:09.616050] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T19:49:09.622837] [INFO ] [REMOTE ] LOMA: Full fetch complete (48161 records). [2025-09-19T19:49:09.622956] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-19T19:49:10.008000] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-19T19:49:10.008106] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-19T19:49:10.008969] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-19T19:49:10.009042] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-19T19:49:10.010167] [DEBUG] [LOCAL ] LOMA: Trimmed 48161 records to 32010 (keeping 200 days of data) [2025-09-19T19:49:10.198765] [DEBUG] [LOCAL ] LOMA: Primary data saved (32010 records). [2025-09-19T19:49:10.198945] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-19T19:49:10.199051] [INFO ] [MAIN ] Update Progress: 1273/2372 symbols completed. LOMA took 37.2s. Estimated remaining: 2h 25m 59s. Rate: 7.5 symbols/min [2025-09-19T19:49:10.246886] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-19T19:49:10.384064] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:10.411585] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T19:49:10.457413] [DEBUG] [LOCAL ] LPX: Loaded 40075 existing records from primary storage. [2025-09-19T19:49:10.457566] [INFO ] [MAIN ] LPX: Loaded 40075 existing records. [2025-09-19T19:49:10.641097] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:10.641375] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-19T19:49:10.641440] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-19T19:49:10.642426] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-19T19:49:10.642487] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-19T19:49:10.897050] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:49:11.041533] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:11.043228] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-19T19:49:11.843290] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-19T19:49:12.648434] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-19T19:49:12.648619] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-19T19:49:12.756731] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:49:12.847292] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T19:49:13.443288] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-19T19:49:13.837475] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T19:49:13.844877] [INFO ] [REMOTE ] LPG: Full fetch complete (60159 records). [2025-09-19T19:49:13.845146] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-19T19:49:14.248290] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-19T19:49:14.268850] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-19T19:49:14.268992] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-19T19:49:14.270357] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-19T19:49:14.270681] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-19T19:49:14.272675] [DEBUG] [LOCAL ] LPG: Trimmed 60159 records to 40939 (keeping 200 days of data) [2025-09-19T19:49:14.566967] [DEBUG] [LOCAL ] LPG: Primary data saved (40939 records). [2025-09-19T19:49:14.567176] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-19T19:49:14.568740] [INFO ] [MAIN ] Update Progress: 1274/2372 symbols completed. LPG took 30.3s. Estimated remaining: 2h 25m 48s. Rate: 7.5 symbols/min [2025-09-19T19:49:14.751896] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:14.802345] [DEBUG] [LOCAL ] LRN: Loaded 40443 existing records from primary storage. [2025-09-19T19:49:14.802579] [INFO ] [MAIN ] LRN: Loaded 40443 existing records. [2025-09-19T19:49:14.989086] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:14.989534] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-19T19:49:14.989594] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-19T19:49:14.990636] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-19T19:49:14.990732] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-19T19:49:15.048440] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-19T19:49:15.383110] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:15.410303] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T19:49:15.843240] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-19T19:49:16.484352] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-19T19:49:16.492172] [INFO ] [REMOTE ] LOW: Full fetch complete (76466 records). [2025-09-19T19:49:16.492302] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-19T19:49:16.671067] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-19T19:49:16.903550] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T19:49:16.935481] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-19T19:49:16.936405] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-19T19:49:16.937639] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-19T19:49:16.937783] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-19T19:49:16.940207] [DEBUG] [LOCAL ] LOW: Trimmed 76466 records to 53729 (keeping 200 days of data) [2025-09-19T19:49:17.066437] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T19:49:17.320425] [DEBUG] [LOCAL ] LOW: Primary data saved (53729 records). [2025-09-19T19:49:17.320581] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-19T19:49:17.321922] [INFO ] [MAIN ] Update Progress: 1275/2372 symbols completed. LOW took 44.3s. Estimated remaining: 2h 25m 36s. Rate: 7.5 symbols/min [2025-09-19T19:49:17.448344] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-19T19:49:17.492127] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:17.539417] [DEBUG] [LOCAL ] LSPD: Loaded 43972 existing records from primary storage. [2025-09-19T19:49:17.539564] [INFO ] [MAIN ] LSPD: Loaded 43972 existing records. [2025-09-19T19:49:17.715342] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:17.715625] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-19T19:49:17.715711] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-19T19:49:17.716681] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-19T19:49:17.716741] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-19T19:49:18.079514] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:18.243279] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-19T19:49:18.393249] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T19:49:19.043318] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-19T19:49:19.258081] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T19:49:19.674395] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T19:49:19.843277] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-19T19:49:20.643270] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-19T19:49:20.925265] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T19:49:21.021335] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T19:49:21.443302] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-19T19:49:22.243279] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-19T19:49:22.379737] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:49:22.385455] [INFO ] [REMOTE ] LPL: Full fetch complete (34241 records). [2025-09-19T19:49:22.385570] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-19T19:49:22.794830] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-19T19:49:22.794928] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-19T19:49:22.795700] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-19T19:49:22.795809] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-19T19:49:22.797238] [DEBUG] [LOCAL ] LPL: Trimmed 34241 records to 25507 (keeping 200 days of data) [2025-09-19T19:49:22.912504] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T19:49:22.982730] [DEBUG] [LOCAL ] LPL: Primary data saved (25507 records). [2025-09-19T19:49:22.982884] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-19T19:49:22.982975] [INFO ] [MAIN ] Update Progress: 1276/2372 symbols completed. LPL took 35.5s. Estimated remaining: 2h 25m 26s. Rate: 7.5 symbols/min [2025-09-19T19:49:23.048352] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-19T19:49:23.164972] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:23.201720] [DEBUG] [LOCAL ] LTC: Loaded 30192 existing records from primary storage. [2025-09-19T19:49:23.201874] [INFO ] [MAIN ] LTC: Loaded 30192 existing records. [2025-09-19T19:49:23.391194] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:23.391743] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-19T19:49:23.391858] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-19T19:49:23.392822] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-19T19:49:23.392889] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-19T19:49:23.664938] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T19:49:23.789561] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:23.843219] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-19T19:49:24.643300] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-19T19:49:25.016725] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:49:25.238018] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:49:25.443253] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-19T19:49:26.243325] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-19T19:49:26.449769] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T19:49:27.043297] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-19T19:49:27.526307] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T19:49:27.783275] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T19:49:27.843238] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-19T19:49:28.643303] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-19T19:49:28.826000] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T19:49:29.443278] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-19T19:49:29.566508] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T19:49:30.102451] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T19:49:30.243262] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-19T19:49:31.043245] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-19T19:49:31.167380] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T19:49:31.368045] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T19:49:31.843268] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-19T19:49:32.275580] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T19:49:32.643329] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-19T19:49:33.030624] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T19:49:33.443291] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-19T19:49:34.243255] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-19T19:49:34.347736] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T19:49:35.043292] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-19T19:49:35.285786] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:49:35.706082] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T19:49:35.843268] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-19T19:49:36.198720] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T19:49:36.643330] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-19T19:49:37.363801] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T19:49:37.443226] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-19T19:49:37.850145] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T19:49:38.243299] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-19T19:49:38.973189] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T19:49:39.043227] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-19T19:49:39.843317] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-19T19:49:39.936494] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T19:49:39.942357] [INFO ] [REMOTE ] LPX: Full fetch complete (58326 records). [2025-09-19T19:49:39.942485] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-19T19:49:40.327812] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-19T19:49:40.327956] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-19T19:49:40.328809] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-19T19:49:40.328874] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-19T19:49:40.330133] [DEBUG] [LOCAL ] LPX: Trimmed 58326 records to 40396 (keeping 200 days of data) [2025-09-19T19:49:40.575066] [DEBUG] [LOCAL ] LPX: Primary data saved (40396 records). [2025-09-19T19:49:40.575198] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-19T19:49:40.575280] [INFO ] [MAIN ] Update Progress: 1277/2372 symbols completed. LPX took 30.4s. Estimated remaining: 2h 25m 26s. Rate: 7.5 symbols/min [2025-09-19T19:49:40.643276] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-19T19:49:41.188125] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T19:49:41.443297] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-19T19:49:41.496139] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T19:49:41.502590] [INFO ] [REMOTE ] LSPD: Full fetch complete (61744 records). [2025-09-19T19:49:41.502717] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-19T19:49:41.904446] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-19T19:49:41.904525] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-19T19:49:41.905414] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-19T19:49:41.905489] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-19T19:49:41.907425] [DEBUG] [LOCAL ] LSPD: Trimmed 61744 records to 44246 (keeping 200 days of data) [2025-09-19T19:49:42.159785] [DEBUG] [LOCAL ] LSPD: Primary data saved (44246 records). [2025-09-19T19:49:42.160003] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-19T19:49:42.160125] [INFO ] [MAIN ] Update Progress: 1278/2372 symbols completed. LSPD took 24.8s. Estimated remaining: 2h 25m 13s. Rate: 7.5 symbols/min [2025-09-19T19:49:42.176277] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T19:49:42.243215] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-19T19:49:42.869607] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T19:49:43.043263] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-19T19:49:43.854187] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T19:49:43.862410] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-19T19:49:44.817412] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:49:44.826509] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-19T19:49:45.399718] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T19:49:45.443217] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-19T19:49:46.022607] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:49:46.243250] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-19T19:49:47.075553] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T19:49:47.080022] [INFO ] [REMOTE ] LTC: Full fetch complete (42731 records). [2025-09-19T19:49:47.080122] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-19T19:49:47.476004] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-19T19:49:47.476206] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-19T19:49:47.477021] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-19T19:49:47.477159] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-19T19:49:47.478459] [DEBUG] [LOCAL ] LTC: Trimmed 42731 records to 30403 (keeping 200 days of data) [2025-09-19T19:49:47.495825] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T19:49:47.591498] [INFO ] [REMOTE ] LRN: Full fetch complete (58420 records). [2025-09-19T19:49:47.591992] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-19T19:49:48.000593] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-19T19:49:48.001004] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-19T19:49:48.002137] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-19T19:49:48.002440] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-19T19:49:48.008361] [DEBUG] [LOCAL ] LRN: Trimmed 58420 records to 40764 (keeping 200 days of data) [2025-09-19T19:49:48.325711] [DEBUG] [LOCAL ] LRN: Primary data saved (40764 records). [2025-09-19T19:49:48.327020] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-19T19:49:48.327678] [INFO ] [MAIN ] Update Progress: 1279/2372 symbols completed. LRN took 33.8s. Estimated remaining: 2h 25m 3s. Rate: 7.5 symbols/min [2025-09-19T19:49:48.329193] [DEBUG] [LOCAL ] LTC: Primary data saved (30403 records). [2025-09-19T19:49:48.329461] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-19T19:49:48.329555] [INFO ] [MAIN ] Update Progress: 1280/2372 symbols completed. LTC took 25.3s. Estimated remaining: 2h 24m 48s. Rate: 7.5 symbols/min [2025-09-19T19:49:48.922074] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:48.987940] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:48.991939] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:49.029081] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-19T19:49:49.037975] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-19T19:49:49.059923] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:49.060688] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-19T19:49:49.060899] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-19T19:49:49.061087] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-19T19:49:49.061141] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-19T19:49:49.418254] [DEBUG] [LOCAL ] LU: Loaded 49316 existing records from primary storage. [2025-09-19T19:49:49.417052] [DEBUG] [LOCAL ] LTM: Loaded 35889 existing records from primary storage. [2025-09-19T19:49:49.442361] [INFO ] [MAIN ] LTM: Loaded 35889 existing records. [2025-09-19T19:49:49.423799] [INFO ] [MAIN ] LU: Loaded 49316 existing records. [2025-09-19T19:49:49.519605] [DEBUG] [LOCAL ] LTH: Loaded 52311 existing records from primary storage. [2025-09-19T19:49:49.544226] [INFO ] [MAIN ] LTH: Loaded 52311 existing records. [2025-09-19T19:49:49.793322] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:49.840496] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-19T19:49:50.056849] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:50.107742] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:50.113211] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:50.113815] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-19T19:49:50.114073] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-19T19:49:50.114202] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-19T19:49:50.114028] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-19T19:49:50.114338] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-19T19:49:50.113972] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-19T19:49:50.115269] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-19T19:49:50.115330] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-19T19:49:50.126421] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-19T19:49:50.126370] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-19T19:49:50.158316] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-19T19:49:50.151628] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-19T19:49:51.129614] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:51.160402] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:51.160794] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-19T19:49:51.166887] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-19T19:49:51.251490] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:51.251928] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-19T19:49:51.266324] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T19:49:51.271497] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-19T19:49:52.426107] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T19:49:52.430870] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-19T19:49:52.838173] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:49:52.846329] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-19T19:49:52.963999] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:49:52.973264] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-19T19:49:53.047217] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T19:49:53.443287] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-19T19:49:53.811299] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T19:49:54.243235] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-19T19:49:54.408891] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T19:49:54.921671] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T19:49:55.044220] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-19T19:49:55.044111] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T19:49:55.843300] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-19T19:49:56.052420] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:49:56.643314] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-19T19:49:56.842477] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:49:57.405535] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T19:49:57.443235] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-19T19:49:58.150895] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T19:49:58.243216] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-19T19:49:59.043344] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-19T19:49:59.450875] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T19:49:59.830306] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:49:59.843266] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-19T19:50:00.643332] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-19T19:50:01.172608] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T19:50:01.431256] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:50:01.443238] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-19T19:50:01.553329] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T19:50:02.243316] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-19T19:50:02.525960] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T19:50:03.043325] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-19T19:50:03.843290] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-19T19:50:04.074358] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:50:04.644081] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-19T19:50:04.646383] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T19:50:05.443276] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-19T19:50:05.709359] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:50:06.200899] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T19:50:06.243275] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-19T19:50:06.826094] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T19:50:07.043302] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-19T19:50:07.843274] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-19T19:50:08.127312] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:50:08.216174] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T19:50:08.643283] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-19T19:50:09.443327] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-19T19:50:09.985068] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T19:50:10.243275] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-19T19:50:10.536184] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T19:50:10.746013] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T19:50:10.752997] [INFO ] [REMOTE ] LTM: Full fetch complete (46466 records). [2025-09-19T19:50:10.753111] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-19T19:50:11.046419] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-19T19:50:11.139333] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-19T19:50:11.139413] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-19T19:50:11.140184] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-19T19:50:11.140247] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-19T19:50:11.141358] [DEBUG] [LOCAL ] LTM: Trimmed 46466 records to 36215 (keeping 200 days of data) [2025-09-19T19:50:11.356104] [DEBUG] [LOCAL ] LTM: Primary data saved (36215 records). [2025-09-19T19:50:11.356334] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-19T19:50:11.356443] [INFO ] [MAIN ] Update Progress: 1281/2372 symbols completed. LTM took 23.0s. Estimated remaining: 2h 24m 53s. Rate: 7.5 symbols/min [2025-09-19T19:50:11.530659] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:11.582432] [DEBUG] [LOCAL ] LUMN: Loaded 54024 existing records from primary storage. [2025-09-19T19:50:11.582661] [INFO ] [MAIN ] LUMN: Loaded 54024 existing records. [2025-09-19T19:50:11.772455] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:11.773047] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-19T19:50:11.773146] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-19T19:50:11.774932] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-19T19:50:11.774997] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-19T19:50:11.845751] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-19T19:50:12.095321] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T19:50:12.182730] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:12.470497] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T19:50:12.643260] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-19T19:50:13.443269] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-19T19:50:14.137443] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T19:50:14.243301] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-19T19:50:14.838728] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T19:50:15.043266] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-19T19:50:15.419425] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T19:50:15.643355] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T19:50:15.843274] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-19T19:50:16.643322] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-19T19:50:16.898564] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T19:50:17.443298] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-19T19:50:18.179930] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T19:50:18.243222] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-19T19:50:18.663673] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T19:50:18.838060] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T19:50:18.841867] [INFO ] [REMOTE ] LUCK: Full fetch complete (39748 records). [2025-09-19T19:50:18.841950] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-19T19:50:19.032508] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-19T19:50:19.033096] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:50:19.033185] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:50:19.033262] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-19T19:50:19.033360] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-19T19:50:19.033417] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-19T19:50:19.033479] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-19T19:50:19.033566] [INFO ] [MAIN ] Update Progress: 1282/2372 symbols completed. LUCK took 30.7s. Estimated remaining: 2h 24m 45s. Rate: 7.5 symbols/min [2025-09-19T19:50:19.048494] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-19T19:50:19.207548] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:19.264256] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-09-19T19:50:19.264437] [INFO ] [MAIN ] LUV: Loaded 54079 existing records. [2025-09-19T19:50:19.446609] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:19.446877] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-19T19:50:19.446927] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-19T19:50:19.448883] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-19T19:50:19.448956] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-19T19:50:19.806004] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:19.843213] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-19T19:50:20.051802] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:50:20.643288] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-19T19:50:20.974218] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T19:50:21.443266] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-19T19:50:21.973708] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T19:50:22.243261] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-19T19:50:22.825936] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T19:50:23.043234] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-19T19:50:23.365867] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T19:50:23.373983] [INFO ] [REMOTE ] LTH: Full fetch complete (73818 records). [2025-09-19T19:50:23.374120] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-19T19:50:23.782772] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-19T19:50:23.782899] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-19T19:50:23.784081] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-19T19:50:23.784148] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-19T19:50:23.786067] [DEBUG] [LOCAL ] LTH: Trimmed 73818 records to 52690 (keeping 200 days of data) [2025-09-19T19:50:23.846161] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-19T19:50:24.104840] [DEBUG] [LOCAL ] LTH: Primary data saved (52690 records). [2025-09-19T19:50:24.104995] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-19T19:50:24.105116] [INFO ] [MAIN ] Update Progress: 1283/2372 symbols completed. LTH took 35.8s. Estimated remaining: 2h 24m 35s. Rate: 7.5 symbols/min [2025-09-19T19:50:24.289081] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:24.289621] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-19T19:50:24.289749] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-19T19:50:24.290099] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-19T19:50:24.290334] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-19T19:50:24.290491] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-19T19:50:24.290758] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-19T19:50:24.357114] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T19:50:24.430546] [INFO ] [REMOTE ] LU: Full fetch complete (70474 records). [2025-09-19T19:50:24.436386] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-19T19:50:25.048976] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:25.055179] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-19T19:50:25.158323] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-19T19:50:25.158418] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-19T19:50:25.159587] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-19T19:50:25.159693] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-19T19:50:25.161602] [DEBUG] [LOCAL ] LU: Trimmed 70474 records to 49686 (keeping 200 days of data) [2025-09-19T19:50:25.344735] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:25.354544] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-19T19:50:25.448121] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-19T19:50:25.511228] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T19:50:25.529779] [DEBUG] [LOCAL ] LU: Primary data saved (49686 records). [2025-09-19T19:50:25.529906] [INFO ] [MAIN ] LU: Full history saved. [2025-09-19T19:50:25.530030] [INFO ] [MAIN ] Update Progress: 1284/2372 symbols completed. LU took 37.2s. Estimated remaining: 2h 24m 21s. Rate: 7.5 symbols/min [2025-09-19T19:50:25.724626] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:25.785168] [DEBUG] [LOCAL ] LVS: Loaded 53957 existing records from primary storage. [2025-09-19T19:50:25.785339] [INFO ] [MAIN ] LVS: Loaded 53957 existing records. [2025-09-19T19:50:25.942941] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:25.983480] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-19T19:50:25.990264] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:25.990865] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-19T19:50:25.990943] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-19T19:50:25.992987] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-19T19:50:25.993061] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-19T19:50:26.246731] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-19T19:50:26.312776] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-19T19:50:26.426807] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:26.755807] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:26.756149] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-19T19:50:27.043272] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-19T19:50:27.275052] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:27.275408] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-19T19:50:27.843283] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-19T19:50:28.643274] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-19T19:50:29.443320] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-19T19:50:30.100374] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T19:50:30.203533] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T19:50:30.243230] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-19T19:50:31.043280] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-19T19:50:31.288237] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:31.288589] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-19T19:50:31.475718] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T19:50:31.843285] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-19T19:50:32.421341] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T19:50:32.643282] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-19T19:50:33.443287] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-19T19:50:33.983089] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T19:50:34.084184] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:50:34.243253] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-19T19:50:35.043270] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-19T19:50:35.450392] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T19:50:35.843276] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-19T19:50:36.127681] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T19:50:36.608336] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T19:50:36.643226] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-19T19:50:37.443323] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-19T19:50:37.773576] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T19:50:38.243322] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-19T19:50:39.055119] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-19T19:50:39.058974] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-19T19:50:39.477200] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T19:50:39.683626] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T19:50:39.843266] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-19T19:50:40.643257] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-19T19:50:40.711890] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T19:50:41.443261] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-19T19:50:41.754015] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T19:50:42.134834] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T19:50:42.243274] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-19T19:50:43.043269] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-19T19:50:43.537033] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T19:50:43.540825] [INFO ] [REMOTE ] LUXE: Full fetch complete (12535 records). [2025-09-19T19:50:43.541003] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-19T19:50:43.748170] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 98 unique days, need 200 days [2025-09-19T19:50:43.749241] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:50:43.749605] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:50:43.749729] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-19T19:50:43.749847] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-19T19:50:43.750289] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-19T19:50:43.750369] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-19T19:50:43.750542] [INFO ] [MAIN ] Update Progress: 1285/2372 symbols completed. LUXE took 19.6s. Estimated remaining: 2h 24m 22s. Rate: 7.5 symbols/min [2025-09-19T19:50:43.847149] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-19T19:50:43.861242] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-19T19:50:43.971557] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:43.992687] [DEBUG] [LOCAL ] LVWR: Loaded 17218 existing records from primary storage. [2025-09-19T19:50:43.992918] [INFO ] [MAIN ] LVWR: Loaded 17218 existing records. [2025-09-19T19:50:44.167478] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:44.167773] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-19T19:50:44.167827] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-19T19:50:44.168373] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-19T19:50:44.168437] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-19T19:50:44.525185] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:44.643258] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-19T19:50:45.447004] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-19T19:50:45.452239] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-19T19:50:45.462128] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-19T19:50:45.462252] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-19T19:50:45.676557] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T19:50:45.873140] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-19T19:50:45.873228] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-19T19:50:45.874262] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-19T19:50:45.874430] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-19T19:50:45.876376] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 54414 (keeping 200 days of data) [2025-09-19T19:50:46.127077] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:50:46.243349] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-19T19:50:46.255775] [DEBUG] [LOCAL ] LUMN: Primary data saved (54414 records). [2025-09-19T19:50:46.255988] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-19T19:50:46.256105] [INFO ] [MAIN ] Update Progress: 1286/2372 symbols completed. LUMN took 34.9s. Estimated remaining: 2h 24m 9s. Rate: 7.5 symbols/min [2025-09-19T19:50:46.430127] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:46.485513] [DEBUG] [LOCAL ] LW: Loaded 51681 existing records from primary storage. [2025-09-19T19:50:46.485739] [INFO ] [MAIN ] LW: Loaded 51681 existing records. [2025-09-19T19:50:46.667022] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:46.667256] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-19T19:50:46.667303] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-19T19:50:46.668865] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-19T19:50:46.668927] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-19T19:50:47.028213] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:47.043214] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-19T19:50:47.767856] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T19:50:47.843229] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-19T19:50:48.400571] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T19:50:48.643260] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-19T19:50:49.436254] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T19:50:49.446982] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-19T19:50:50.158839] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T19:50:50.159604] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T19:50:50.243229] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-19T19:50:50.663498] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T19:50:51.043263] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-19T19:50:51.742596] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T19:50:51.843275] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-19T19:50:52.181049] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T19:50:52.535245] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-19T19:50:52.643275] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-19T19:50:53.443262] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-19T19:50:54.243245] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-19T19:50:54.834334] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T19:50:54.993294] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T19:50:55.043223] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-19T19:50:55.380775] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T19:50:55.843264] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-19T19:50:56.643235] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-19T19:50:57.261162] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T19:50:57.443252] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-19T19:50:57.903593] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T19:50:57.913777] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-19T19:50:57.913937] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-19T19:50:58.249557] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-19T19:50:58.322318] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-19T19:50:58.322409] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-19T19:50:58.323434] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-19T19:50:58.323498] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-19T19:50:58.325017] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 54469 (keeping 200 days of data) [2025-09-19T19:50:58.694891] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T19:50:58.716099] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-09-19T19:50:58.716212] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-19T19:50:58.716344] [INFO ] [MAIN ] Update Progress: 1287/2372 symbols completed. LUV took 39.7s. Estimated remaining: 2h 24m 5s. Rate: 7.5 symbols/min [2025-09-19T19:50:58.888687] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:58.900257] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T19:50:58.918479] [DEBUG] [LOCAL ] LXFR: Loaded 17313 existing records from primary storage. [2025-09-19T19:50:58.918603] [INFO ] [MAIN ] LXFR: Loaded 17313 existing records. [2025-09-19T19:50:59.058410] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-19T19:50:59.100059] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:59.100256] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-19T19:50:59.100340] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-19T19:50:59.101113] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-19T19:50:59.101174] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-19T19:50:59.467847] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:59.843267] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-19T19:51:00.330892] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:51:00.338842] [INFO ] [REMOTE ] LVS: Full fetch complete (77515 records). [2025-09-19T19:51:00.338968] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-19T19:51:00.648401] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-19T19:51:00.736344] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-19T19:51:00.736424] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-19T19:51:00.737430] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-19T19:51:00.737515] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-19T19:51:00.739036] [DEBUG] [LOCAL ] LVS: Trimmed 77515 records to 54347 (keeping 200 days of data) [2025-09-19T19:51:01.003486] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T19:51:01.092727] [DEBUG] [LOCAL ] LVS: Primary data saved (54347 records). [2025-09-19T19:51:01.092903] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-19T19:51:01.093582] [INFO ] [MAIN ] Update Progress: 1288/2372 symbols completed. LVS took 35.6s. Estimated remaining: 2h 23m 52s. Rate: 7.5 symbols/min [2025-09-19T19:51:01.272170] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:01.307081] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T19:51:01.363208] [DEBUG] [LOCAL ] LXP: Loaded 51004 existing records from primary storage. [2025-09-19T19:51:01.363397] [INFO ] [MAIN ] LXP: Loaded 51004 existing records. [2025-09-19T19:51:01.448457] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-19T19:51:01.553602] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:01.553911] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-19T19:51:01.553968] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-19T19:51:01.555347] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-19T19:51:01.555408] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-19T19:51:01.914025] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:02.243297] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-19T19:51:03.043285] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-19T19:51:03.447488] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-19T19:51:03.843274] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-19T19:51:04.951076] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (3.50 seconds). [2025-09-19T19:51:04.962324] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-19T19:51:05.666218] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:51:05.671118] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-19T19:51:06.000940] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (2.96 seconds). [2025-09-19T19:51:06.245979] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-19T19:51:06.250447] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (4.01 seconds). [2025-09-19T19:51:06.271837] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T19:51:06.412534] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:51:07.043349] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-19T19:51:07.273473] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T19:51:07.843285] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-19T19:51:08.607493] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:51:08.643224] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-19T19:51:09.172715] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T19:51:09.443362] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-19T19:51:10.243291] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-19T19:51:10.609294] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T19:51:10.689924] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T19:51:11.043246] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-19T19:51:11.114216] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T19:51:11.117850] [INFO ] [REMOTE ] LVWR: Full fetch complete (19635 records). [2025-09-19T19:51:11.117930] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-19T19:51:11.486888] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-19T19:51:11.486995] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-19T19:51:11.487416] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-19T19:51:11.487469] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-19T19:51:11.488284] [DEBUG] [LOCAL ] LVWR: Trimmed 19635 records to 17439 (keeping 200 days of data) [2025-09-19T19:51:11.597497] [DEBUG] [LOCAL ] LVWR: Primary data saved (17439 records). [2025-09-19T19:51:11.597661] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-19T19:51:11.597765] [INFO ] [MAIN ] Update Progress: 1289/2372 symbols completed. LVWR took 27.8s. Estimated remaining: 2h 23m 46s. Rate: 7.5 symbols/min [2025-09-19T19:51:11.766732] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:11.802101] [DEBUG] [LOCAL ] LXU: Loaded 32513 existing records from primary storage. [2025-09-19T19:51:11.802276] [INFO ] [MAIN ] LXU: Loaded 32513 existing records. [2025-09-19T19:51:11.848368] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-19T19:51:11.984539] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:11.984835] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-19T19:51:11.984885] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-19T19:51:11.985915] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-19T19:51:11.985978] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-19T19:51:12.444903] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:12.643300] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-19T19:51:12.928026] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T19:51:12.937950] [INFO ] [REMOTE ] LW: Full fetch complete (74632 records). [2025-09-19T19:51:12.938191] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-19T19:51:13.465479] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-19T19:51:13.447054] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-19T19:51:13.475688] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-19T19:51:13.479866] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-19T19:51:13.482201] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-19T19:51:13.482062] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T19:51:13.489299] [DEBUG] [LOCAL ] LW: Trimmed 74632 records to 52035 (keeping 200 days of data) [2025-09-19T19:51:13.833907] [DEBUG] [LOCAL ] LW: Primary data saved (52035 records). [2025-09-19T19:51:13.834181] [INFO ] [MAIN ] LW: Full history saved. [2025-09-19T19:51:13.834345] [INFO ] [MAIN ] Update Progress: 1290/2372 symbols completed. LW took 27.6s. Estimated remaining: 2h 23m 34s. Rate: 7.5 symbols/min [2025-09-19T19:51:13.985466] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T19:51:14.061802] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:14.114719] [DEBUG] [LOCAL ] LYB: Loaded 53989 existing records from primary storage. [2025-09-19T19:51:14.114886] [INFO ] [MAIN ] LYB: Loaded 53989 existing records. [2025-09-19T19:51:14.248386] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-19T19:51:14.309403] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:14.309742] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-19T19:51:14.309817] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-19T19:51:14.311763] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-19T19:51:14.311837] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-19T19:51:14.686862] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:14.696886] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:51:15.041997] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T19:51:15.046012] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-19T19:51:15.843273] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-19T19:51:16.299759] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T19:51:16.643330] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-19T19:51:16.677199] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-19T19:51:17.443282] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-19T19:51:18.243286] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-19T19:51:18.654586] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T19:51:18.803803] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T19:51:19.043270] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-19T19:51:19.843274] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-19T19:51:20.378124] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T19:51:20.517177] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:51:20.606343] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T19:51:20.609047] [INFO ] [REMOTE ] LXFR: Full fetch complete (25108 records). [2025-09-19T19:51:20.609127] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-19T19:51:20.648433] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-19T19:51:21.017311] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-19T19:51:21.017405] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-19T19:51:21.018219] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-19T19:51:21.018301] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-19T19:51:21.019486] [DEBUG] [LOCAL ] LXFR: Trimmed 25108 records to 17450 (keeping 200 days of data) [2025-09-19T19:51:21.133804] [DEBUG] [LOCAL ] LXFR: Primary data saved (17450 records). [2025-09-19T19:51:21.133995] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-19T19:51:21.134117] [INFO ] [MAIN ] Update Progress: 1291/2372 symbols completed. LXFR took 22.4s. Estimated remaining: 2h 23m 25s. Rate: 7.5 symbols/min [2025-09-19T19:51:21.312713] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:21.367860] [DEBUG] [LOCAL ] LYG: Loaded 53313 existing records from primary storage. [2025-09-19T19:51:21.368048] [INFO ] [MAIN ] LYG: Loaded 53313 existing records. [2025-09-19T19:51:21.448369] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-19T19:51:21.579744] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:21.580066] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-19T19:51:21.580124] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-19T19:51:21.581359] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-19T19:51:21.581422] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-19T19:51:21.997176] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:22.243290] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-19T19:51:22.592810] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T19:51:23.043290] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-19T19:51:23.831703] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-19T19:51:23.843217] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-19T19:51:23.894256] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:51:24.422717] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T19:51:24.643268] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-19T19:51:25.443364] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-19T19:51:25.760538] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:51:26.164334] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T19:51:26.243309] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-19T19:51:26.620259] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T19:51:27.043331] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-19T19:51:27.567041] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T19:51:27.843278] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-19T19:51:28.648397] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-19T19:51:28.663252] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T19:51:28.795846] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:51:29.443269] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-19T19:51:30.243286] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-19T19:51:30.678679] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:51:31.043277] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-19T19:51:31.517193] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T19:51:31.826833] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T19:51:31.843217] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-19T19:51:32.643320] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-19T19:51:33.021600] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T19:51:33.408101] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:51:33.443281] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-19T19:51:34.150957] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T19:51:34.243283] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-19T19:51:35.043303] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-19T19:51:35.414380] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:51:35.422324] [INFO ] [REMOTE ] LXP: Full fetch complete (72394 records). [2025-09-19T19:51:35.422487] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-19T19:51:35.846957] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-19T19:51:35.867101] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-19T19:51:35.868005] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-19T19:51:35.869169] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-19T19:51:35.869353] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-19T19:51:35.871160] [DEBUG] [LOCAL ] LXP: Trimmed 72394 records to 51359 (keeping 200 days of data) [2025-09-19T19:51:36.156408] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:51:36.243679] [DEBUG] [LOCAL ] LXP: Primary data saved (51359 records). [2025-09-19T19:51:36.243841] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-19T19:51:36.244219] [INFO ] [MAIN ] Update Progress: 1292/2372 symbols completed. LXP took 35.2s. Estimated remaining: 2h 23m 23s. Rate: 7.5 symbols/min [2025-09-19T19:51:36.417707] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:36.473318] [DEBUG] [LOCAL ] LYV: Loaded 51684 existing records from primary storage. [2025-09-19T19:51:36.473471] [INFO ] [MAIN ] LYV: Loaded 51684 existing records. [2025-09-19T19:51:36.645377] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-19T19:51:36.660130] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:36.660439] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-19T19:51:36.660514] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-19T19:51:36.661703] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-19T19:51:36.661764] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-19T19:51:37.048417] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:37.151806] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T19:51:37.324288] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T19:51:37.443258] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-19T19:51:38.243295] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-19T19:51:38.576799] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T19:51:38.935061] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:51:38.939300] [INFO ] [REMOTE ] LXU: Full fetch complete (44832 records). [2025-09-19T19:51:38.939444] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-19T19:51:39.051470] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-19T19:51:39.333820] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-19T19:51:39.333917] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-19T19:51:39.334720] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-19T19:51:39.334785] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-19T19:51:39.335955] [DEBUG] [LOCAL ] LXU: Trimmed 44832 records to 32691 (keeping 200 days of data) [2025-09-19T19:51:39.515303] [DEBUG] [LOCAL ] LXU: Primary data saved (32691 records). [2025-09-19T19:51:39.515445] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-19T19:51:39.515542] [INFO ] [MAIN ] Update Progress: 1293/2372 symbols completed. LXU took 27.9s. Estimated remaining: 2h 23m 11s. Rate: 7.5 symbols/min [2025-09-19T19:51:39.693016] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:39.732169] [DEBUG] [LOCAL ] LZB: Loaded 35776 existing records from primary storage. [2025-09-19T19:51:39.732320] [INFO ] [MAIN ] LZB: Loaded 35776 existing records. [2025-09-19T19:51:39.848578] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-19T19:51:39.909144] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:39.909354] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-19T19:51:39.909402] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-19T19:51:39.910282] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-19T19:51:39.910343] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-19T19:51:40.263963] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:40.299117] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T19:51:40.643327] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-19T19:51:41.221811] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T19:51:41.443271] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-19T19:51:41.927842] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T19:51:42.243276] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-19T19:51:42.933793] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T19:51:43.043246] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-19T19:51:43.226715] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T19:51:43.834238] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T19:51:43.844976] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-19T19:51:44.643243] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-19T19:51:45.289284] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T19:51:45.443240] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-19T19:51:45.673187] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T19:51:46.243231] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-19T19:51:46.941841] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T19:51:47.043238] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-19T19:51:47.669918] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T19:51:47.681616] [INFO ] [REMOTE ] LYB: Full fetch complete (77441 records). [2025-09-19T19:51:47.681904] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-19T19:51:47.857949] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-19T19:51:48.094761] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-19T19:51:48.094881] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-19T19:51:48.097539] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-19T19:51:48.097748] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-19T19:51:48.100819] [DEBUG] [LOCAL ] LYB: Trimmed 77441 records to 54378 (keeping 200 days of data) [2025-09-19T19:51:48.234243] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T19:51:48.494798] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:51:48.521514] [DEBUG] [LOCAL ] LYB: Primary data saved (54378 records). [2025-09-19T19:51:48.521729] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-19T19:51:48.521842] [INFO ] [MAIN ] Update Progress: 1294/2372 symbols completed. LYB took 34.7s. Estimated remaining: 2h 23m 4s. Rate: 7.5 symbols/min [2025-09-19T19:51:48.648393] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-19T19:51:48.707408] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:48.724038] [DEBUG] [LOCAL ] LZM: Loaded 13504 existing records from primary storage. [2025-09-19T19:51:48.724163] [INFO ] [MAIN ] LZM: Loaded 13504 existing records. [2025-09-19T19:51:48.916863] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:48.917211] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-19T19:51:48.917274] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-19T19:51:48.917717] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-19T19:51:48.917776] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-19T19:51:49.335149] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:49.336116] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T19:51:49.443252] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-19T19:51:50.243274] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-19T19:51:50.727518] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T19:51:50.762448] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T19:51:51.043290] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-19T19:51:51.843265] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-19T19:51:52.388388] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T19:51:52.643309] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-19T19:51:52.885554] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T19:51:53.161298] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T19:51:53.443265] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-19T19:51:54.243270] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-19T19:51:54.697829] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T19:51:55.043272] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-19T19:51:55.095860] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T19:51:55.176260] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T19:51:55.843282] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-19T19:51:56.643268] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-19T19:51:57.033822] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:51:57.443315] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-19T19:51:57.578104] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T19:51:57.985346] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T19:51:58.243271] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-19T19:51:59.040262] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-19T19:51:59.047254] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-19T19:51:59.049011] [INFO ] [REMOTE ] LYG: Full fetch complete (76059 records). [2025-09-19T19:51:59.049100] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-19T19:51:59.174130] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:51:59.457719] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-19T19:51:59.457817] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-19T19:51:59.458901] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-19T19:51:59.458986] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-19T19:51:59.460581] [DEBUG] [LOCAL ] LYG: Trimmed 76059 records to 53679 (keeping 200 days of data) [2025-09-19T19:51:59.792004] [DEBUG] [LOCAL ] LYG: Primary data saved (53679 records). [2025-09-19T19:51:59.792194] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-19T19:51:59.792320] [INFO ] [MAIN ] Update Progress: 1295/2372 symbols completed. LYG took 38.7s. Estimated remaining: 2h 22m 59s. Rate: 7.5 symbols/min [2025-09-19T19:51:59.849405] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-19T19:51:59.974219] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:00.031979] [DEBUG] [LOCAL ] M: Loaded 53926 existing records from primary storage. [2025-09-19T19:52:00.032170] [INFO ] [MAIN ] M: Loaded 53926 existing records. [2025-09-19T19:52:00.218622] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:00.218918] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-19T19:52:00.218969] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-19T19:52:00.220310] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-19T19:52:00.220374] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-19T19:52:00.582633] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:00.643247] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-19T19:52:00.800806] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T19:52:01.443339] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-19T19:52:02.086344] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T19:52:02.243329] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-19T19:52:02.356860] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T19:52:02.624054] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T19:52:03.043263] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-19T19:52:03.843296] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-19T19:52:04.179280] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T19:52:04.436804] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T19:52:04.643324] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-19T19:52:05.096533] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-19T19:52:05.443305] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-19T19:52:06.187692] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T19:52:06.243336] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-19T19:52:06.349197] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T19:52:07.043324] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-19T19:52:07.843276] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-19T19:52:08.375563] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T19:52:08.643288] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-19T19:52:08.689986] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T19:52:09.443351] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-19T19:52:09.893013] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T19:52:09.900768] [INFO ] [REMOTE ] LYV: Full fetch complete (73712 records). [2025-09-19T19:52:09.900942] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-19T19:52:10.262223] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-19T19:52:10.325629] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-19T19:52:10.325807] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-19T19:52:10.326923] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-19T19:52:10.327147] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-19T19:52:10.329161] [DEBUG] [LOCAL ] LYV: Trimmed 73712 records to 52036 (keeping 200 days of data) [2025-09-19T19:52:10.454718] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:52:10.697053] [DEBUG] [LOCAL ] LYV: Primary data saved (52036 records). [2025-09-19T19:52:10.697210] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-19T19:52:10.698019] [INFO ] [MAIN ] Update Progress: 1296/2372 symbols completed. LYV took 34.5s. Estimated remaining: 2h 22m 53s. Rate: 7.5 symbols/min [2025-09-19T19:52:10.876176] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:10.934407] [DEBUG] [LOCAL ] MA: Loaded 52979 existing records from primary storage. [2025-09-19T19:52:10.934571] [INFO ] [MAIN ] MA: Loaded 52979 existing records. [2025-09-19T19:52:11.051316] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-19T19:52:11.138382] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:11.138671] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-19T19:52:11.138734] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-19T19:52:11.140477] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-19T19:52:11.140541] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-19T19:52:11.525731] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:52:11.529890] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T19:52:11.563518] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:11.569474] [INFO ] [REMOTE ] LZB: Full fetch complete (50064 records). [2025-09-19T19:52:11.569574] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-19T19:52:11.853039] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-19T19:52:11.960414] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-19T19:52:11.960601] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-19T19:52:11.961540] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-19T19:52:11.961606] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-19T19:52:11.963075] [DEBUG] [LOCAL ] LZB: Trimmed 50064 records to 36007 (keeping 200 days of data) [2025-09-19T19:52:12.200883] [DEBUG] [LOCAL ] LZB: Primary data saved (36007 records). [2025-09-19T19:52:12.201084] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-19T19:52:12.201233] [INFO ] [MAIN ] Update Progress: 1297/2372 symbols completed. LZB took 32.7s. Estimated remaining: 2h 22m 40s. Rate: 7.5 symbols/min [2025-09-19T19:52:12.400205] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:12.448924] [DEBUG] [LOCAL ] MAA: Loaded 43351 existing records from primary storage. [2025-09-19T19:52:12.449076] [INFO ] [MAIN ] MAA: Loaded 43351 existing records. [2025-09-19T19:52:12.643294] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-19T19:52:12.647910] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:12.649336] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-19T19:52:12.649415] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-19T19:52:12.650719] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-19T19:52:12.650798] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-19T19:52:12.951674] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T19:52:13.038511] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:13.287205] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T19:52:13.443269] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-19T19:52:14.243287] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-19T19:52:14.375126] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T19:52:15.043271] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-19T19:52:15.238765] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T19:52:15.317062] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T19:52:15.843271] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-19T19:52:16.643258] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-19T19:52:16.897407] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T19:52:16.917061] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T19:52:16.920495] [INFO ] [REMOTE ] LZM: Full fetch complete (17606 records). [2025-09-19T19:52:16.920586] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-19T19:52:17.336533] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-19T19:52:17.336617] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-19T19:52:17.337023] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-19T19:52:17.337079] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-19T19:52:17.337682] [DEBUG] [LOCAL ] LZM: Trimmed 17606 records to 13614 (keeping 200 days of data) [2025-09-19T19:52:17.411887] [DEBUG] [LOCAL ] LZM: Primary data saved (13614 records). [2025-09-19T19:52:17.412029] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-19T19:52:17.412118] [INFO ] [MAIN ] Update Progress: 1298/2372 symbols completed. LZM took 28.9s. Estimated remaining: 2h 22m 30s. Rate: 7.5 symbols/min [2025-09-19T19:52:17.448369] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-19T19:52:17.582131] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:17.629187] [DEBUG] [LOCAL ] MAC: Loaded 50122 existing records from primary storage. [2025-09-19T19:52:17.629381] [INFO ] [MAIN ] MAC: Loaded 50122 existing records. [2025-09-19T19:52:17.810218] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:17.810522] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-19T19:52:17.810594] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-19T19:52:17.811857] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-19T19:52:17.811920] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-19T19:52:18.202143] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:18.243222] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-19T19:52:18.503621] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:52:19.043255] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-19T19:52:19.714880] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T19:52:19.843252] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-19T19:52:20.502371] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T19:52:20.643231] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-19T19:52:20.822961] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T19:52:21.443282] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-19T19:52:21.943381] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T19:52:22.243309] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-19T19:52:22.401800] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T19:52:23.043274] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-19T19:52:23.579405] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T19:52:23.843285] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-19T19:52:24.091740] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T19:52:24.643255] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-19T19:52:25.331181] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-19T19:52:25.443230] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-19T19:52:25.579918] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:52:26.032019] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T19:52:26.243244] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-19T19:52:27.043340] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-19T19:52:27.390727] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:52:27.790843] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T19:52:27.843228] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-19T19:52:28.238677] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T19:52:28.643268] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-19T19:52:29.316794] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T19:52:29.443261] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-19T19:52:30.243267] [INFO ] [REMOTE ] MAA: Fetching pr